2024-04-24T22:45:48.426 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-24T22:45:48.426 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672162 --verbose --name teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi --owner scheduled_teuthology@teuthology --description fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_blogbench traceless/50pc} -- /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672162/orig.config.yaml 2024-04-24T22:45:48.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T22:45:48.562 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672162 branch: squid description: fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_blogbench traceless/50pc} email: ceph-qa@ceph.com first_in_suite: false job_id: '7672162' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds inject traceless reply probability: 0.5 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 8528 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 122/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHFT6u11gSFQRdk5urlkReFURvi4pwMHs1ad51Li94iDbIdEvBvrfhpM40YrhaeGbid9MsiTVKlOuKQoILFmmps= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG9Wv2GoXPqO4HErfCIy9w7FrNofWkF1vGw7kZeRePbjeK/MqQKzT26bu54jZR5yuVtyQU294vXu1G1n7o79BFU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - check-counter: counters: mds: - mds.dir_split - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-24T22:45:48.562 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa; will attempt to use it 2024-04-24T22:45:48.563 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks 2024-04-24T22:45:48.563 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-24T22:45:48.565 INFO:teuthology.task.internal:Checking packages... 2024-04-24T22:45:48.588 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-24T22:45:48.588 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-24T22:45:48.588 INFO:teuthology.packaging:ref: None 2024-04-24T22:45:48.589 INFO:teuthology.packaging:tag: None 2024-04-24T22:45:48.589 INFO:teuthology.packaging:branch: squid 2024-04-24T22:45:48.589 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T22:45:48.589 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-04-24T22:45:48.969 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2445-gd2c45d97-1jammy 2024-04-24T22:45:48.971 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-24T22:45:48.977 INFO:teuthology.task.internal:no buildpackages task found 2024-04-24T22:45:48.977 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-24T22:45:48.984 INFO:teuthology.task.internal:Saving configuration 2024-04-24T22:45:49.001 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-24T22:45:49.007 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-24T22:45:49.031 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672162', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 22:39:54.833330', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINk1kn/WSM0SooKXdT+KjOsxF/IqQYGxxqopbBDOIFHx'} 2024-04-24T22:45:49.055 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672162', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 22:39:54.835309', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBv0Em/ttcBzyudEOit/uIeocrIvC34YTtmhpcPxu6B3'} 2024-04-24T22:45:49.056 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-24T22:45:49.061 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-24T22:45:49.061 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-24T22:45:49.061 INFO:teuthology.run_tasks:Running task console_log... 2024-04-24T22:45:49.132 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc12775e3a0>, signals=[15]) 2024-04-24T22:45:49.133 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-24T22:45:49.139 INFO:teuthology.task.internal:Opening connections... 2024-04-24T22:45:49.139 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2024-04-24T22:45:49.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:45:49.229 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-04-24T22:45:49.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:45:49.313 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-24T22:45:49.323 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-04-24T22:45:49.328 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-04-24T22:45:49.328 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-04-24T22:45:49.378 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-24T22:45:49.378 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Ubuntu" 2024-04-24T22:45:49.378 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="22.04" 2024-04-24T22:45:49.378 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-24T22:45:49.378 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_CODENAME=jammy 2024-04-24T22:45:49.378 INFO:teuthology.orchestra.run.smithi043.stdout:ID=ubuntu 2024-04-24T22:45:49.378 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE=debian 2024-04-24T22:45:49.378 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-24T22:45:49.378 INFO:teuthology.orchestra.run.smithi043.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-24T22:45:49.378 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-24T22:45:49.378 INFO:teuthology.orchestra.run.smithi043.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-24T22:45:49.378 INFO:teuthology.orchestra.run.smithi043.stdout:UBUNTU_CODENAME=jammy 2024-04-24T22:45:49.379 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-04-24T22:45:49.402 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-04-24T22:45:49.406 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-04-24T22:45:49.407 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-04-24T22:45:49.452 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-24T22:45:49.452 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu" 2024-04-24T22:45:49.452 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="22.04" 2024-04-24T22:45:49.452 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-24T22:45:49.452 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=jammy 2024-04-24T22:45:49.453 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu 2024-04-24T22:45:49.453 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian 2024-04-24T22:45:49.453 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-24T22:45:49.453 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-24T22:45:49.453 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-24T22:45:49.453 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-24T22:45:49.454 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=jammy 2024-04-24T22:45:49.454 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-04-24T22:45:49.477 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-24T22:45:49.487 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-24T22:45:49.523 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-24T22:45:49.523 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2024-04-24T22:45:49.525 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-04-24T22:45:49.529 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-24T22:45:49.535 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-24T22:45:49.535 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2024-04-24T22:45:49.571 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-04-24T22:45:49.587 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-24T22:45:49.634 INFO:teuthology.run_tasks:Running task kernel... 2024-04-24T22:45:49.650 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-24T22:45:49.650 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-24T22:45:49.651 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T22:45:49.651 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T22:45:49.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T22:45:49.656 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-04-24T22:45:49.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T22:45:49.657 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-04-24T22:45:49.704 INFO:teuthology.orchestra.run.smithi162.stdout:5.15.0-56-generic 2024-04-24T22:45:49.704 INFO:teuthology.task.kernel:Running kernel on smithi162: 5.15.0-56-generic 2024-04-24T22:45:49.704 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get clean 2024-04-24T22:45:49.706 INFO:teuthology.orchestra.run.smithi043.stdout:5.15.0-56-generic 2024-04-24T22:45:49.707 INFO:teuthology.task.kernel:Running kernel on smithi043: 5.15.0-56-generic 2024-04-24T22:45:49.707 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get clean 2024-04-24T22:45:49.828 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2024-04-24T22:45:49.841 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get update 2024-04-24T22:45:49.984 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T22:45:49.985 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-24T22:45:49.985 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-24T22:45:49.989 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T22:45:49.992 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-24T22:45:49.992 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-24T22:45:50.076 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-24T22:45:50.080 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-24T22:45:50.218 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-24T22:45:50.228 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-24T22:45:50.296 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-24T22:45:50.309 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-24T22:45:50.340 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-24T22:45:50.348 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-24T22:45:50.348 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-24T22:45:50.352 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-24T22:45:50.353 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-24T22:45:50.354 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-24T22:45:50.357 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-24T22:45:50.360 INFO:teuthology.orchestra.run.smithi043.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-24T22:45:50.360 INFO:teuthology.orchestra.run.smithi043.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-24T22:45:50.391 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-24T22:45:50.396 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T22:45:50.396 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-24T22:45:50.400 INFO:teuthology.orchestra.run.smithi043.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-24T22:45:50.401 INFO:teuthology.orchestra.run.smithi043.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-24T22:45:50.402 INFO:teuthology.orchestra.run.smithi043.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-24T22:45:50.410 INFO:teuthology.orchestra.run.smithi043.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T22:45:50.410 INFO:teuthology.orchestra.run.smithi043.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-24T22:45:50.428 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-24T22:45:50.438 INFO:teuthology.orchestra.run.smithi043.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-24T22:45:50.445 INFO:teuthology.orchestra.run.smithi043.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-24T22:45:50.447 INFO:teuthology.orchestra.run.smithi043.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-24T22:45:50.455 INFO:teuthology.orchestra.run.smithi043.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-24T22:45:50.455 INFO:teuthology.orchestra.run.smithi043.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-24T22:45:50.462 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-24T22:45:50.473 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-24T22:45:50.487 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-24T22:45:50.488 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-24T22:45:50.488 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-24T22:45:50.488 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-24T22:45:50.489 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-24T22:45:50.497 INFO:teuthology.orchestra.run.smithi043.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-24T22:45:50.498 INFO:teuthology.orchestra.run.smithi043.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-24T22:45:50.498 INFO:teuthology.orchestra.run.smithi043.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-24T22:45:50.499 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-24T22:45:50.504 INFO:teuthology.orchestra.run.smithi043.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-24T22:45:50.505 INFO:teuthology.orchestra.run.smithi043.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-24T22:45:50.506 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-24T22:45:50.506 INFO:teuthology.orchestra.run.smithi043.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-24T22:45:50.507 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-24T22:45:50.540 INFO:teuthology.orchestra.run.smithi043.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-24T22:45:50.545 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-24T22:45:50.546 INFO:teuthology.orchestra.run.smithi043.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T22:45:50.547 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-24T22:45:50.547 INFO:teuthology.orchestra.run.smithi043.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-24T22:45:50.554 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T22:45:50.554 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-24T22:45:50.565 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-24T22:45:50.566 INFO:teuthology.orchestra.run.smithi043.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-24T22:45:50.582 INFO:teuthology.orchestra.run.smithi043.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-24T22:45:50.586 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-24T22:45:50.586 INFO:teuthology.orchestra.run.smithi043.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-24T22:45:50.587 INFO:teuthology.orchestra.run.smithi043.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-24T22:45:50.587 INFO:teuthology.orchestra.run.smithi043.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-24T22:45:50.589 INFO:teuthology.orchestra.run.smithi043.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-24T22:45:50.590 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-24T22:45:50.590 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-24T22:45:50.591 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-24T22:45:50.600 INFO:teuthology.orchestra.run.smithi043.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-24T22:45:50.600 INFO:teuthology.orchestra.run.smithi043.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [90.8 kB] 2024-04-24T22:45:50.602 INFO:teuthology.orchestra.run.smithi043.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [82.9 kB] 2024-04-24T22:45:50.603 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-24T22:45:50.604 INFO:teuthology.orchestra.run.smithi043.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-24T22:45:50.604 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-24T22:45:50.604 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [82.9 kB] 2024-04-24T22:45:50.606 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [90.8 kB] 2024-04-24T22:45:50.607 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-24T22:45:50.622 INFO:teuthology.orchestra.run.smithi043.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-24T22:45:50.622 INFO:teuthology.orchestra.run.smithi043.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [18.5 kB] 2024-04-24T22:45:50.622 INFO:teuthology.orchestra.run.smithi043.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [29.8 kB] 2024-04-24T22:45:50.623 INFO:teuthology.orchestra.run.smithi043.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-24T22:45:50.623 INFO:teuthology.orchestra.run.smithi043.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-24T22:45:50.624 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-24T22:45:50.624 INFO:teuthology.orchestra.run.smithi162.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [29.8 kB] 2024-04-24T22:45:50.625 INFO:teuthology.orchestra.run.smithi162.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [18.5 kB] 2024-04-24T22:45:50.625 INFO:teuthology.orchestra.run.smithi162.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-24T22:45:50.626 INFO:teuthology.orchestra.run.smithi162.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-24T22:45:55.971 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 13.3 MB in 2s (7,106 kB/s) 2024-04-24T22:45:56.265 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 13.3 MB in 2s (6,821 kB/s) 2024-04-24T22:45:57.329 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-04-24T22:45:57.346 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T22:45:57.397 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-04-24T22:45:57.575 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2024-04-24T22:45:57.575 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2024-04-24T22:45:57.611 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-04-24T22:45:57.629 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T22:45:57.684 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-04-24T22:45:57.731 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T22:45:57.731 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T22:45:57.731 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T22:45:57.732 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T22:45:57.732 INFO:teuthology.orchestra.run.smithi162.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-24T22:45:57.732 INFO:teuthology.orchestra.run.smithi162.stdout: python2.7-minimal 2024-04-24T22:45:57.732 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T22:45:57.733 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2024-04-24T22:45:57.733 INFO:teuthology.orchestra.run.smithi162.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T22:45:57.733 INFO:teuthology.orchestra.run.smithi162.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-24T22:45:57.734 INFO:teuthology.orchestra.run.smithi162.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-24T22:45:57.735 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2024-04-24T22:45:57.735 INFO:teuthology.orchestra.run.smithi162.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-24T22:45:57.735 INFO:teuthology.orchestra.run.smithi162.stdout:Recommended packages: 2024-04-24T22:45:57.735 INFO:teuthology.orchestra.run.smithi162.stdout: thermald 2024-04-24T22:45:57.781 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2024-04-24T22:45:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T22:45:57.781 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-24T22:45:57.782 INFO:teuthology.orchestra.run.smithi162.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-24T22:45:57.783 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages will be upgraded: 2024-04-24T22:45:57.783 INFO:teuthology.orchestra.run.smithi162.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-24T22:45:57.839 INFO:teuthology.orchestra.run.smithi162.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T22:45:57.839 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 113 MB of archives. 2024-04-24T22:45:57.839 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-24T22:45:57.839 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-24T22:45:57.865 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2024-04-24T22:45:57.866 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2024-04-24T22:45:58.028 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T22:45:58.028 INFO:teuthology.orchestra.run.smithi043.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T22:45:58.028 INFO:teuthology.orchestra.run.smithi043.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T22:45:58.029 INFO:teuthology.orchestra.run.smithi043.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T22:45:58.029 INFO:teuthology.orchestra.run.smithi043.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-24T22:45:58.029 INFO:teuthology.orchestra.run.smithi043.stdout: python2.7-minimal 2024-04-24T22:45:58.029 INFO:teuthology.orchestra.run.smithi043.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T22:45:58.030 INFO:teuthology.orchestra.run.smithi043.stdout:The following additional packages will be installed: 2024-04-24T22:45:58.030 INFO:teuthology.orchestra.run.smithi043.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T22:45:58.030 INFO:teuthology.orchestra.run.smithi043.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-24T22:45:58.030 INFO:teuthology.orchestra.run.smithi043.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-24T22:45:58.031 INFO:teuthology.orchestra.run.smithi043.stdout:Suggested packages: 2024-04-24T22:45:58.031 INFO:teuthology.orchestra.run.smithi043.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-24T22:45:58.031 INFO:teuthology.orchestra.run.smithi043.stdout:Recommended packages: 2024-04-24T22:45:58.031 INFO:teuthology.orchestra.run.smithi043.stdout: thermald 2024-04-24T22:45:58.074 INFO:teuthology.orchestra.run.smithi043.stdout:The following NEW packages will be installed: 2024-04-24T22:45:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T22:45:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-24T22:45:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-24T22:45:58.076 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages will be upgraded: 2024-04-24T22:45:58.076 INFO:teuthology.orchestra.run.smithi043.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-24T22:45:58.256 INFO:teuthology.orchestra.run.smithi043.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T22:45:58.257 INFO:teuthology.orchestra.run.smithi043.stdout:Need to get 113 MB of archives. 2024-04-24T22:45:58.257 INFO:teuthology.orchestra.run.smithi043.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-24T22:45:58.257 INFO:teuthology.orchestra.run.smithi043.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-24T22:45:58.304 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-24T22:45:58.421 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-24T22:45:59.418 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-24T22:45:59.418 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-24T22:45:59.418 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-24T22:45:59.550 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-24T22:45:59.576 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-24T22:45:59.669 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-24T22:45:59.956 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 113 MB in 2s (63.4 MB/s) 2024-04-24T22:46:00.024 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-24T22:46:00.137 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-24T22:46:02.083 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-24T22:46:02.087 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T22:46:02.142 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:02.279 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-24T22:46:02.279 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-24T22:46:02.279 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-24T22:46:02.690 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-24T22:46:02.771 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-24T22:46:03.181 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 113 MB in 5s (24.2 MB/s) 2024-04-24T22:46:03.335 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-24T22:46:04.267 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-24T22:46:04.288 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T22:46:04.380 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:04.837 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-24T22:46:04.857 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T22:46:04.895 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:05.353 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-24T22:46:05.358 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T22:46:05.415 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:07.908 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-24T22:46:07.930 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T22:46:08.031 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:08.495 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-24T22:46:08.515 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T22:46:08.553 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:11.535 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T22:46:11.638 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T22:46:11.979 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T22:46:12.116 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T22:46:12.402 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-24T22:46:12.424 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-24T22:46:12.468 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T22:46:15.194 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T22:46:15.296 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T22:46:15.637 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T22:46:15.766 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T22:46:16.078 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-24T22:46:16.101 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-24T22:46:16.136 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T22:46:18.336 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-24T22:46:18.372 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T22:46:18.402 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:21.163 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T22:46:21.288 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T22:46:21.622 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T22:46:21.744 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:21.837 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-24T22:46:21.870 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-24T22:46:21.875 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T22:46:21.920 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:21.998 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:23.288 INFO:teuthology.orchestra.run.smithi162.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-24T22:46:23.288 INFO:teuthology.orchestra.run.smithi162.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-24T22:46:23.288 INFO:teuthology.orchestra.run.smithi162.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-24T22:46:23.288 INFO:teuthology.orchestra.run.smithi162.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-24T22:46:23.442 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:24.483 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T22:46:24.614 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T22:46:24.844 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:24.956 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T22:46:25.053 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:25.170 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-24T22:46:25.299 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:26.653 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-24T22:46:26.804 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-24T22:46:26.922 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:26.998 INFO:teuthology.orchestra.run.smithi162.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-24T22:46:26.998 INFO:teuthology.orchestra.run.smithi162.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-24T22:46:27.181 INFO:teuthology.orchestra.run.smithi043.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-24T22:46:27.181 INFO:teuthology.orchestra.run.smithi043.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-24T22:46:27.181 INFO:teuthology.orchestra.run.smithi043.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-24T22:46:27.181 INFO:teuthology.orchestra.run.smithi043.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-24T22:46:27.326 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:28.720 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:30.154 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-24T22:46:30.280 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-24T22:46:30.406 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T22:46:30.469 INFO:teuthology.orchestra.run.smithi043.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-24T22:46:30.469 INFO:teuthology.orchestra.run.smithi043.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-24T22:46:41.720 INFO:teuthology.orchestra.run.smithi162.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-24T22:46:41.720 INFO:teuthology.orchestra.run.smithi162.stdout:Sourcing file `/etc/default/grub' 2024-04-24T22:46:41.732 INFO:teuthology.orchestra.run.smithi162.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T22:46:41.748 INFO:teuthology.orchestra.run.smithi162.stdout:Generating grub configuration file ... 2024-04-24T22:46:42.020 INFO:teuthology.orchestra.run.smithi162.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T22:46:42.041 INFO:teuthology.orchestra.run.smithi162.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T22:46:42.344 INFO:teuthology.orchestra.run.smithi162.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T22:46:42.351 INFO:teuthology.orchestra.run.smithi162.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T22:46:42.426 INFO:teuthology.orchestra.run.smithi162.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T22:46:42.432 INFO:teuthology.orchestra.run.smithi162.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T22:46:42.597 INFO:teuthology.orchestra.run.smithi162.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T22:46:42.597 INFO:teuthology.orchestra.run.smithi162.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T22:46:42.597 INFO:teuthology.orchestra.run.smithi162.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T22:46:42.635 INFO:teuthology.orchestra.run.smithi162.stdout:done 2024-04-24T22:46:43.102 DEBUG:teuthology.orchestra.run.smithi162:> dpkg -s linux-image-generic 2024-04-24T22:46:43.169 INFO:teuthology.orchestra.run.smithi162.stdout:Package: linux-image-generic 2024-04-24T22:46:43.169 INFO:teuthology.orchestra.run.smithi162.stdout:Status: install ok installed 2024-04-24T22:46:43.169 INFO:teuthology.orchestra.run.smithi162.stdout:Priority: optional 2024-04-24T22:46:43.169 INFO:teuthology.orchestra.run.smithi162.stdout:Section: kernel 2024-04-24T22:46:43.169 INFO:teuthology.orchestra.run.smithi162.stdout:Installed-Size: 21 2024-04-24T22:46:43.170 INFO:teuthology.orchestra.run.smithi162.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T22:46:43.170 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: amd64 2024-04-24T22:46:43.170 INFO:teuthology.orchestra.run.smithi162.stdout:Source: linux-meta 2024-04-24T22:46:43.170 INFO:teuthology.orchestra.run.smithi162.stdout:Version: 5.15.0.105.102 2024-04-24T22:46:43.170 INFO:teuthology.orchestra.run.smithi162.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T22:46:43.170 INFO:teuthology.orchestra.run.smithi162.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T22:46:43.170 INFO:teuthology.orchestra.run.smithi162.stdout:Recommends: thermald 2024-04-24T22:46:43.170 INFO:teuthology.orchestra.run.smithi162.stdout:Description: Generic Linux kernel image 2024-04-24T22:46:43.170 INFO:teuthology.orchestra.run.smithi162.stdout: This package will always depend on the latest generic kernel image 2024-04-24T22:46:43.170 INFO:teuthology.orchestra.run.smithi162.stdout: available. 2024-04-24T22:46:43.170 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-24T22:46:43.171 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-24T22:46:43.171 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-24T22:46:43.171 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-24T22:46:43.171 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=None, version=distro) 2024-04-24T22:46:43.171 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get clean 2024-04-24T22:46:43.371 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2024-04-24T22:46:43.485 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T22:46:43.603 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T22:46:43.685 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T22:46:43.768 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T22:46:44.685 INFO:teuthology.orchestra.run.smithi043.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-24T22:46:44.685 INFO:teuthology.orchestra.run.smithi043.stdout:Sourcing file `/etc/default/grub' 2024-04-24T22:46:44.694 INFO:teuthology.orchestra.run.smithi043.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T22:46:44.714 INFO:teuthology.orchestra.run.smithi043.stdout:Generating grub configuration file ... 2024-04-24T22:46:44.894 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-04-24T22:46:44.914 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T22:46:44.964 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-04-24T22:46:45.074 INFO:teuthology.orchestra.run.smithi043.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T22:46:45.094 INFO:teuthology.orchestra.run.smithi043.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T22:46:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2024-04-24T22:46:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2024-04-24T22:46:45.299 INFO:teuthology.orchestra.run.smithi162.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-24T22:46:45.299 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T22:46:45.299 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T22:46:45.299 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T22:46:45.299 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T22:46:45.299 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T22:46:45.300 INFO:teuthology.orchestra.run.smithi162.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T22:46:45.300 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T22:46:45.339 INFO:teuthology.orchestra.run.smithi162.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T22:46:45.342 DEBUG:teuthology.orchestra.run.smithi162:> dpkg -s linux-image-generic 2024-04-24T22:46:45.394 INFO:teuthology.orchestra.run.smithi162.stdout:Package: linux-image-generic 2024-04-24T22:46:45.395 INFO:teuthology.orchestra.run.smithi162.stdout:Status: install ok installed 2024-04-24T22:46:45.395 INFO:teuthology.orchestra.run.smithi162.stdout:Priority: optional 2024-04-24T22:46:45.395 INFO:teuthology.orchestra.run.smithi162.stdout:Section: kernel 2024-04-24T22:46:45.395 INFO:teuthology.orchestra.run.smithi162.stdout:Installed-Size: 21 2024-04-24T22:46:45.395 INFO:teuthology.orchestra.run.smithi162.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T22:46:45.395 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: amd64 2024-04-24T22:46:45.395 INFO:teuthology.orchestra.run.smithi162.stdout:Source: linux-meta 2024-04-24T22:46:45.395 INFO:teuthology.orchestra.run.smithi162.stdout:Version: 5.15.0.105.102 2024-04-24T22:46:45.395 INFO:teuthology.orchestra.run.smithi162.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T22:46:45.395 INFO:teuthology.orchestra.run.smithi162.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T22:46:45.395 INFO:teuthology.orchestra.run.smithi162.stdout:Recommends: thermald 2024-04-24T22:46:45.395 INFO:teuthology.orchestra.run.smithi162.stdout:Description: Generic Linux kernel image 2024-04-24T22:46:45.396 INFO:teuthology.orchestra.run.smithi162.stdout: This package will always depend on the latest generic kernel image 2024-04-24T22:46:45.396 INFO:teuthology.orchestra.run.smithi162.stdout: available. 2024-04-24T22:46:45.396 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-04-24T22:46:45.439 INFO:teuthology.orchestra.run.smithi043.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T22:46:45.445 INFO:teuthology.orchestra.run.smithi043.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T22:46:45.448 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.rdtytYOcIA 2024-04-24T22:46:45.448 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub/grub.cfg /tmp/tmp.rdtytYOcIA 2024-04-24T22:46:45.503 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.rdtytYOcIA 2024-04-24T22:46:45.509 INFO:teuthology.orchestra.run.smithi043.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T22:46:45.515 INFO:teuthology.orchestra.run.smithi043.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T22:46:45.619 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.rdtytYOcIA is 10KB 2024-04-24T22:46:45.632 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.rdtytYOcIA 2024-04-24T22:46:45.638 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-24T22:46:45.670 INFO:teuthology.orchestra.run.smithi043.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T22:46:45.670 INFO:teuthology.orchestra.run.smithi043.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T22:46:45.670 INFO:teuthology.orchestra.run.smithi043.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T22:46:45.695 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:46:45.695 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-24T22:46:45.695 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-24T22:46:45.700 INFO:teuthology.orchestra.run.smithi043.stdout:done 2024-04-24T22:46:45.763 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-24T22:46:45.763 DEBUG:teuthology.orchestra.run.smithi162:> sudo update-grub 2024-04-24T22:46:46.215 DEBUG:teuthology.orchestra.run.smithi043:> dpkg -s linux-image-generic 2024-04-24T22:46:46.234 INFO:teuthology.orchestra.run.smithi043.stdout:Package: linux-image-generic 2024-04-24T22:46:46.235 INFO:teuthology.orchestra.run.smithi043.stdout:Status: install ok installed 2024-04-24T22:46:46.235 INFO:teuthology.orchestra.run.smithi043.stdout:Priority: optional 2024-04-24T22:46:46.235 INFO:teuthology.orchestra.run.smithi043.stdout:Section: kernel 2024-04-24T22:46:46.235 INFO:teuthology.orchestra.run.smithi043.stdout:Installed-Size: 21 2024-04-24T22:46:46.235 INFO:teuthology.orchestra.run.smithi043.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T22:46:46.235 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: amd64 2024-04-24T22:46:46.235 INFO:teuthology.orchestra.run.smithi043.stdout:Source: linux-meta 2024-04-24T22:46:46.235 INFO:teuthology.orchestra.run.smithi043.stdout:Version: 5.15.0.105.102 2024-04-24T22:46:46.235 INFO:teuthology.orchestra.run.smithi043.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T22:46:46.235 INFO:teuthology.orchestra.run.smithi043.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T22:46:46.235 INFO:teuthology.orchestra.run.smithi043.stdout:Recommends: thermald 2024-04-24T22:46:46.235 INFO:teuthology.orchestra.run.smithi043.stdout:Description: Generic Linux kernel image 2024-04-24T22:46:46.236 INFO:teuthology.orchestra.run.smithi043.stdout: This package will always depend on the latest generic kernel image 2024-04-24T22:46:46.236 INFO:teuthology.orchestra.run.smithi043.stdout: available. 2024-04-24T22:46:46.236 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-24T22:46:46.236 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-24T22:46:46.236 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-24T22:46:46.236 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-24T22:46:46.236 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi043.front.sepia.ceph.com, path=None, version=distro) 2024-04-24T22:46:46.236 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get clean 2024-04-24T22:46:46.430 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get update 2024-04-24T22:46:46.550 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T22:46:46.550 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T22:46:46.563 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T22:46:46.584 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T22:46:47.038 INFO:teuthology.orchestra.run.smithi162.stderr:Sourcing file `/etc/default/grub' 2024-04-24T22:46:47.039 INFO:teuthology.orchestra.run.smithi162.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T22:46:47.042 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2024-04-24T22:46:47.235 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T22:46:47.241 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T22:46:47.486 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T22:46:47.490 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T22:46:47.528 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T22:46:47.533 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T22:46:47.646 INFO:teuthology.orchestra.run.smithi162.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T22:46:47.646 INFO:teuthology.orchestra.run.smithi162.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T22:46:47.646 INFO:teuthology.orchestra.run.smithi162.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T22:46:47.657 INFO:teuthology.orchestra.run.smithi162.stderr:done 2024-04-24T22:46:47.662 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2024-04-24T22:46:47.896 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-04-24T22:46:47.914 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T22:46:47.966 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-04-24T22:46:48.148 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2024-04-24T22:46:48.148 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2024-04-24T22:46:48.316 INFO:teuthology.orchestra.run.smithi043.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-24T22:46:48.316 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T22:46:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T22:46:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T22:46:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T22:46:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T22:46:48.317 INFO:teuthology.orchestra.run.smithi043.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T22:46:48.317 INFO:teuthology.orchestra.run.smithi043.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T22:46:48.356 INFO:teuthology.orchestra.run.smithi043.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T22:46:48.358 DEBUG:teuthology.orchestra.run.smithi043:> dpkg -s linux-image-generic 2024-04-24T22:46:48.417 INFO:teuthology.orchestra.run.smithi043.stdout:Package: linux-image-generic 2024-04-24T22:46:48.417 INFO:teuthology.orchestra.run.smithi043.stdout:Status: install ok installed 2024-04-24T22:46:48.417 INFO:teuthology.orchestra.run.smithi043.stdout:Priority: optional 2024-04-24T22:46:48.417 INFO:teuthology.orchestra.run.smithi043.stdout:Section: kernel 2024-04-24T22:46:48.417 INFO:teuthology.orchestra.run.smithi043.stdout:Installed-Size: 21 2024-04-24T22:46:48.417 INFO:teuthology.orchestra.run.smithi043.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T22:46:48.417 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: amd64 2024-04-24T22:46:48.417 INFO:teuthology.orchestra.run.smithi043.stdout:Source: linux-meta 2024-04-24T22:46:48.417 INFO:teuthology.orchestra.run.smithi043.stdout:Version: 5.15.0.105.102 2024-04-24T22:46:48.417 INFO:teuthology.orchestra.run.smithi043.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T22:46:48.418 INFO:teuthology.orchestra.run.smithi043.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T22:46:48.418 INFO:teuthology.orchestra.run.smithi043.stdout:Recommends: thermald 2024-04-24T22:46:48.418 INFO:teuthology.orchestra.run.smithi043.stdout:Description: Generic Linux kernel image 2024-04-24T22:46:48.418 INFO:teuthology.orchestra.run.smithi043.stdout: This package will always depend on the latest generic kernel image 2024-04-24T22:46:48.418 INFO:teuthology.orchestra.run.smithi043.stdout: available. 2024-04-24T22:46:48.419 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-04-24T22:46:48.465 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.7uFnEAhIU9 2024-04-24T22:46:48.466 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /boot/grub/grub.cfg /tmp/tmp.7uFnEAhIU9 2024-04-24T22:46:48.533 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.7uFnEAhIU9 2024-04-24T22:46:48.659 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.7uFnEAhIU9 is 10KB 2024-04-24T22:46:48.672 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.7uFnEAhIU9 2024-04-24T22:46:48.677 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-24T22:46:48.737 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:46:48.737 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-24T22:46:48.737 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-24T22:46:48.810 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-24T22:46:48.810 DEBUG:teuthology.orchestra.run.smithi043:> sudo update-grub 2024-04-24T22:46:50.017 INFO:teuthology.orchestra.run.smithi043.stderr:Sourcing file `/etc/default/grub' 2024-04-24T22:46:50.017 INFO:teuthology.orchestra.run.smithi043.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T22:46:50.019 INFO:teuthology.orchestra.run.smithi043.stderr:Generating grub configuration file ... 2024-04-24T22:46:50.167 INFO:teuthology.orchestra.run.smithi043.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T22:46:50.173 INFO:teuthology.orchestra.run.smithi043.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T22:46:50.462 INFO:teuthology.orchestra.run.smithi043.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T22:46:50.467 INFO:teuthology.orchestra.run.smithi043.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T22:46:50.509 INFO:teuthology.orchestra.run.smithi043.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T22:46:50.514 INFO:teuthology.orchestra.run.smithi043.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T22:46:50.643 INFO:teuthology.orchestra.run.smithi043.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T22:46:50.644 INFO:teuthology.orchestra.run.smithi043.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T22:46:50.644 INFO:teuthology.orchestra.run.smithi043.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T22:46:50.667 INFO:teuthology.orchestra.run.smithi043.stderr:done 2024-04-24T22:46:50.675 DEBUG:teuthology.orchestra.run.smithi043:> sudo shutdown -r now 2024-04-24T22:47:17.690 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-24T22:47:17.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-24T22:47:17.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:47:20.679 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-24T22:47:20.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-24T22:47:20.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:47:36.223 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-04-24T22:47:39.038 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-04-24T22:47:45.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-24T22:47:45.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:47:48.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-24T22:47:48.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:47:48.286 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-04-24T22:48:00.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-24T22:48:00.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:48:48.091 DEBUG:teuthology.orchestra.remote:timed out 2024-04-24T22:49:00.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-24T22:49:00.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:49:00.301 DEBUG:teuthology.orchestra.remote:timed out 2024-04-24T22:49:00.308 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-04-24T22:49:01.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-24T22:49:01.042 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-24T22:49:01.043 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-04-24T22:49:01.088 INFO:teuthology.orchestra.run.smithi043.stdout:5.15.0-105-generic 2024-04-24T22:49:01.089 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-24T22:49:01.089 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-24T22:49:01.089 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-24T22:49:02.090 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-24T22:49:02.090 DEBUG:teuthology.orchestra.run.smithi043:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T22:49:02.167 INFO:teuthology.orchestra.run.smithi043.stdout:ttyS1 2024-04-24T22:49:02.198 DEBUG:teuthology.parallel:result is None 2024-04-24T22:49:15.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-24T22:49:15.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:49:15.604 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-04-24T22:49:16.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-24T22:49:16.185 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-24T22:49:16.185 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-04-24T22:49:16.233 INFO:teuthology.orchestra.run.smithi162.stdout:5.15.0-105-generic 2024-04-24T22:49:16.233 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-24T22:49:16.233 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-24T22:49:16.233 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-24T22:49:17.234 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-24T22:49:17.234 DEBUG:teuthology.orchestra.run.smithi162:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T22:49:17.574 INFO:teuthology.orchestra.run.smithi162.stdout:ttyS1 2024-04-24T22:49:17.591 DEBUG:teuthology.parallel:result is None 2024-04-24T22:49:17.591 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-24T22:49:17.599 INFO:teuthology.task.internal:Creating test directory... 2024-04-24T22:49:17.599 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T22:49:17.601 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T22:49:17.607 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-24T22:49:17.613 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-24T22:49:17.623 INFO:teuthology.task.internal:Creating archive directory... 2024-04-24T22:49:17.624 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T22:49:17.649 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T22:49:17.670 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-24T22:49:17.677 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-24T22:49:17.678 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T22:49:17.710 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T22:49:17.732 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T22:49:17.737 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T22:49:17.740 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T22:49:17.745 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T22:49:17.747 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-24T22:49:17.754 INFO:teuthology.task.internal:Configuring sudo... 2024-04-24T22:49:17.754 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T22:49:17.792 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T22:49:17.807 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-24T22:49:17.817 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-24T22:49:17.818 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T22:49:17.846 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T22:49:17.853 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T22:49:17.898 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T22:49:17.945 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:49:17.946 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T22:49:18.002 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T22:49:18.008 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T22:49:18.057 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:49:18.058 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T22:49:18.130 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2024-04-24T22:49:18.133 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-04-24T22:49:18.201 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-24T22:49:18.209 INFO:teuthology.task.internal:Starting timer... 2024-04-24T22:49:18.209 INFO:teuthology.run_tasks:Running task pcp... 2024-04-24T22:49:18.220 INFO:teuthology.run_tasks:Running task selinux... 2024-04-24T22:49:18.249 DEBUG:teuthology.task.selinux:Excluding smithi043: OS 'ubuntu' does not support SELinux 2024-04-24T22:49:18.249 DEBUG:teuthology.task.selinux:Excluding smithi162: OS 'ubuntu' does not support SELinux 2024-04-24T22:49:18.250 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-24T22:49:18.250 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-24T22:49:18.250 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-24T22:49:18.250 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-24T22:49:18.259 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-24T22:49:18.277 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-24T22:49:18.278 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi043.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-24T22:56:22.408 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-04-24T22:56:22.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-24T22:56:22.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:56:22.493 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-04-24T22:56:22.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-24T22:56:22.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-24T22:56:22.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T22:56:22.654 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-04-24T22:56:22.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-24T22:56:22.738 INFO:teuthology.run_tasks:Running task clock... 2024-04-24T22:56:22.749 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-24T22:56:22.749 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T22:56:22.750 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T22:56:22.752 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T22:56:22.753 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T22:56:22.778 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-24T22:56:22.778 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: Command line: ntpd -gq 2024-04-24T22:56:22.779 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: ---------------------------------------------------- 2024-04-24T22:56:22.779 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: ntp-4 is maintained by Network Time Foundation, 2024-04-24T22:56:22.779 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-24T22:56:22.779 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: corporation. Support and training for ntp-4 are 2024-04-24T22:56:22.779 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: available at https://www.nwtime.org/support 2024-04-24T22:56:22.780 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: ---------------------------------------------------- 2024-04-24T22:56:22.781 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: proto: precision = 0.120 usec (-23) 2024-04-24T22:56:22.781 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: basedate set to 2022-02-04 2024-04-24T22:56:22.781 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: gps base set to 2022-02-06 (week 2196) 2024-04-24T22:56:22.781 INFO:teuthology.orchestra.run.smithi043.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T22:56:22.782 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T22:56:22.782 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: restrict ::: KOD does nothing without LIMITED. 2024-04-24T22:56:22.782 INFO:teuthology.orchestra.run.smithi043.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-24T22:56:22.783 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: Listen and drop on 0 v6wildcard [::]:123 2024-04-24T22:56:22.783 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-24T22:56:22.783 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: Listen normally on 2 lo 127.0.0.1:123 2024-04-24T22:56:22.783 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: Listen normally on 3 ens1f0 172.21.15.43:123 2024-04-24T22:56:22.783 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: Listen normally on 4 lo [::1]:123 2024-04-24T22:56:22.783 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1358%4]:123 2024-04-24T22:56:22.784 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:22 ntpd[17130]: Listening on routing socket on fd #22 for interface updates 2024-04-24T22:56:22.806 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-24T22:56:22.806 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: Command line: ntpd -gq 2024-04-24T22:56:22.806 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: ---------------------------------------------------- 2024-04-24T22:56:22.806 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: ntp-4 is maintained by Network Time Foundation, 2024-04-24T22:56:22.806 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-24T22:56:22.806 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: corporation. Support and training for ntp-4 are 2024-04-24T22:56:22.806 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: available at https://www.nwtime.org/support 2024-04-24T22:56:22.807 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: ---------------------------------------------------- 2024-04-24T22:56:22.807 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: proto: precision = 0.060 usec (-24) 2024-04-24T22:56:22.807 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: basedate set to 2022-02-04 2024-04-24T22:56:22.807 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: gps base set to 2022-02-06 (week 2196) 2024-04-24T22:56:22.808 INFO:teuthology.orchestra.run.smithi162.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T22:56:22.808 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T22:56:22.808 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: restrict ::: KOD does nothing without LIMITED. 2024-04-24T22:56:22.808 INFO:teuthology.orchestra.run.smithi162.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-24T22:56:22.809 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: Listen and drop on 0 v6wildcard [::]:123 2024-04-24T22:56:22.809 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-24T22:56:22.809 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: Listen normally on 2 lo 127.0.0.1:123 2024-04-24T22:56:22.809 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: Listen normally on 3 enp3s0f1 172.21.15.162:123 2024-04-24T22:56:22.809 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: Listen normally on 4 lo [::1]:123 2024-04-24T22:56:22.809 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f41%5]:123 2024-04-24T22:56:22.810 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:22 ntpd[17207]: Listening on routing socket on fd #22 for interface updates 2024-04-24T22:56:23.780 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:23 ntpd[17130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:23.780 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:23 ntpd[17130]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:23.780 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:23 ntpd[17130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:23.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:23 ntpd[17130]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:23.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:23 ntpd[17130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:23.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:23 ntpd[17130]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:23.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:23 ntpd[17130]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T22:56:23.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:23 ntpd[17130]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T22:56:23.808 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:23 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:23.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:23 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:23.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:23 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:23.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:23 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:23.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:23 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:23.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:23 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:23.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:23 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:23.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:23 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:23.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:23 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T22:56:23.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:23 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T22:56:23.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:23 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:23.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:23 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:23.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:23 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T22:56:23.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:23 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T22:56:25.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:25 ntpd[17130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:25.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:25 ntpd[17130]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:25.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:25 ntpd[17130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:25.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:25 ntpd[17130]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:25.782 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:25 ntpd[17130]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T22:56:25.782 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:25 ntpd[17130]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T22:56:25.808 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:25.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:25.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:25.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:25.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:25.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:25.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:25.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:25.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T22:56:25.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T22:56:25.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:25.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:25.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T22:56:25.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T22:56:25.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:25.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:25.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T22:56:25.810 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:25 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T22:56:27.780 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:27.780 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:27.780 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:27.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:27.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:27.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:27.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:27.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:27.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T22:56:27.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T22:56:27.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:27.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:27.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T22:56:27.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T22:56:27.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:27.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:27.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T22:56:27.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:27 ntpd[17130]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T22:56:27.808 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:27.808 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:27.808 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:27.808 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:27.808 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:27.808 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:27.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:27.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:27.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T22:56:27.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T22:56:27.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:27.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:27.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T22:56:27.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T22:56:27.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:27.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:27.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T22:56:27.809 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:27 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T22:56:29.780 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:29 ntpd[17130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:29.780 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:29 ntpd[17130]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:29.780 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:29 ntpd[17130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:29.780 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:29 ntpd[17130]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:29.780 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:29 ntpd[17130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:29.780 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:29 ntpd[17130]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:29.780 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:29 ntpd[17130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:29.780 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:29 ntpd[17130]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:29.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:29 ntpd[17130]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T22:56:29.781 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:29 ntpd[17130]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T22:56:29.781 INFO:teuthology.orchestra.run.smithi043.stdout:24 Apr 22:56:29 ntpd[17130]: ntpd: time slew -0.000513 s 2024-04-24T22:56:29.781 INFO:teuthology.orchestra.run.smithi043.stdout:ntpd: time slew -0.000513s 2024-04-24T22:56:29.782 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:29 ntpd[17130]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-24T22:56:29.782 INFO:teuthology.orchestra.run.smithi043.stderr:24 Apr 22:56:29 ntpd[17130]: can't open /var/log/ntpstats/loopstats.20240424: Permission denied 2024-04-24T22:56:29.807 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:29 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:29.807 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:29 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:29.807 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:29 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:29.807 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:29 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:29.807 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:29 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:29.807 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:29 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:29.807 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:29 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T22:56:29.808 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:29 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T22:56:29.808 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:29 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T22:56:29.808 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:29 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T22:56:29.808 INFO:teuthology.orchestra.run.smithi162.stdout:24 Apr 22:56:29 ntpd[17207]: ntpd: time slew -0.000940 s 2024-04-24T22:56:29.808 INFO:teuthology.orchestra.run.smithi162.stdout:ntpd: time slew -0.000940s 2024-04-24T22:56:29.808 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:29 ntpd[17207]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-24T22:56:29.808 INFO:teuthology.orchestra.run.smithi162.stderr:24 Apr 22:56:29 ntpd[17207]: can't open /var/log/ntpstats/loopstats.20240424: Permission denied 2024-04-24T22:56:29.835 INFO:teuthology.orchestra.run.smithi043.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T22:56:29.835 INFO:teuthology.orchestra.run.smithi043.stdout:============================================================================== 2024-04-24T22:56:29.835 INFO:teuthology.orchestra.run.smithi043.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T22:56:29.835 INFO:teuthology.orchestra.run.smithi043.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T22:56:29.835 INFO:teuthology.orchestra.run.smithi043.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T22:56:29.835 INFO:teuthology.orchestra.run.smithi043.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T22:56:29.857 INFO:teuthology.orchestra.run.smithi162.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T22:56:29.857 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================== 2024-04-24T22:56:29.857 INFO:teuthology.orchestra.run.smithi162.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T22:56:29.857 INFO:teuthology.orchestra.run.smithi162.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T22:56:29.857 INFO:teuthology.orchestra.run.smithi162.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T22:56:29.858 INFO:teuthology.orchestra.run.smithi162.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T22:56:29.858 INFO:teuthology.run_tasks:Running task install... 2024-04-24T22:56:29.867 DEBUG:teuthology.task.install:project ceph 2024-04-24T22:56:29.868 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-24T22:56:29.868 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-24T22:56:29.868 INFO:teuthology.task.install:Using flavor: default 2024-04-24T22:56:29.873 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-24T22:56:29.873 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-24T22:56:29.874 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-key list | grep Ceph 2024-04-24T22:56:29.874 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-key list | grep Ceph 2024-04-24T22:56:29.936 INFO:teuthology.orchestra.run.smithi043.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-24T22:56:29.964 INFO:teuthology.orchestra.run.smithi162.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-24T22:56:29.967 INFO:teuthology.orchestra.run.smithi043.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-24T22:56:29.967 INFO:teuthology.orchestra.run.smithi043.stdout:uid [ unknown] Ceph.com (release key) 2024-04-24T22:56:29.967 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-24T22:56:29.968 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-24T22:56:29.968 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T22:56:30.003 INFO:teuthology.orchestra.run.smithi162.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-24T22:56:30.003 INFO:teuthology.orchestra.run.smithi162.stdout:uid [ unknown] Ceph.com (release key) 2024-04-24T22:56:30.003 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-24T22:56:30.003 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-24T22:56:30.003 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T22:56:30.118 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-24T22:56:30.118 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-24T22:56:30.215 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-24T22:56:30.215 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-24T22:56:30.286 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:56:30.286 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-24T22:56:30.301 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get update 2024-04-24T22:56:30.329 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:56:30.329 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-24T22:56:30.343 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2024-04-24T22:56:30.473 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T22:56:30.474 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T22:56:30.487 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T22:56:30.508 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T22:56:30.520 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T22:56:30.524 INFO:teuthology.orchestra.run.smithi043.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-24T22:56:30.545 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-24T22:56:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-24T22:56:30.588 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-04-24T22:56:30.615 INFO:teuthology.orchestra.run.smithi043.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-24T22:56:30.626 INFO:teuthology.orchestra.run.smithi162.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-24T22:56:30.633 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T22:56:30.662 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-24T22:56:30.699 INFO:teuthology.orchestra.run.smithi162.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-24T22:56:30.715 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T22:56:30.738 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-04-24T22:56:30.779 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-24T22:56:30.796 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T22:56:30.840 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 28.9 kB in 0s (81.1 kB/s) 2024-04-24T22:56:30.938 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 28.9 kB in 0s (70.2 kB/s) 2024-04-24T22:56:31.826 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-04-24T22:56:31.842 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy cephfs-shell=19.0.0-2445-gd2c45d97-1jammy cephfs-top=19.0.0-2445-gd2c45d97-1jammy cephfs-mirror=19.0.0-2445-gd2c45d97-1jammy 2024-04-24T22:56:31.904 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-04-24T22:56:31.936 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-04-24T22:56:31.951 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy cephfs-shell=19.0.0-2445-gd2c45d97-1jammy cephfs-top=19.0.0-2445-gd2c45d97-1jammy cephfs-mirror=19.0.0-2445-gd2c45d97-1jammy 2024-04-24T22:56:32.013 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-04-24T22:56:32.116 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2024-04-24T22:56:32.116 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2024-04-24T22:56:32.213 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2024-04-24T22:56:32.214 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2024-04-24T22:56:32.327 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T22:56:32.327 INFO:teuthology.orchestra.run.smithi043.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T22:56:32.328 INFO:teuthology.orchestra.run.smithi043.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T22:56:32.328 INFO:teuthology.orchestra.run.smithi043.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T22:56:32.328 INFO:teuthology.orchestra.run.smithi043.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T22:56:32.328 INFO:teuthology.orchestra.run.smithi043.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T22:56:32.329 INFO:teuthology.orchestra.run.smithi043.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T22:56:32.329 INFO:teuthology.orchestra.run.smithi043.stdout:The following additional packages will be installed: 2024-04-24T22:56:32.329 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-24T22:56:32.329 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-24T22:56:32.329 INFO:teuthology.orchestra.run.smithi043.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T22:56:32.330 INFO:teuthology.orchestra.run.smithi043.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-24T22:56:32.331 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-24T22:56:32.331 INFO:teuthology.orchestra.run.smithi043.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-24T22:56:32.331 INFO:teuthology.orchestra.run.smithi043.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-24T22:56:32.331 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-24T22:56:32.331 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-24T22:56:32.331 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-24T22:56:32.331 INFO:teuthology.orchestra.run.smithi043.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-24T22:56:32.331 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-24T22:56:32.331 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-24T22:56:32.331 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-24T22:56:32.331 INFO:teuthology.orchestra.run.smithi043.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-24T22:56:32.331 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-24T22:56:32.332 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-24T22:56:32.332 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-24T22:56:32.332 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-24T22:56:32.332 INFO:teuthology.orchestra.run.smithi043.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-24T22:56:32.332 INFO:teuthology.orchestra.run.smithi043.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-24T22:56:32.332 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-24T22:56:32.332 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-24T22:56:32.332 INFO:teuthology.orchestra.run.smithi043.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-24T22:56:32.332 INFO:teuthology.orchestra.run.smithi043.stdout:Suggested packages: 2024-04-24T22:56:32.332 INFO:teuthology.orchestra.run.smithi043.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-24T22:56:32.332 INFO:teuthology.orchestra.run.smithi043.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-24T22:56:32.333 INFO:teuthology.orchestra.run.smithi043.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-24T22:56:32.333 INFO:teuthology.orchestra.run.smithi043.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-24T22:56:32.333 INFO:teuthology.orchestra.run.smithi043.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-24T22:56:32.333 INFO:teuthology.orchestra.run.smithi043.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-24T22:56:32.333 INFO:teuthology.orchestra.run.smithi043.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-24T22:56:32.333 INFO:teuthology.orchestra.run.smithi043.stdout:Recommended packages: 2024-04-24T22:56:32.333 INFO:teuthology.orchestra.run.smithi043.stdout: btrfs-tools 2024-04-24T22:56:32.398 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T22:56:32.398 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T22:56:32.398 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T22:56:32.398 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T22:56:32.399 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T22:56:32.399 INFO:teuthology.orchestra.run.smithi162.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T22:56:32.399 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T22:56:32.400 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2024-04-24T22:56:32.400 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-24T22:56:32.400 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-24T22:56:32.400 INFO:teuthology.orchestra.run.smithi162.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T22:56:32.400 INFO:teuthology.orchestra.run.smithi162.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-24T22:56:32.401 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-24T22:56:32.401 INFO:teuthology.orchestra.run.smithi162.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-24T22:56:32.401 INFO:teuthology.orchestra.run.smithi162.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-24T22:56:32.401 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-24T22:56:32.401 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-24T22:56:32.401 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-24T22:56:32.401 INFO:teuthology.orchestra.run.smithi162.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-24T22:56:32.402 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-24T22:56:32.402 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-24T22:56:32.402 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-24T22:56:32.402 INFO:teuthology.orchestra.run.smithi162.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-24T22:56:32.402 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-24T22:56:32.402 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-24T22:56:32.402 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-24T22:56:32.402 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-24T22:56:32.402 INFO:teuthology.orchestra.run.smithi162.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-24T22:56:32.402 INFO:teuthology.orchestra.run.smithi162.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-24T22:56:32.402 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-24T22:56:32.402 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-24T22:56:32.402 INFO:teuthology.orchestra.run.smithi162.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-24T22:56:32.403 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2024-04-24T22:56:32.403 INFO:teuthology.orchestra.run.smithi162.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-24T22:56:32.403 INFO:teuthology.orchestra.run.smithi162.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-24T22:56:32.403 INFO:teuthology.orchestra.run.smithi162.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-24T22:56:32.403 INFO:teuthology.orchestra.run.smithi162.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-24T22:56:32.403 INFO:teuthology.orchestra.run.smithi162.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-24T22:56:32.403 INFO:teuthology.orchestra.run.smithi162.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-24T22:56:32.403 INFO:teuthology.orchestra.run.smithi162.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-24T22:56:32.403 INFO:teuthology.orchestra.run.smithi162.stdout:Recommended packages: 2024-04-24T22:56:32.403 INFO:teuthology.orchestra.run.smithi162.stdout: btrfs-tools 2024-04-24T22:56:32.447 INFO:teuthology.orchestra.run.smithi043.stdout:The following NEW packages will be installed: 2024-04-24T22:56:32.447 INFO:teuthology.orchestra.run.smithi043.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-24T22:56:32.447 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-24T22:56:32.447 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-24T22:56:32.447 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-24T22:56:32.448 INFO:teuthology.orchestra.run.smithi043.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T22:56:32.448 INFO:teuthology.orchestra.run.smithi043.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-24T22:56:32.448 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-24T22:56:32.448 INFO:teuthology.orchestra.run.smithi043.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-24T22:56:32.448 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-24T22:56:32.448 INFO:teuthology.orchestra.run.smithi043.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-24T22:56:32.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-24T22:56:32.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-24T22:56:32.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-24T22:56:32.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-24T22:56:32.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-24T22:56:32.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-24T22:56:32.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-24T22:56:32.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-24T22:56:32.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-24T22:56:32.450 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-24T22:56:32.450 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-24T22:56:32.450 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-24T22:56:32.450 INFO:teuthology.orchestra.run.smithi043.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-24T22:56:32.450 INFO:teuthology.orchestra.run.smithi043.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-24T22:56:32.450 INFO:teuthology.orchestra.run.smithi043.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-24T22:56:32.451 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-24T22:56:32.451 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-24T22:56:32.451 INFO:teuthology.orchestra.run.smithi043.stdout: socat unzip xmlstarlet zip 2024-04-24T22:56:32.511 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2024-04-24T22:56:32.511 INFO:teuthology.orchestra.run.smithi162.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-24T22:56:32.511 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-24T22:56:32.511 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-24T22:56:32.511 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-24T22:56:32.511 INFO:teuthology.orchestra.run.smithi162.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T22:56:32.511 INFO:teuthology.orchestra.run.smithi162.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-24T22:56:32.511 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-24T22:56:32.511 INFO:teuthology.orchestra.run.smithi162.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-24T22:56:32.511 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-24T22:56:32.511 INFO:teuthology.orchestra.run.smithi162.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-24T22:56:32.511 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-24T22:56:32.512 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-24T22:56:32.512 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-24T22:56:32.512 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-24T22:56:32.512 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-24T22:56:32.512 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-24T22:56:32.512 INFO:teuthology.orchestra.run.smithi162.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-24T22:56:32.512 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-24T22:56:32.512 INFO:teuthology.orchestra.run.smithi162.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-24T22:56:32.512 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-24T22:56:32.512 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-24T22:56:32.512 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-24T22:56:32.513 INFO:teuthology.orchestra.run.smithi162.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-24T22:56:32.513 INFO:teuthology.orchestra.run.smithi162.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-24T22:56:32.513 INFO:teuthology.orchestra.run.smithi162.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-24T22:56:32.513 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-24T22:56:32.513 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-24T22:56:32.513 INFO:teuthology.orchestra.run.smithi162.stdout: socat unzip xmlstarlet zip 2024-04-24T22:56:32.634 INFO:teuthology.orchestra.run.smithi043.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-24T22:56:32.635 INFO:teuthology.orchestra.run.smithi043.stdout:Need to get 180 MB of archives. 2024-04-24T22:56:32.635 INFO:teuthology.orchestra.run.smithi043.stdout:After this operation, 823 MB of additional disk space will be used. 2024-04-24T22:56:32.635 INFO:teuthology.orchestra.run.smithi043.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-24T22:56:32.652 INFO:teuthology.orchestra.run.smithi162.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-24T22:56:32.653 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 180 MB of archives. 2024-04-24T22:56:32.653 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 823 MB of additional disk space will be used. 2024-04-24T22:56:32.653 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,540 kB] 2024-04-24T22:56:32.665 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,540 kB] 2024-04-24T22:56:32.700 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-24T22:56:32.717 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-24T22:56:32.763 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-24T22:56:32.786 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-24T22:56:32.828 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-24T22:56:32.965 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-24T22:56:33.033 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-24T22:56:33.060 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-24T22:56:33.071 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-24T22:56:33.074 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-24T22:56:33.126 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-24T22:56:33.126 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-24T22:56:33.140 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-24T22:56:33.192 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-24T22:56:33.243 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-24T22:56:33.279 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-24T22:56:33.287 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-24T22:56:33.296 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-24T22:56:33.300 INFO:teuthology.orchestra.run.smithi043.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-24T22:56:33.301 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.7 kB] 2024-04-24T22:56:33.303 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-24T22:56:33.308 INFO:teuthology.orchestra.run.smithi043.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-24T22:56:33.320 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-24T22:56:33.337 INFO:teuthology.orchestra.run.smithi043.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-24T22:56:33.344 INFO:teuthology.orchestra.run.smithi043.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-24T22:56:33.366 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-24T22:56:33.374 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-24T22:56:33.402 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-24T22:56:33.410 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-24T22:56:33.426 INFO:teuthology.orchestra.run.smithi043.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-24T22:56:33.509 INFO:teuthology.orchestra.run.smithi043.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-24T22:56:33.575 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-24T22:56:33.594 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-24T22:56:33.598 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [466 kB] 2024-04-24T22:56:33.618 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-24T22:56:33.871 INFO:teuthology.orchestra.run.smithi043.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-24T22:56:33.966 INFO:teuthology.orchestra.run.smithi043.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-24T22:56:34.020 INFO:teuthology.orchestra.run.smithi043.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-24T22:56:34.023 INFO:teuthology.orchestra.run.smithi043.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-24T22:56:34.051 INFO:teuthology.orchestra.run.smithi043.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.7 kB] 2024-04-24T22:56:34.058 INFO:teuthology.orchestra.run.smithi043.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-24T22:56:34.080 INFO:teuthology.orchestra.run.smithi043.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-24T22:56:34.095 INFO:teuthology.orchestra.run.smithi043.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-24T22:56:34.110 INFO:teuthology.orchestra.run.smithi043.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-24T22:56:34.114 INFO:teuthology.orchestra.run.smithi043.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-24T22:56:34.119 INFO:teuthology.orchestra.run.smithi043.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-24T22:56:34.119 INFO:teuthology.orchestra.run.smithi043.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-24T22:56:34.135 INFO:teuthology.orchestra.run.smithi043.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-24T22:56:34.149 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-24T22:56:34.164 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-24T22:56:34.173 INFO:teuthology.orchestra.run.smithi043.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-24T22:56:34.179 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-24T22:56:34.186 INFO:teuthology.orchestra.run.smithi043.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-24T22:56:34.188 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-24T22:56:34.189 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-24T22:56:34.190 INFO:teuthology.orchestra.run.smithi043.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-24T22:56:34.190 INFO:teuthology.orchestra.run.smithi043.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-24T22:56:34.205 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-24T22:56:34.243 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-24T22:56:34.256 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-24T22:56:34.260 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-24T22:56:34.261 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-24T22:56:34.361 INFO:teuthology.orchestra.run.smithi043.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-24T22:56:34.431 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-24T22:56:34.444 INFO:teuthology.orchestra.run.smithi043.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-24T22:56:34.451 INFO:teuthology.orchestra.run.smithi043.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-24T22:56:34.514 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-24T22:56:34.521 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-24T22:56:34.526 INFO:teuthology.orchestra.run.smithi043.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-24T22:56:34.551 INFO:teuthology.orchestra.run.smithi043.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-24T22:56:34.568 INFO:teuthology.orchestra.run.smithi043.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-24T22:56:34.585 INFO:teuthology.orchestra.run.smithi043.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-24T22:56:34.595 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-24T22:56:34.621 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-24T22:56:34.637 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-24T22:56:34.654 INFO:teuthology.orchestra.run.smithi162.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-24T22:56:34.777 INFO:teuthology.orchestra.run.smithi043.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-24T22:56:34.779 INFO:teuthology.orchestra.run.smithi162.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-24T22:56:34.792 INFO:teuthology.orchestra.run.smithi043.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-24T22:56:34.800 INFO:teuthology.orchestra.run.smithi043.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-24T22:56:34.804 INFO:teuthology.orchestra.run.smithi043.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-24T22:56:34.846 INFO:teuthology.orchestra.run.smithi162.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-24T22:56:34.862 INFO:teuthology.orchestra.run.smithi162.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-24T22:56:34.869 INFO:teuthology.orchestra.run.smithi162.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-24T22:56:34.874 INFO:teuthology.orchestra.run.smithi162.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-24T22:56:34.936 INFO:teuthology.orchestra.run.smithi162.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-24T22:56:34.947 INFO:teuthology.orchestra.run.smithi162.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-24T22:56:34.954 INFO:teuthology.orchestra.run.smithi162.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,525 kB] 2024-04-24T22:56:34.988 INFO:teuthology.orchestra.run.smithi043.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-24T22:56:35.020 INFO:teuthology.orchestra.run.smithi162.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-24T22:56:35.022 INFO:teuthology.orchestra.run.smithi043.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-24T22:56:35.034 INFO:teuthology.orchestra.run.smithi043.stdout:Get:45 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [466 kB] 2024-04-24T22:56:35.058 INFO:teuthology.orchestra.run.smithi162.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-24T22:56:35.071 INFO:teuthology.orchestra.run.smithi043.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-24T22:56:35.086 INFO:teuthology.orchestra.run.smithi043.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-24T22:56:35.095 INFO:teuthology.orchestra.run.smithi043.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-24T22:56:35.140 INFO:teuthology.orchestra.run.smithi162.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-24T22:56:35.155 INFO:teuthology.orchestra.run.smithi162.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-24T22:56:35.260 INFO:teuthology.orchestra.run.smithi043.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-24T22:56:35.296 INFO:teuthology.orchestra.run.smithi162.stdout:Get:54 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-24T22:56:35.305 INFO:teuthology.orchestra.run.smithi043.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-24T22:56:35.318 INFO:teuthology.orchestra.run.smithi043.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-24T22:56:35.333 INFO:teuthology.orchestra.run.smithi162.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-24T22:56:35.379 INFO:teuthology.orchestra.run.smithi162.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-24T22:56:35.391 INFO:teuthology.orchestra.run.smithi162.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-24T22:56:35.476 INFO:teuthology.orchestra.run.smithi043.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-24T22:56:35.477 INFO:teuthology.orchestra.run.smithi043.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-24T22:56:35.481 INFO:teuthology.orchestra.run.smithi043.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-24T22:56:35.486 INFO:teuthology.orchestra.run.smithi043.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-24T22:56:35.500 INFO:teuthology.orchestra.run.smithi043.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-24T22:56:35.553 INFO:teuthology.orchestra.run.smithi162.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-24T22:56:35.554 INFO:teuthology.orchestra.run.smithi162.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-24T22:56:35.559 INFO:teuthology.orchestra.run.smithi162.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-24T22:56:35.564 INFO:teuthology.orchestra.run.smithi162.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-24T22:56:35.578 INFO:teuthology.orchestra.run.smithi162.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-24T22:56:35.685 INFO:teuthology.orchestra.run.smithi043.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-24T22:56:35.763 INFO:teuthology.orchestra.run.smithi162.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-24T22:56:35.940 INFO:teuthology.orchestra.run.smithi043.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-24T22:56:36.029 INFO:teuthology.orchestra.run.smithi162.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-24T22:56:36.054 INFO:teuthology.orchestra.run.smithi043.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-24T22:56:36.099 INFO:teuthology.orchestra.run.smithi043.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-24T22:56:36.139 INFO:teuthology.orchestra.run.smithi162.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-24T22:56:36.180 INFO:teuthology.orchestra.run.smithi043.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-24T22:56:36.183 INFO:teuthology.orchestra.run.smithi162.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-24T22:56:36.192 INFO:teuthology.orchestra.run.smithi043.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-24T22:56:36.206 INFO:teuthology.orchestra.run.smithi043.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-24T22:56:36.246 INFO:teuthology.orchestra.run.smithi043.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-24T22:56:36.265 INFO:teuthology.orchestra.run.smithi162.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-24T22:56:36.278 INFO:teuthology.orchestra.run.smithi162.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-24T22:56:36.291 INFO:teuthology.orchestra.run.smithi162.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-24T22:56:36.369 INFO:teuthology.orchestra.run.smithi162.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-24T22:56:36.371 INFO:teuthology.orchestra.run.smithi162.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-24T22:56:36.371 INFO:teuthology.orchestra.run.smithi162.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-24T22:56:36.390 INFO:teuthology.orchestra.run.smithi162.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-24T22:56:36.451 INFO:teuthology.orchestra.run.smithi162.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [790 kB] 2024-04-24T22:56:36.481 INFO:teuthology.orchestra.run.smithi162.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-24T22:56:36.489 INFO:teuthology.orchestra.run.smithi162.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-24T22:56:36.506 INFO:teuthology.orchestra.run.smithi043.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-24T22:56:36.508 INFO:teuthology.orchestra.run.smithi043.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-24T22:56:36.511 INFO:teuthology.orchestra.run.smithi043.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-24T22:56:36.585 INFO:teuthology.orchestra.run.smithi162.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-24T22:56:36.620 INFO:teuthology.orchestra.run.smithi162.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-24T22:56:36.622 INFO:teuthology.orchestra.run.smithi162.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-24T22:56:36.624 INFO:teuthology.orchestra.run.smithi162.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-24T22:56:36.678 INFO:teuthology.orchestra.run.smithi043.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-24T22:56:36.789 INFO:teuthology.orchestra.run.smithi162.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-24T22:56:36.965 INFO:teuthology.orchestra.run.smithi162.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-24T22:56:36.965 INFO:teuthology.orchestra.run.smithi162.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-24T22:56:37.014 INFO:teuthology.orchestra.run.smithi043.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-24T22:56:37.114 INFO:teuthology.orchestra.run.smithi162.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-24T22:56:37.410 INFO:teuthology.orchestra.run.smithi043.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-24T22:56:37.420 INFO:teuthology.orchestra.run.smithi043.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-24T22:56:37.421 INFO:teuthology.orchestra.run.smithi043.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-24T22:56:37.489 INFO:teuthology.orchestra.run.smithi043.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-24T22:56:37.490 INFO:teuthology.orchestra.run.smithi043.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-24T22:56:37.492 INFO:teuthology.orchestra.run.smithi043.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-24T22:56:37.493 INFO:teuthology.orchestra.run.smithi043.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-24T22:56:37.494 INFO:teuthology.orchestra.run.smithi043.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-24T22:56:37.521 INFO:teuthology.orchestra.run.smithi162.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-24T22:56:37.530 INFO:teuthology.orchestra.run.smithi162.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-24T22:56:37.531 INFO:teuthology.orchestra.run.smithi162.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-24T22:56:37.600 INFO:teuthology.orchestra.run.smithi162.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-24T22:56:37.601 INFO:teuthology.orchestra.run.smithi162.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-24T22:56:37.603 INFO:teuthology.orchestra.run.smithi162.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-24T22:56:37.604 INFO:teuthology.orchestra.run.smithi162.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-24T22:56:37.605 INFO:teuthology.orchestra.run.smithi162.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-24T22:56:37.660 INFO:teuthology.orchestra.run.smithi043.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-24T22:56:37.755 INFO:teuthology.orchestra.run.smithi043.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-24T22:56:37.771 INFO:teuthology.orchestra.run.smithi162.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-24T22:56:37.852 INFO:teuthology.orchestra.run.smithi043.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-24T22:56:37.858 INFO:teuthology.orchestra.run.smithi162.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-24T22:56:37.955 INFO:teuthology.orchestra.run.smithi162.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-24T22:56:38.098 INFO:teuthology.orchestra.run.smithi043.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-24T22:56:38.141 INFO:teuthology.orchestra.run.smithi043.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-24T22:56:38.165 INFO:teuthology.orchestra.run.smithi043.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-24T22:56:38.174 INFO:teuthology.orchestra.run.smithi043.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-24T22:56:38.200 INFO:teuthology.orchestra.run.smithi162.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-24T22:56:38.217 INFO:teuthology.orchestra.run.smithi043.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-24T22:56:38.243 INFO:teuthology.orchestra.run.smithi043.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-24T22:56:38.243 INFO:teuthology.orchestra.run.smithi162.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-24T22:56:38.244 INFO:teuthology.orchestra.run.smithi043.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-24T22:56:38.251 INFO:teuthology.orchestra.run.smithi043.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-24T22:56:38.268 INFO:teuthology.orchestra.run.smithi162.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-24T22:56:38.276 INFO:teuthology.orchestra.run.smithi162.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-24T22:56:38.321 INFO:teuthology.orchestra.run.smithi162.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-24T22:56:38.346 INFO:teuthology.orchestra.run.smithi162.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-24T22:56:38.347 INFO:teuthology.orchestra.run.smithi162.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-24T22:56:38.354 INFO:teuthology.orchestra.run.smithi162.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-24T22:56:38.418 INFO:teuthology.orchestra.run.smithi043.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-24T22:56:38.521 INFO:teuthology.orchestra.run.smithi162.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-24T22:56:38.567 INFO:teuthology.orchestra.run.smithi043.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-24T22:56:38.960 INFO:teuthology.orchestra.run.smithi043.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-24T22:56:38.965 INFO:teuthology.orchestra.run.smithi043.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-24T22:56:39.004 INFO:teuthology.orchestra.run.smithi043.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-24T22:56:39.005 INFO:teuthology.orchestra.run.smithi043.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-24T22:56:39.011 INFO:teuthology.orchestra.run.smithi043.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-24T22:56:39.014 INFO:teuthology.orchestra.run.smithi043.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-24T22:56:39.055 INFO:teuthology.orchestra.run.smithi043.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-24T22:56:39.058 INFO:teuthology.orchestra.run.smithi162.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-24T22:56:39.064 INFO:teuthology.orchestra.run.smithi043.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-24T22:56:39.064 INFO:teuthology.orchestra.run.smithi162.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-24T22:56:39.103 INFO:teuthology.orchestra.run.smithi162.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-24T22:56:39.104 INFO:teuthology.orchestra.run.smithi162.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-24T22:56:39.110 INFO:teuthology.orchestra.run.smithi162.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-24T22:56:39.112 INFO:teuthology.orchestra.run.smithi162.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-24T22:56:39.118 INFO:teuthology.orchestra.run.smithi043.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-24T22:56:39.137 INFO:teuthology.orchestra.run.smithi043.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-24T22:56:39.138 INFO:teuthology.orchestra.run.smithi043.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-24T22:56:39.153 INFO:teuthology.orchestra.run.smithi162.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-24T22:56:39.158 INFO:teuthology.orchestra.run.smithi043.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-24T22:56:39.161 INFO:teuthology.orchestra.run.smithi162.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-24T22:56:39.174 INFO:teuthology.orchestra.run.smithi043.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,525 kB] 2024-04-24T22:56:39.265 INFO:teuthology.orchestra.run.smithi162.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-24T22:56:39.265 INFO:teuthology.orchestra.run.smithi162.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-24T22:56:39.303 INFO:teuthology.orchestra.run.smithi043.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-24T22:56:39.361 INFO:teuthology.orchestra.run.smithi043.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-24T22:56:39.406 INFO:teuthology.orchestra.run.smithi162.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-24T22:56:39.408 INFO:teuthology.orchestra.run.smithi162.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2445-gd2c45d97-1jammy [229 kB] 2024-04-24T22:56:39.413 INFO:teuthology.orchestra.run.smithi162.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2445-gd2c45d97-1jammy [34.0 kB] 2024-04-24T22:56:39.415 INFO:teuthology.orchestra.run.smithi162.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2445-gd2c45d97-1jammy [23.4 kB] 2024-04-24T22:56:39.415 INFO:teuthology.orchestra.run.smithi162.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-24T22:56:39.416 INFO:teuthology.orchestra.run.smithi162.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-24T22:56:39.430 INFO:teuthology.orchestra.run.smithi162.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-24T22:56:39.745 INFO:teuthology.orchestra.run.smithi043.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-24T22:56:39.760 INFO:teuthology.orchestra.run.smithi043.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-24T22:56:39.871 INFO:teuthology.orchestra.run.smithi162.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.2 kB] 2024-04-24T22:56:39.873 INFO:teuthology.orchestra.run.smithi162.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-24T22:56:39.888 INFO:teuthology.orchestra.run.smithi162.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-24T22:56:39.925 INFO:teuthology.orchestra.run.smithi043.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-24T22:56:40.779 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 180 MB in 8s (23.5 MB/s) 2024-04-24T22:56:40.914 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-24T22:56:41.003 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-24T22:56:41.009 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-24T22:56:41.046 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-24T22:56:41.202 INFO:teuthology.orchestra.run.smithi043.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-24T22:56:41.203 INFO:teuthology.orchestra.run.smithi043.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-24T22:56:41.220 INFO:teuthology.orchestra.run.smithi043.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-24T22:56:41.321 INFO:teuthology.orchestra.run.smithi043.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [790 kB] 2024-04-24T22:56:41.369 INFO:teuthology.orchestra.run.smithi043.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-24T22:56:41.374 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-24T22:56:41.383 INFO:teuthology.orchestra.run.smithi043.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-24T22:56:41.389 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-24T22:56:41.424 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T22:56:41.496 INFO:teuthology.orchestra.run.smithi043.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-24T22:56:41.727 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cmd2. 2024-04-24T22:56:41.753 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-24T22:56:41.794 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-24T22:56:41.957 INFO:teuthology.orchestra.run.smithi043.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-24T22:56:41.957 INFO:teuthology.orchestra.run.smithi043.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-24T22:56:42.147 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-24T22:56:42.173 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-24T22:56:42.256 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T22:56:42.584 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-24T22:56:42.599 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-24T22:56:42.634 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T22:56:42.946 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-24T22:56:42.972 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-24T22:56:43.012 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T22:56:43.466 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-24T22:56:43.492 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T22:56:43.541 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T22:56:43.903 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-24T22:56:43.918 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T22:56:43.952 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T22:56:44.322 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-24T22:56:44.349 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T22:56:44.389 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T22:56:44.759 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-24T22:56:44.785 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-24T22:56:44.826 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T22:56:44.836 INFO:teuthology.orchestra.run.smithi043.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-24T22:56:44.838 INFO:teuthology.orchestra.run.smithi043.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2445-gd2c45d97-1jammy [229 kB] 2024-04-24T22:56:44.843 INFO:teuthology.orchestra.run.smithi043.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2445-gd2c45d97-1jammy [34.0 kB] 2024-04-24T22:56:44.844 INFO:teuthology.orchestra.run.smithi043.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2445-gd2c45d97-1jammy [23.4 kB] 2024-04-24T22:56:44.844 INFO:teuthology.orchestra.run.smithi043.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-24T22:56:44.846 INFO:teuthology.orchestra.run.smithi043.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-24T22:56:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librados2. 2024-04-24T22:56:45.127 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../010-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:45.162 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:45.422 INFO:teuthology.orchestra.run.smithi043.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.2 kB] 2024-04-24T22:56:45.598 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librbd1. 2024-04-24T22:56:45.624 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../011-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:45.673 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:46.082 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 180 MB in 13s (13.9 MB/s) 2024-04-24T22:56:46.221 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-24T22:56:46.235 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libcephfs2. 2024-04-24T22:56:46.261 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:46.293 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:46.320 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-24T22:56:46.326 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-24T22:56:46.370 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-24T22:56:46.579 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rados. 2024-04-24T22:56:46.594 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:46.637 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:46.664 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-24T22:56:46.691 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-24T22:56:46.731 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T22:56:46.948 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-24T22:56:46.975 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:56:46.992 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cmd2. 2024-04-24T22:56:47.019 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-24T22:56:47.023 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:47.050 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-24T22:56:47.301 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cephfs. 2024-04-24T22:56:47.327 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:47.353 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-24T22:56:47.368 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:47.380 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-24T22:56:47.445 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T22:56:47.687 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-24T22:56:47.713 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:56:47.753 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:47.782 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-24T22:56:47.808 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-24T22:56:47.848 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T22:56:48.091 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-prettytable. 2024-04-24T22:56:48.117 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-24T22:56:48.157 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-24T22:56:48.193 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-24T22:56:48.220 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-24T22:56:48.260 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T22:56:48.410 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rbd. 2024-04-24T22:56:48.426 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:48.459 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:48.622 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-24T22:56:48.648 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T22:56:48.689 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T22:56:48.788 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-24T22:56:48.814 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-24T22:56:48.854 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T22:56:49.125 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-24T22:56:49.151 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T22:56:49.157 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-24T22:56:49.184 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-24T22:56:49.192 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T22:56:49.224 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T22:56:49.502 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-24T22:56:49.517 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-24T22:56:49.536 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-24T22:56:49.551 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T22:56:49.563 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T22:56:49.603 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T22:56:49.855 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package lua5.1. 2024-04-24T22:56:49.881 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-24T22:56:49.922 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-24T22:56:49.931 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-24T22:56:49.957 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-24T22:56:49.991 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T22:56:50.242 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package lua-any. 2024-04-24T22:56:50.257 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-24T22:56:50.300 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-24T22:56:50.325 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package librados2. 2024-04-24T22:56:50.352 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../010-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:50.392 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:50.569 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package zip. 2024-04-24T22:56:50.584 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-24T22:56:50.619 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking zip (3.0-12build2) ... 2024-04-24T22:56:50.812 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package librbd1. 2024-04-24T22:56:50.838 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../011-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:50.872 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package unzip. 2024-04-24T22:56:50.878 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:50.887 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-24T22:56:50.931 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-24T22:56:51.465 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libcephfs2. 2024-04-24T22:56:51.491 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:51.531 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:51.826 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rados. 2024-04-24T22:56:51.853 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:51.892 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:51.894 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package luarocks. 2024-04-24T22:56:51.920 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-24T22:56:51.960 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-24T22:56:52.178 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-24T22:56:52.194 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:56:52.228 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:52.318 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librgw2. 2024-04-24T22:56:52.334 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../027-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:52.368 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:52.448 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cephfs. 2024-04-24T22:56:52.474 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:52.514 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:52.825 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-24T22:56:52.852 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:56:52.879 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rgw. 2024-04-24T22:56:52.892 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:52.894 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:52.937 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:53.212 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-prettytable. 2024-04-24T22:56:53.238 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-24T22:56:53.278 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-24T22:56:53.309 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-24T22:56:53.335 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-24T22:56:53.367 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T22:56:53.539 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rbd. 2024-04-24T22:56:53.566 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:53.606 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:53.668 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libradosstriper1. 2024-04-24T22:56:53.695 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:53.737 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:53.909 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-24T22:56:53.936 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-24T22:56:53.975 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T22:56:54.149 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-common. 2024-04-24T22:56:54.176 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:54.215 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:54.253 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-24T22:56:54.270 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-24T22:56:54.312 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T22:56:54.614 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-24T22:56:54.641 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-24T22:56:54.681 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T22:56:54.968 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package lua5.1. 2024-04-24T22:56:54.995 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-24T22:56:55.026 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-24T22:56:55.337 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package lua-any. 2024-04-24T22:56:55.364 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-24T22:56:55.404 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-24T22:56:55.571 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-base. 2024-04-24T22:56:55.598 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:55.646 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:55.656 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package zip. 2024-04-24T22:56:55.683 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-24T22:56:55.723 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking zip (3.0-12build2) ... 2024-04-24T22:56:56.027 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package unzip. 2024-04-24T22:56:56.053 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-24T22:56:56.118 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-24T22:56:56.242 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-24T22:56:56.268 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-24T22:56:56.309 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-24T22:56:56.603 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cheroot. 2024-04-24T22:56:56.629 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-24T22:56:56.845 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T22:56:56.845 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package luarocks. 2024-04-24T22:56:56.845 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-24T22:56:56.845 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-24T22:56:57.046 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package librgw2. 2024-04-24T22:56:57.073 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../027-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:57.104 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:57.181 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-24T22:56:57.208 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-24T22:56:57.240 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-24T22:56:57.543 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-24T22:56:57.570 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-24T22:56:57.609 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-24T22:56:57.665 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rgw. 2024-04-24T22:56:57.681 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:57.723 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:57.912 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-24T22:56:57.939 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-24T22:56:57.979 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-24T22:56:58.077 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-24T22:56:58.103 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-24T22:56:58.143 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T22:56:58.215 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-tempora. 2024-04-24T22:56:58.230 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-24T22:56:58.265 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-24T22:56:58.396 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libradosstriper1. 2024-04-24T22:56:58.423 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:58.454 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:58.551 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-portend. 2024-04-24T22:56:58.578 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-24T22:56:58.618 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-24T22:56:58.857 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-common. 2024-04-24T22:56:58.884 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:56:58.921 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-24T22:56:58.924 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:56:58.948 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-24T22:56:58.987 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-24T22:56:59.257 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-24T22:56:59.284 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-24T22:56:59.315 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-24T22:56:59.686 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-natsort. 2024-04-24T22:56:59.713 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-24T22:56:59.752 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-24T22:57:00.047 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-logutils. 2024-04-24T22:57:00.071 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-24T22:57:00.105 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-24T22:57:00.213 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-base. 2024-04-24T22:57:00.240 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:00.289 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:00.417 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-24T22:57:00.443 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-24T22:57:00.484 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-24T22:57:00.795 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-mako. 2024-04-24T22:57:00.821 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-24T22:57:00.862 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T22:57:00.875 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-24T22:57:00.902 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-24T22:57:00.950 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-24T22:57:01.173 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-24T22:57:01.200 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-24T22:57:01.240 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-24T22:57:01.253 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cheroot. 2024-04-24T22:57:01.280 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-24T22:57:01.311 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T22:57:01.535 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-24T22:57:01.561 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-24T22:57:01.581 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-24T22:57:01.601 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-24T22:57:01.608 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-24T22:57:01.639 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-24T22:57:01.896 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-webob. 2024-04-24T22:57:01.922 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-24T22:57:01.962 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-24T22:57:02.160 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-24T22:57:02.186 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-24T22:57:02.234 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-24T22:57:02.307 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-waitress. 2024-04-24T22:57:02.334 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-24T22:57:02.377 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T22:57:02.537 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-24T22:57:02.564 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-24T22:57:02.603 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-24T22:57:02.702 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-tempita. 2024-04-24T22:57:02.729 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-24T22:57:02.768 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T22:57:02.865 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-tempora. 2024-04-24T22:57:02.881 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-24T22:57:02.914 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-24T22:57:03.046 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-paste. 2024-04-24T22:57:03.073 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-24T22:57:03.113 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T22:57:03.159 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-portend. 2024-04-24T22:57:03.186 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-24T22:57:03.259 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-24T22:57:03.441 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-24T22:57:03.456 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-24T22:57:03.491 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T22:57:03.545 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-24T22:57:03.572 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-24T22:57:03.611 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-24T22:57:03.769 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-24T22:57:03.796 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-24T22:57:03.836 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-24T22:57:03.915 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-24T22:57:03.942 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-24T22:57:03.981 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-24T22:57:04.156 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-webtest. 2024-04-24T22:57:04.182 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-24T22:57:04.222 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-24T22:57:04.343 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-natsort. 2024-04-24T22:57:04.370 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-24T22:57:04.410 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-24T22:57:04.534 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pecan. 2024-04-24T22:57:04.560 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-24T22:57:04.609 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T22:57:04.721 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-logutils. 2024-04-24T22:57:04.749 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-24T22:57:04.788 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-24T22:57:04.972 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-certifi. 2024-04-24T22:57:04.998 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-24T22:57:05.032 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-24T22:57:05.038 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-24T22:57:05.059 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-24T22:57:05.090 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-24T22:57:05.375 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-idna. 2024-04-24T22:57:05.401 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-24T22:57:05.427 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-mako. 2024-04-24T22:57:05.441 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-24T22:57:05.454 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-24T22:57:05.493 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T22:57:06.412 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-urllib3. 2024-04-24T22:57:06.440 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-24T22:57:06.505 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-24T22:57:06.532 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-24T22:57:06.614 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-24T22:57:06.653 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T22:57:06.941 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-24T22:57:06.968 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-24T22:57:06.973 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-requests. 2024-04-24T22:57:07.000 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-24T22:57:07.008 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-24T22:57:07.040 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T22:57:07.269 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-webob. 2024-04-24T22:57:07.296 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-24T22:57:07.327 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-24T22:57:07.502 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-24T22:57:07.529 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-24T22:57:07.570 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T22:57:07.656 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-waitress. 2024-04-24T22:57:07.683 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-24T22:57:07.725 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T22:57:07.830 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-24T22:57:07.864 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:07.897 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:08.034 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-tempita. 2024-04-24T22:57:08.061 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-24T22:57:08.100 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T22:57:08.285 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-24T22:57:08.314 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:08.352 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:08.411 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-paste. 2024-04-24T22:57:08.439 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-24T22:57:08.479 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T22:57:08.613 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-24T22:57:08.628 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-24T22:57:08.663 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-24T22:57:08.772 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-24T22:57:08.800 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-24T22:57:08.839 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T22:57:08.999 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-openssl. 2024-04-24T22:57:09.026 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-24T22:57:09.065 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-24T22:57:09.142 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-24T22:57:09.169 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-24T22:57:09.208 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-24T22:57:09.419 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr. 2024-04-24T22:57:09.445 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:09.485 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:09.486 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-webtest. 2024-04-24T22:57:09.514 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-24T22:57:09.553 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-24T22:57:09.814 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pecan. 2024-04-24T22:57:09.842 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-24T22:57:09.864 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mon. 2024-04-24T22:57:09.872 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T22:57:09.879 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:09.913 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:10.203 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-certifi. 2024-04-24T22:57:10.230 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-24T22:57:10.269 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-24T22:57:10.501 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-osd. 2024-04-24T22:57:10.527 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:10.575 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:10.630 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-idna. 2024-04-24T22:57:10.657 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-24T22:57:10.697 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-24T22:57:11.008 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-urllib3. 2024-04-24T22:57:11.035 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-24T22:57:11.074 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T22:57:11.372 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-requests. 2024-04-24T22:57:11.399 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-24T22:57:11.430 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T22:57:11.637 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph. 2024-04-24T22:57:11.652 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../068-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:11.683 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-24T22:57:11.695 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:11.695 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-24T22:57:11.724 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T22:57:11.989 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-fuse. 2024-04-24T22:57:12.005 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:12.019 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-24T22:57:12.035 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:12.039 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:12.069 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:12.402 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mds. 2024-04-24T22:57:12.428 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:12.467 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:12.641 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-24T22:57:12.668 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:12.707 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:12.879 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephadm. 2024-04-24T22:57:12.906 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../071-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:12.946 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:13.027 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-24T22:57:13.053 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-24T22:57:13.093 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-24T22:57:13.240 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-24T22:57:13.267 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-24T22:57:13.306 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-24T22:57:13.404 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-openssl. 2024-04-24T22:57:13.432 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-24T22:57:13.471 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-24T22:57:13.618 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-24T22:57:13.633 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T22:57:13.676 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T22:57:13.824 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr. 2024-04-24T22:57:13.851 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:13.899 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:14.394 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mon. 2024-04-24T22:57:14.421 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:14.468 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:14.715 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-babel. 2024-04-24T22:57:14.742 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T22:57:14.781 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T22:57:15.106 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-osd. 2024-04-24T22:57:15.118 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jinja2. 2024-04-24T22:57:15.133 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:15.145 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-24T22:57:15.172 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:15.184 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T22:57:15.538 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-24T22:57:15.564 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:15.604 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:15.949 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-24T22:57:15.976 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-24T22:57:16.015 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-24T22:57:16.233 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph. 2024-04-24T22:57:16.250 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../068-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:16.277 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-routes. 2024-04-24T22:57:16.292 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:16.293 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-24T22:57:16.327 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T22:57:16.602 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-fuse. 2024-04-24T22:57:16.619 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:16.622 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-24T22:57:16.637 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:16.652 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:16.671 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:16.964 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mds. 2024-04-24T22:57:16.992 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:17.031 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:17.417 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package cephadm. 2024-04-24T22:57:17.445 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../071-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:17.483 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:17.837 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-24T22:57:17.864 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-24T22:57:17.912 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-24T22:57:18.019 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-24T22:57:18.046 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-24T22:57:18.085 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T22:57:18.222 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-24T22:57:18.239 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T22:57:18.272 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T22:57:18.597 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-joblib. 2024-04-24T22:57:18.625 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-24T22:57:18.664 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T22:57:19.026 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-24T22:57:19.054 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-24T22:57:19.178 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-24T22:57:19.228 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-babel. 2024-04-24T22:57:19.255 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T22:57:19.286 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T22:57:19.473 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-sklearn. 2024-04-24T22:57:19.500 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-24T22:57:19.539 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T22:57:19.555 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jinja2. 2024-04-24T22:57:19.583 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-24T22:57:19.614 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T22:57:19.933 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-24T22:57:19.961 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:19.991 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:20.320 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-24T22:57:20.347 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-24T22:57:20.365 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-24T22:57:20.378 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-24T22:57:20.393 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:20.432 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:20.673 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-routes. 2024-04-24T22:57:20.700 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-24T22:57:20.739 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T22:57:21.059 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-24T22:57:21.087 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:21.148 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:21.435 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cachetools. 2024-04-24T22:57:21.462 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-24T22:57:21.502 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-24T22:57:21.763 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-24T22:57:21.786 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-24T22:57:21.821 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-24T22:57:22.158 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-24T22:57:22.185 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-24T22:57:22.225 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T22:57:22.373 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-24T22:57:22.389 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-24T22:57:22.431 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T22:57:22.498 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rsa. 2024-04-24T22:57:22.522 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-24T22:57:22.561 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-24T22:57:23.085 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-joblib. 2024-04-24T22:57:23.112 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-24T22:57:23.132 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-google-auth. 2024-04-24T22:57:23.142 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T22:57:23.159 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-24T22:57:23.198 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-24T22:57:23.504 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-24T22:57:23.527 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-24T22:57:23.532 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-24T22:57:23.554 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-24T22:57:23.593 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T22:57:23.656 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-24T22:57:23.872 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-websocket. 2024-04-24T22:57:23.899 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-24T22:57:23.930 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-24T22:57:23.934 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-sklearn. 2024-04-24T22:57:23.962 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-24T22:57:23.994 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T22:57:24.225 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-24T22:57:24.252 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-24T22:57:24.291 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T22:57:24.785 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-24T22:57:24.813 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:24.851 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:24.981 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-24T22:57:25.009 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:25.047 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:25.375 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-24T22:57:25.403 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-24T22:57:25.441 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T22:57:25.737 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-24T22:57:25.764 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T22:57:25.771 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cachetools. 2024-04-24T22:57:25.788 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-24T22:57:25.803 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T22:57:25.829 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-24T22:57:26.064 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package jq. 2024-04-24T22:57:26.080 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T22:57:26.122 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-24T22:57:26.133 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-24T22:57:26.160 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-24T22:57:26.199 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-24T22:57:26.375 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package socat. 2024-04-24T22:57:26.403 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-24T22:57:26.442 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-24T22:57:26.536 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-24T22:57:26.563 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-24T22:57:26.602 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T22:57:26.745 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package xmlstarlet. 2024-04-24T22:57:26.773 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-24T22:57:26.811 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-24T22:57:26.914 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rsa. 2024-04-24T22:57:26.941 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-24T22:57:26.980 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-24T22:57:27.166 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-test. 2024-04-24T22:57:27.182 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:27.249 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:27.451 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-google-auth. 2024-04-24T22:57:27.478 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-24T22:57:27.517 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-24T22:57:27.829 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-24T22:57:27.856 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-24T22:57:27.895 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T22:57:28.223 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-websocket. 2024-04-24T22:57:28.251 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-24T22:57:28.290 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-24T22:57:28.643 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-24T22:57:28.671 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-24T22:57:28.710 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T22:57:29.399 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-24T22:57:29.416 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:29.457 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:29.596 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-volume. 2024-04-24T22:57:29.623 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:29.661 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:29.751 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-24T22:57:29.779 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-24T22:57:29.818 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T22:57:30.041 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-24T22:57:30.069 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:30.107 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:30.121 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-24T22:57:30.150 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T22:57:30.187 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T22:57:30.419 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-colorama. 2024-04-24T22:57:30.447 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-24T22:57:30.449 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package jq. 2024-04-24T22:57:30.476 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T22:57:30.477 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-24T22:57:30.515 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-24T22:57:30.680 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephfs-shell. 2024-04-24T22:57:30.708 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:30.746 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:30.768 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package socat. 2024-04-24T22:57:30.796 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-24T22:57:30.834 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-24T22:57:31.016 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephfs-top. 2024-04-24T22:57:31.044 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:31.082 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:31.146 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package xmlstarlet. 2024-04-24T22:57:31.174 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-24T22:57:31.221 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-24T22:57:31.343 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-24T22:57:31.359 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:31.402 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:31.575 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-test. 2024-04-24T22:57:31.592 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:31.633 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:31.688 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-24T22:57:31.716 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-24T22:57:31.754 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T22:57:32.059 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-24T22:57:32.087 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-24T22:57:32.125 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-24T22:57:32.496 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package nvme-cli. 2024-04-24T22:57:32.524 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-24T22:57:32.563 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T22:57:32.970 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package pkg-config. 2024-04-24T22:57:32.999 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-24T22:57:33.028 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T22:57:33.248 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-24T22:57:33.264 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-24T22:57:33.306 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-24T22:57:33.710 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-24T22:57:33.738 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-24T22:57:33.767 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-24T22:57:34.054 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-volume. 2024-04-24T22:57:34.079 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pastescript. 2024-04-24T22:57:34.082 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:34.107 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-24T22:57:34.121 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:34.145 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-24T22:57:34.465 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pluggy. 2024-04-24T22:57:34.493 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-24T22:57:34.516 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-24T22:57:34.531 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-24T22:57:34.545 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:34.583 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:34.843 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-psutil. 2024-04-24T22:57:34.871 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-24T22:57:34.894 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-colorama. 2024-04-24T22:57:34.909 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-24T22:57:34.923 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-24T22:57:34.960 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-24T22:57:35.205 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package cephfs-shell. 2024-04-24T22:57:35.222 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:35.254 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-py. 2024-04-24T22:57:35.258 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:35.282 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-24T22:57:35.328 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-24T22:57:35.533 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package cephfs-top. 2024-04-24T22:57:35.561 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-24T22:57:35.599 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:35.657 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pygments. 2024-04-24T22:57:35.685 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-24T22:57:35.723 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T22:57:35.852 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-24T22:57:35.870 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:35.910 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:36.195 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-24T22:57:36.222 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-24T22:57:36.223 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-24T22:57:36.250 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-24T22:57:36.261 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-24T22:57:36.288 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T22:57:36.538 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-toml. 2024-04-24T22:57:36.566 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-24T22:57:36.584 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-24T22:57:36.596 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-24T22:57:36.613 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-24T22:57:36.642 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-24T22:57:36.891 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pytest. 2024-04-24T22:57:36.919 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-24T22:57:36.957 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T22:57:37.030 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package nvme-cli. 2024-04-24T22:57:37.058 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-24T22:57:37.096 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T22:57:37.286 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-simplejson. 2024-04-24T22:57:37.314 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-24T22:57:37.344 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-24T22:57:37.485 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package pkg-config. 2024-04-24T22:57:37.513 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-24T22:57:37.543 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T22:57:37.580 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-24T22:57:37.597 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-24T22:57:37.630 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-24T22:57:37.771 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-24T22:57:37.787 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-24T22:57:37.829 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-24T22:57:38.207 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-24T22:57:38.224 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-24T22:57:38.265 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-24T22:57:38.284 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package radosgw. 2024-04-24T22:57:38.312 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../122-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:38.342 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:38.568 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pastescript. 2024-04-24T22:57:38.596 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-24T22:57:38.634 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-24T22:57:38.955 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pluggy. 2024-04-24T22:57:38.983 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-24T22:57:39.030 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-24T22:57:39.137 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package rbd-fuse. 2024-04-24T22:57:39.165 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:39.195 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:39.366 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-psutil. 2024-04-24T22:57:39.394 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-24T22:57:39.432 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-24T22:57:39.475 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-24T22:57:39.767 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T22:57:39.769 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-py. 2024-04-24T22:57:39.797 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-24T22:57:39.835 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-24T22:57:39.893 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T22:57:40.156 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-24T22:57:40.181 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pygments. 2024-04-24T22:57:40.209 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-24T22:57:40.247 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T22:57:40.472 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-24T22:57:40.718 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-24T22:57:40.746 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-24T22:57:40.784 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-24T22:57:40.887 INFO:teuthology.orchestra.run.smithi162.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-24T22:57:40.953 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:41.095 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-toml. 2024-04-24T22:57:41.124 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-24T22:57:41.161 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-24T22:57:41.448 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pytest. 2024-04-24T22:57:41.452 INFO:teuthology.orchestra.run.smithi162.stdout:Adding system user cephadm....done 2024-04-24T22:57:41.476 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-24T22:57:41.506 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T22:57:41.567 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T22:57:41.835 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-24T22:57:41.868 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-simplejson. 2024-04-24T22:57:41.896 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-24T22:57:41.934 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-24T22:57:42.087 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-24T22:57:42.196 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-24T22:57:42.212 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-24T22:57:42.229 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-24T22:57:42.270 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-24T22:57:42.430 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-24T22:57:42.673 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T22:57:42.799 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-24T22:57:43.033 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package radosgw. 2024-04-24T22:57:43.062 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../122-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:43.126 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T22:57:43.503 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-24T22:57:43.896 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-24T22:57:44.028 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package rbd-fuse. 2024-04-24T22:57:44.057 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-24T22:57:44.131 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-24T22:57:44.185 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:44.382 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-24T22:57:44.499 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-24T22:57:44.633 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-24T22:57:44.757 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T22:57:44.883 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T22:57:44.884 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-24T22:57:45.144 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-24T22:57:45.151 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-24T22:57:45.404 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:45.477 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-24T22:57:45.663 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T22:57:45.764 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T22:57:45.865 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-24T22:57:45.911 INFO:teuthology.orchestra.run.smithi043.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-24T22:57:46.086 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:46.115 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T22:57:46.242 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-24T22:57:46.502 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-24T22:57:46.909 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-24T22:57:46.929 INFO:teuthology.orchestra.run.smithi043.stdout:Adding system user cephadm....done 2024-04-24T22:57:46.940 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-24T22:57:47.013 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T22:57:47.114 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-24T22:57:47.234 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T22:57:47.448 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T22:57:47.575 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-24T22:57:47.834 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T22:57:47.837 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-24T22:57:48.102 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-24T22:57:48.114 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-24T22:57:48.232 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-24T22:57:48.428 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up zip (3.0-12build2) ... 2024-04-24T22:57:48.491 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-24T22:57:48.537 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T22:57:48.759 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T22:57:48.885 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-24T22:57:49.156 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T22:57:49.195 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T22:57:49.398 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T22:57:49.542 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-24T22:57:49.556 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-24T22:57:49.668 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T22:57:49.840 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-24T22:57:49.985 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-24T22:57:50.099 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-24T22:57:50.369 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-24T22:57:50.451 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-24T22:57:50.604 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T22:57:50.677 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-24T22:57:50.937 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-24T22:57:50.939 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T22:57:51.215 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-24T22:57:51.232 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-24T22:57:51.466 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:51.533 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T22:57:51.734 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T22:57:51.835 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T22:57:51.893 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-24T22:57:51.936 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-24T22:57:52.144 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-24T22:57:52.195 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T22:57:52.270 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:52.321 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-24T22:57:52.597 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-24T22:57:52.621 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-idna (3.3-1) ... 2024-04-24T22:57:52.957 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-24T22:57:52.979 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-24T22:57:53.034 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T22:57:53.089 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T22:57:53.135 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-24T22:57:53.486 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T22:57:53.603 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-24T22:57:53.871 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T22:57:54.156 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-24T22:57:54.330 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T22:57:54.538 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T22:57:54.664 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-24T22:57:54.743 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up zip (3.0-12build2) ... 2024-04-24T22:57:54.849 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T22:57:54.923 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T22:57:55.049 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-24T22:57:55.192 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T22:57:55.494 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-24T22:57:55.551 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T22:57:55.737 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-24T22:57:55.802 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T22:57:55.928 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-24T22:57:55.962 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T22:57:56.054 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T22:57:56.072 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-24T22:57:56.364 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-24T22:57:56.373 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-24T22:57:56.625 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-24T22:57:56.765 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-24T22:57:56.900 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-24T22:57:57.033 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T22:57:57.152 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-24T22:57:57.394 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-24T22:57:57.418 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T22:57:57.629 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T22:57:57.694 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-24T22:57:57.730 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-24T22:57:58.006 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T22:57:58.020 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T22:57:58.132 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T22:57:58.379 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-24T22:57:58.433 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-24T22:57:58.639 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-24T22:57:58.740 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:57:58.742 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-24T22:57:58.994 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T22:57:59.033 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-idna (3.3-1) ... 2024-04-24T22:57:59.094 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-24T22:57:59.196 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T22:57:59.276 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-24T22:57:59.342 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T22:57:59.514 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T22:57:59.640 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T22:58:00.025 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-24T22:58:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-24T22:58:00.418 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-24T22:58:00.565 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T22:58:00.653 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T22:58:00.762 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T22:58:00.817 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T22:58:00.926 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-24T22:58:01.063 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T22:58:01.177 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T22:58:01.289 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-24T22:58:01.364 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T22:58:01.412 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T22:58:01.641 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-24T22:58:01.721 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-24T22:58:01.852 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-24T22:58:01.964 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-24T22:58:02.104 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-24T22:58:02.216 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T22:58:02.342 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-24T22:58:02.355 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T22:58:02.623 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-24T22:58:02.643 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-24T22:58:02.886 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-24T22:58:03.008 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-24T22:58:03.153 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-24T22:58:03.309 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T22:58:03.438 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-24T22:58:03.654 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T22:58:03.689 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-24T22:58:03.771 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:03.897 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:03.958 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T22:58:04.023 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-24T22:58:04.074 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-24T22:58:04.385 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:04.392 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T22:58:04.494 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:04.510 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T22:58:04.620 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-24T22:58:04.806 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-24T22:58:04.872 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:04.998 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:05.103 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-24T22:58:05.124 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:05.334 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T22:58:05.334 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T22:58:05.396 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T22:58:05.497 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-24T22:58:05.599 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T22:58:05.671 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-24T22:58:05.801 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:05.925 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T22:58:05.926 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:06.026 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T22:58:06.036 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:06.137 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:06.246 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T22:58:06.419 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-24T22:58:06.695 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-24T22:58:06.821 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-24T22:58:07.089 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T22:58:07.223 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T22:58:07.383 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:07.509 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:07.541 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T22:58:07.610 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:07.711 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:07.829 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:07.842 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T22:58:07.955 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:08.110 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-24T22:58:08.305 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-24T22:58:08.539 INFO:teuthology.orchestra.run.smithi162.stdout:Adding group ceph....done 2024-04-24T22:58:08.589 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-24T22:58:08.858 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T22:58:08.883 INFO:teuthology.orchestra.run.smithi162.stdout:Adding system user ceph....done 2024-04-24T22:58:09.017 INFO:teuthology.orchestra.run.smithi162.stdout:Setting system user ceph properties....done 2024-04-24T22:58:09.033 INFO:teuthology.orchestra.run.smithi162.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-24T22:58:09.126 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-24T22:58:09.169 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-24T22:58:09.465 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-24T22:58:09.511 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-24T22:58:09.804 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T22:58:09.923 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:10.129 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T22:58:10.129 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T22:58:10.147 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T22:58:10.282 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:10.408 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:10.509 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-24T22:58:10.599 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:10.725 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:10.829 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:10.955 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:11.081 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-24T22:58:11.155 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T22:58:11.155 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T22:58:11.374 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:11.500 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:11.569 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:11.626 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:11.845 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T22:58:11.846 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T22:58:11.885 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-24T22:58:12.337 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:12.344 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:12.462 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:12.576 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T22:58:12.576 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T22:58:12.588 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:12.713 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:12.839 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T22:58:13.022 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:13.241 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T22:58:13.241 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T22:58:13.707 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:14.005 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T22:58:14.005 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T22:58:14.110 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:14.236 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:14.362 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:14.487 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:14.597 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:14.698 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:14.707 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:14.804 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:14.955 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:15.168 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T22:58:15.168 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T22:58:15.241 INFO:teuthology.orchestra.run.smithi043.stdout:Adding group ceph....done 2024-04-24T22:58:15.585 INFO:teuthology.orchestra.run.smithi043.stdout:Adding system user ceph....done 2024-04-24T22:58:15.597 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:15.740 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:15.745 INFO:teuthology.orchestra.run.smithi043.stdout:Setting system user ceph properties....done 2024-04-24T22:58:15.762 INFO:teuthology.orchestra.run.smithi043.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-24T22:58:15.875 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:15.907 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-24T22:58:16.018 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:16.245 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-24T22:58:16.345 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T22:58:16.471 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T22:58:16.624 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T22:58:16.724 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:16.938 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T22:58:16.938 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-24T22:58:17.434 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:17.535 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:17.674 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T22:58:17.990 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T22:58:17.990 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T22:58:18.297 INFO:teuthology.orchestra.run.smithi162.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T22:58:18.300 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-24T22:58:18.353 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-04-24T22:58:18.453 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:18.553 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2024-04-24T22:58:18.554 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2024-04-24T22:58:18.748 INFO:teuthology.orchestra.run.smithi162.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-24T22:58:18.749 INFO:teuthology.orchestra.run.smithi162.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-24T22:58:18.749 INFO:teuthology.orchestra.run.smithi162.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-24T22:58:18.749 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T22:58:18.749 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T22:58:18.749 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T22:58:18.749 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T22:58:18.751 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T22:58:18.751 INFO:teuthology.orchestra.run.smithi162.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T22:58:18.751 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T22:58:18.751 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2024-04-24T22:58:18.751 INFO:teuthology.orchestra.run.smithi162.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-24T22:58:18.751 INFO:teuthology.orchestra.run.smithi162.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-24T22:58:18.751 INFO:teuthology.orchestra.run.smithi162.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-24T22:58:18.751 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-24T22:58:18.751 INFO:teuthology.orchestra.run.smithi162.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T22:58:18.752 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2024-04-24T22:58:18.752 INFO:teuthology.orchestra.run.smithi162.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-24T22:58:18.752 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-24T22:58:18.752 INFO:teuthology.orchestra.run.smithi162.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-24T22:58:18.792 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2024-04-24T22:58:18.792 INFO:teuthology.orchestra.run.smithi162.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-24T22:58:18.792 INFO:teuthology.orchestra.run.smithi162.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-24T22:58:18.793 INFO:teuthology.orchestra.run.smithi162.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-24T22:58:18.793 INFO:teuthology.orchestra.run.smithi162.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-24T22:58:18.793 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-24T22:58:18.793 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-24T22:58:18.793 INFO:teuthology.orchestra.run.smithi162.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T22:58:18.794 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages will be upgraded: 2024-04-24T22:58:18.795 INFO:teuthology.orchestra.run.smithi162.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-24T22:58:18.829 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-24T22:58:18.853 INFO:teuthology.orchestra.run.smithi162.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-24T22:58:18.853 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 55.7 MB of archives. 2024-04-24T22:58:18.853 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-24T22:58:18.853 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-24T22:58:19.013 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-24T22:58:19.021 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-24T22:58:19.061 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-24T22:58:19.062 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-24T22:58:19.063 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-24T22:58:19.074 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-24T22:58:19.075 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-24T22:58:19.077 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-24T22:58:19.078 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-24T22:58:19.079 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-24T22:58:19.080 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-24T22:58:19.083 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-24T22:58:19.106 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-24T22:58:19.107 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-24T22:58:19.108 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-24T22:58:19.297 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:19.487 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-24T22:58:19.489 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-24T22:58:19.490 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-24T22:58:19.492 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-24T22:58:19.493 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-24T22:58:19.497 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-24T22:58:19.499 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-24T22:58:19.506 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-24T22:58:19.507 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-24T22:58:19.528 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-24T22:58:19.529 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-24T22:58:19.540 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-24T22:58:19.542 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T22:58:19.543 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T22:58:19.564 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-24T22:58:19.567 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-24T22:58:19.568 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-24T22:58:19.568 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-24T22:58:19.569 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-24T22:58:19.580 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-24T22:58:19.581 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-24T22:58:19.812 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-24T22:58:19.812 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-24T22:58:19.812 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-24T22:58:19.812 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-24T22:58:19.812 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-24T22:58:19.813 INFO:teuthology.orchestra.run.smithi162.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-24T22:58:19.824 INFO:teuthology.orchestra.run.smithi162.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-24T22:58:19.881 INFO:teuthology.orchestra.run.smithi162.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-24T22:58:20.032 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:20.263 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T22:58:20.263 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T22:58:20.284 INFO:teuthology.orchestra.run.smithi162.stdout:Preconfiguring packages ... 2024-04-24T22:58:20.446 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 55.7 MB in 1s (51.6 MB/s) 2024-04-24T22:58:20.741 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:20.764 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173984 files and directories currently installed.) 2024-04-24T22:58:20.769 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T22:58:20.915 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T22:58:21.022 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T22:58:21.023 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T22:58:21.545 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-24T22:58:21.582 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:21.715 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:21.875 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:22.076 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T22:58:22.077 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T22:58:22.502 INFO:teuthology.orchestra.run.smithi162.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-24T22:58:22.576 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:22.702 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:22.798 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package flex. 2024-04-24T22:58:22.827 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:22.899 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173984 files and directories currently installed.) 2024-04-24T22:58:22.905 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-24T22:58:22.946 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-24T22:58:22.979 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-24T22:58:23.348 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T22:58:23.457 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T22:58:23.478 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T22:58:23.609 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T22:58:23.643 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-24T22:58:24.037 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T22:58:24.556 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174057 files and directories currently installed.) 2024-04-24T22:58:24.561 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T22:58:24.683 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T22:58:24.693 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T22:58:25.084 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T22:58:25.215 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T22:58:25.358 INFO:teuthology.orchestra.run.smithi043.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T22:58:25.362 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-24T22:58:25.426 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-04-24T22:58:25.534 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T22:58:25.632 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2024-04-24T22:58:25.632 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2024-04-24T22:58:25.832 INFO:teuthology.orchestra.run.smithi043.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-24T22:58:25.832 INFO:teuthology.orchestra.run.smithi043.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-24T22:58:25.832 INFO:teuthology.orchestra.run.smithi043.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-24T22:58:25.832 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T22:58:25.832 INFO:teuthology.orchestra.run.smithi043.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T22:58:25.832 INFO:teuthology.orchestra.run.smithi043.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T22:58:25.832 INFO:teuthology.orchestra.run.smithi043.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T22:58:25.833 INFO:teuthology.orchestra.run.smithi043.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T22:58:25.833 INFO:teuthology.orchestra.run.smithi043.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T22:58:25.833 INFO:teuthology.orchestra.run.smithi043.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T22:58:25.834 INFO:teuthology.orchestra.run.smithi043.stdout:The following additional packages will be installed: 2024-04-24T22:58:25.834 INFO:teuthology.orchestra.run.smithi043.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-24T22:58:25.834 INFO:teuthology.orchestra.run.smithi043.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-24T22:58:25.834 INFO:teuthology.orchestra.run.smithi043.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-24T22:58:25.835 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-24T22:58:25.835 INFO:teuthology.orchestra.run.smithi043.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T22:58:25.836 INFO:teuthology.orchestra.run.smithi043.stdout:Suggested packages: 2024-04-24T22:58:25.836 INFO:teuthology.orchestra.run.smithi043.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-24T22:58:25.836 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-24T22:58:25.836 INFO:teuthology.orchestra.run.smithi043.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-24T22:58:25.879 INFO:teuthology.orchestra.run.smithi043.stdout:The following NEW packages will be installed: 2024-04-24T22:58:25.879 INFO:teuthology.orchestra.run.smithi043.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-24T22:58:25.879 INFO:teuthology.orchestra.run.smithi043.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-24T22:58:25.880 INFO:teuthology.orchestra.run.smithi043.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-24T22:58:25.880 INFO:teuthology.orchestra.run.smithi043.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-24T22:58:25.880 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-24T22:58:25.880 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-24T22:58:25.880 INFO:teuthology.orchestra.run.smithi043.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-24T22:58:25.882 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages will be upgraded: 2024-04-24T22:58:25.882 INFO:teuthology.orchestra.run.smithi043.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-24T22:58:25.924 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package bison. 2024-04-24T22:58:25.941 INFO:teuthology.orchestra.run.smithi043.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-24T22:58:25.941 INFO:teuthology.orchestra.run.smithi043.stdout:Need to get 55.7 MB of archives. 2024-04-24T22:58:25.941 INFO:teuthology.orchestra.run.smithi043.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-24T22:58:25.941 INFO:teuthology.orchestra.run.smithi043.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-24T22:58:26.028 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174057 files and directories currently installed.) 2024-04-24T22:58:26.034 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-24T22:58:26.084 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T22:58:26.095 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-24T22:58:26.103 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-24T22:58:26.143 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-24T22:58:26.144 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-24T22:58:26.144 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-24T22:58:26.156 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-24T22:58:26.157 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-24T22:58:26.159 INFO:teuthology.orchestra.run.smithi043.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-24T22:58:26.160 INFO:teuthology.orchestra.run.smithi043.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-24T22:58:26.161 INFO:teuthology.orchestra.run.smithi043.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-24T22:58:26.163 INFO:teuthology.orchestra.run.smithi043.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-24T22:58:26.164 INFO:teuthology.orchestra.run.smithi043.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-24T22:58:26.184 INFO:teuthology.orchestra.run.smithi043.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-24T22:58:26.184 INFO:teuthology.orchestra.run.smithi043.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-24T22:58:26.185 INFO:teuthology.orchestra.run.smithi043.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-24T22:58:26.510 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-24T22:58:26.537 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-24T22:58:26.576 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T22:58:26.608 INFO:teuthology.orchestra.run.smithi043.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-24T22:58:26.612 INFO:teuthology.orchestra.run.smithi043.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-24T22:58:26.612 INFO:teuthology.orchestra.run.smithi043.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-24T22:58:26.616 INFO:teuthology.orchestra.run.smithi043.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-24T22:58:26.616 INFO:teuthology.orchestra.run.smithi043.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-24T22:58:26.623 INFO:teuthology.orchestra.run.smithi043.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-24T22:58:26.625 INFO:teuthology.orchestra.run.smithi043.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-24T22:58:26.636 INFO:teuthology.orchestra.run.smithi043.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-24T22:58:26.636 INFO:teuthology.orchestra.run.smithi043.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-24T22:58:26.668 INFO:teuthology.orchestra.run.smithi043.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-24T22:58:26.668 INFO:teuthology.orchestra.run.smithi043.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-24T22:58:26.680 INFO:teuthology.orchestra.run.smithi043.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-24T22:58:26.700 INFO:teuthology.orchestra.run.smithi043.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-24T22:58:26.703 INFO:teuthology.orchestra.run.smithi043.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-24T22:58:26.704 INFO:teuthology.orchestra.run.smithi043.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-24T22:58:26.705 INFO:teuthology.orchestra.run.smithi043.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-24T22:58:26.705 INFO:teuthology.orchestra.run.smithi043.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-24T22:58:26.716 INFO:teuthology.orchestra.run.smithi043.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-24T22:58:26.718 INFO:teuthology.orchestra.run.smithi043.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-24T22:58:26.871 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package dump. 2024-04-24T22:58:26.898 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-24T22:58:26.929 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking dump (0.4b47-3) ... 2024-04-24T22:58:26.933 INFO:teuthology.orchestra.run.smithi043.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-24T22:58:26.933 INFO:teuthology.orchestra.run.smithi043.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-24T22:58:26.934 INFO:teuthology.orchestra.run.smithi043.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-24T22:58:26.934 INFO:teuthology.orchestra.run.smithi043.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-24T22:58:26.968 INFO:teuthology.orchestra.run.smithi043.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-24T22:58:26.968 INFO:teuthology.orchestra.run.smithi043.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-24T22:58:26.981 INFO:teuthology.orchestra.run.smithi043.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-24T22:58:26.981 INFO:teuthology.orchestra.run.smithi043.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-24T22:58:27.191 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package indent. 2024-04-24T22:58:27.218 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T22:58:27.257 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T22:58:27.394 INFO:teuthology.orchestra.run.smithi043.stdout:Preconfiguring packages ... 2024-04-24T22:58:27.538 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-24T22:58:27.563 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-24T22:58:27.580 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 55.7 MB in 1s (51.1 MB/s) 2024-04-24T22:58:27.602 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T22:58:27.873 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173984 files and directories currently installed.) 2024-04-24T22:58:27.878 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T22:58:27.897 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-24T22:58:27.925 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-24T22:58:27.955 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T22:58:27.999 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T22:58:28.208 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-24T22:58:28.236 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-24T22:58:28.274 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T22:58:28.570 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-24T22:58:28.598 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-24T22:58:28.620 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-24T22:58:28.628 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T22:58:28.880 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-24T22:58:28.897 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-24T22:58:28.955 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T22:58:29.225 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libjson-perl. 2024-04-24T22:58:29.252 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-24T22:58:29.291 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-24T22:58:29.535 INFO:teuthology.orchestra.run.smithi043.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-24T22:58:29.620 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-24T22:58:29.647 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-24T22:58:29.686 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T22:58:29.794 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package flex. 2024-04-24T22:58:29.901 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173984 files and directories currently installed.) 2024-04-24T22:58:29.906 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-24T22:58:29.951 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-24T22:58:30.476 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T22:58:30.649 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-24T22:58:31.068 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T22:58:31.330 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-24T22:58:31.358 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T22:58:31.397 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T22:58:31.597 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174057 files and directories currently installed.) 2024-04-24T22:58:31.603 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T22:58:31.666 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-24T22:58:31.694 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T22:58:31.705 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T22:58:31.733 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T22:58:32.082 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-24T22:58:32.102 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-24T22:58:32.130 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T22:58:32.169 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T22:58:32.212 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-24T22:58:32.472 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-24T22:58:32.499 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-24T22:58:32.530 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T22:58:32.665 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T22:58:32.824 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-24T22:58:32.853 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T22:58:32.891 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T22:58:33.021 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package bison. 2024-04-24T22:58:33.120 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174057 files and directories currently installed.) 2024-04-24T22:58:33.126 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-24T22:58:33.173 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T22:58:33.252 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-24T22:58:33.280 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T22:58:33.318 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T22:58:33.541 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-24T22:58:33.569 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-24T22:58:33.607 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T22:58:33.638 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-24T22:58:33.666 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T22:58:33.705 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T22:58:33.952 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package dump. 2024-04-24T22:58:33.980 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-24T22:58:33.990 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-24T22:58:34.007 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T22:58:34.019 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking dump (0.4b47-3) ... 2024-04-24T22:58:34.049 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T22:58:34.289 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package indent. 2024-04-24T22:58:34.301 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-24T22:58:34.317 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T22:58:34.329 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T22:58:34.356 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T22:58:34.368 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T22:58:34.633 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-24T22:58:34.650 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-24T22:58:34.692 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T22:58:34.872 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-24T22:58:34.899 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-24T22:58:34.938 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T22:58:35.029 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-24T22:58:35.057 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-24T22:58:35.096 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T22:58:35.315 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-24T22:58:35.324 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package modemmanager. 2024-04-24T22:58:35.334 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-24T22:58:35.352 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T22:58:35.373 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T22:58:35.391 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T22:58:35.702 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-24T22:58:35.730 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-24T22:58:35.768 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T22:58:36.006 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package network-manager. 2024-04-24T22:58:36.021 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-24T22:58:36.034 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T22:58:36.038 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-24T22:58:36.079 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T22:58:36.098 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-24T22:58:36.290 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libjson-perl. 2024-04-24T22:58:36.307 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-24T22:58:36.340 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-24T22:58:36.668 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-24T22:58:36.696 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-24T22:58:36.697 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ppp. 2024-04-24T22:58:36.725 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-24T22:58:36.735 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T22:58:36.999 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T22:58:37.309 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package pptp-linux. 2024-04-24T22:58:37.337 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-24T22:58:37.384 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-24T22:58:37.629 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-24T22:58:37.656 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-24T22:58:37.687 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-24T22:58:37.989 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-24T22:58:38.018 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-24T22:58:38.056 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-client-common (238) ... 2024-04-24T22:58:38.402 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-24T22:58:38.429 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T22:58:38.468 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T22:58:38.538 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-24T22:58:38.566 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T22:58:38.604 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T22:58:38.823 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-24T22:58:38.840 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-24T22:58:38.882 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T22:58:38.998 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-common. 2024-04-24T22:58:39.025 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-24T22:58:39.082 INFO:teuthology.orchestra.run.smithi162.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-24T22:58:39.112 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-common (238) ... 2024-04-24T22:58:39.218 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-24T22:58:39.247 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T22:58:39.284 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T22:58:39.563 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-14. 2024-04-24T22:58:39.591 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T22:58:39.629 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-24T22:58:39.633 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T22:58:39.657 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-24T22:58:39.696 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T22:58:40.015 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-24T22:58:40.044 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T22:58:40.090 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T22:58:40.443 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-24T22:58:40.471 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T22:58:40.510 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T22:58:40.790 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql. 2024-04-24T22:58:40.819 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-24T22:58:40.848 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql (14+238) ... 2024-04-24T22:58:40.864 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-24T22:58:40.891 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T22:58:40.929 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T22:58:41.083 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-client. 2024-04-24T22:58:41.111 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-24T22:58:41.150 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-client (14+238) ... 2024-04-24T22:58:41.282 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-24T22:58:41.310 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-24T22:58:41.351 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T22:58:41.578 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-24T22:58:41.595 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-24T22:58:41.636 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T22:58:41.644 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-24T22:58:41.663 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-24T22:58:41.702 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-24T22:58:42.022 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package tcl8.6. 2024-04-24T22:58:42.050 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-24T22:58:42.088 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T22:58:42.223 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-24T22:58:42.251 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-24T22:58:42.299 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T22:58:42.349 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package tcl. 2024-04-24T22:58:42.377 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-24T22:58:42.412 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-24T22:58:42.702 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package modemmanager. 2024-04-24T22:58:42.730 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-24T22:58:42.752 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package wpasupplicant. 2024-04-24T22:58:42.768 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T22:58:42.780 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-24T22:58:42.818 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T22:58:43.189 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-24T22:58:43.205 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-24T22:58:43.247 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-24T22:58:43.384 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package network-manager. 2024-04-24T22:58:43.411 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-24T22:58:43.458 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-24T22:58:43.575 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-24T22:58:43.604 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-24T22:58:43.651 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T22:58:43.921 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-client-common (238) ... 2024-04-24T22:58:44.107 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ppp. 2024-04-24T22:58:44.131 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-24T22:58:44.135 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-24T22:58:44.274 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T22:58:44.393 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T22:58:44.399 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T22:58:44.650 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T22:58:44.696 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package pptp-linux. 2024-04-24T22:58:44.724 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-24T22:58:44.762 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-24T22:58:44.768 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T22:58:44.869 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T22:58:45.140 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-24T22:58:45.157 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-24T22:58:45.190 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-24T22:58:45.381 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-24T22:58:45.535 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-24T22:58:45.563 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-24T22:58:45.618 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking postgresql-client-common (238) ... 2024-04-24T22:58:45.930 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-24T22:58:45.958 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T22:58:45.958 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T22:58:45.997 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T22:58:46.338 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T22:58:46.338 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T22:58:46.585 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package postgresql-common. 2024-04-24T22:58:46.613 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-24T22:58:46.671 INFO:teuthology.orchestra.run.smithi043.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-24T22:58:46.700 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking postgresql-common (238) ... 2024-04-24T22:58:46.845 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T22:58:47.004 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T22:58:47.138 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T22:58:47.167 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package postgresql-14. 2024-04-24T22:58:47.196 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-24T22:58:47.236 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T22:58:47.264 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-24T22:58:47.423 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T22:58:47.549 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T22:58:47.686 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T22:58:47.877 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T22:58:48.612 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package postgresql. 2024-04-24T22:58:48.630 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-24T22:58:48.670 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking postgresql (14+238) ... 2024-04-24T22:58:48.897 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package postgresql-client. 2024-04-24T22:58:48.914 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-24T22:58:48.947 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking postgresql-client (14+238) ... 2024-04-24T22:58:49.096 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T22:58:49.174 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-24T22:58:49.191 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-24T22:58:49.232 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-24T22:58:49.323 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up dump (0.4b47-3) ... 2024-04-24T22:58:49.418 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-24T22:58:49.485 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T22:58:49.551 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package tcl8.6. 2024-04-24T22:58:49.580 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-24T22:58:49.611 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T22:58:49.626 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T22:58:49.736 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-24T22:58:49.862 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-24T22:58:49.904 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package tcl. 2024-04-24T22:58:49.933 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-24T22:58:49.976 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-24T22:58:49.988 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T22:58:50.079 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-24T22:58:50.148 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T22:58:50.249 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T22:58:50.282 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package wpasupplicant. 2024-04-24T22:58:50.311 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-24T22:58:50.348 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T22:58:50.392 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T22:58:50.551 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T22:58:50.728 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-24T22:58:50.756 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-24T22:58:50.794 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-24T22:58:50.915 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-24T22:58:51.131 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-24T22:58:51.160 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-24T22:58:51.197 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T22:58:51.229 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-client (14+238) ... 2024-04-24T22:58:51.355 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-24T22:58:51.477 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up postgresql-client-common (238) ... 2024-04-24T22:58:51.728 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-24T22:58:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:58:51.827 INFO:teuthology.orchestra.run.smithi162.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-24T22:58:51.827 INFO:teuthology.orchestra.run.smithi162.stdout:which means they are currently configured by ifupdown: 2024-04-24T22:58:51.827 INFO:teuthology.orchestra.run.smithi162.stdout:- enp3s0f1 2024-04-24T22:58:51.827 INFO:teuthology.orchestra.run.smithi162.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-24T22:58:51.827 INFO:teuthology.orchestra.run.smithi162.stdout:remove their configuration from /etc/network/interfaces. 2024-04-24T22:58:51.827 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:58:51.854 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-24T22:58:51.947 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-24T22:58:51.980 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T22:58:52.264 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-24T22:58:52.548 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-24T22:58:52.593 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-24T22:58:52.674 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-24T22:58:52.809 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T22:58:53.090 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T22:58:53.217 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T22:58:53.351 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-24T22:58:53.414 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-24T22:58:53.497 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-24T22:58:53.502 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-common (238) ... 2024-04-24T22:58:53.893 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T22:58:53.893 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-24T22:58:54.358 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-24T22:58:54.400 INFO:teuthology.orchestra.run.smithi162.stdout:Adding user postgres to group ssl-cert 2024-04-24T22:58:54.485 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-24T22:58:54.636 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-24T22:58:54.668 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:58:54.669 INFO:teuthology.orchestra.run.smithi162.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-24T22:58:54.762 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-24T22:58:54.865 INFO:teuthology.orchestra.run.smithi162.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-24T22:58:54.865 INFO:teuthology.orchestra.run.smithi162.stdout:Removing obsolete dictionary files: 2024-04-24T22:58:54.871 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-24T22:58:54.972 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-24T22:58:55.073 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-24T22:58:55.199 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-24T22:58:55.450 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-24T22:58:55.846 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T22:58:55.996 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-24T22:58:56.122 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up dump (0.4b47-3) ... 2024-04-24T22:58:56.167 INFO:teuthology.orchestra.run.smithi162.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-24T22:58:56.186 INFO:teuthology.orchestra.run.smithi162.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-24T22:58:56.216 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-24T22:58:56.234 INFO:teuthology.orchestra.run.smithi162.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-24T22:58:56.234 INFO:teuthology.orchestra.run.smithi162.stdout:This user must also own the server process. 2024-04-24T22:58:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:58:56.234 INFO:teuthology.orchestra.run.smithi162.stdout:The database cluster will be initialized with locale "en_US". 2024-04-24T22:58:56.234 INFO:teuthology.orchestra.run.smithi162.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-24T22:58:56.234 INFO:teuthology.orchestra.run.smithi162.stdout:The default text search configuration will be set to "english". 2024-04-24T22:58:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:58:56.234 INFO:teuthology.orchestra.run.smithi162.stdout:Data page checksums are disabled. 2024-04-24T22:58:56.234 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:58:56.234 INFO:teuthology.orchestra.run.smithi162.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-24T22:58:56.234 INFO:teuthology.orchestra.run.smithi162.stdout:creating subdirectories ... ok 2024-04-24T22:58:56.235 INFO:teuthology.orchestra.run.smithi162.stdout:selecting dynamic shared memory implementation ... posix 2024-04-24T22:58:56.250 INFO:teuthology.orchestra.run.smithi162.stdout:selecting default max_connections ... 100 2024-04-24T22:58:56.270 INFO:teuthology.orchestra.run.smithi162.stdout:selecting default shared_buffers ... 128MB 2024-04-24T22:58:56.274 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T22:58:56.280 INFO:teuthology.orchestra.run.smithi162.stdout:selecting default time zone ... Etc/UTC 2024-04-24T22:58:56.281 INFO:teuthology.orchestra.run.smithi162.stdout:creating configuration files ... ok 2024-04-24T22:58:56.396 INFO:teuthology.orchestra.run.smithi162.stdout:running bootstrap script ... ok 2024-04-24T22:58:56.416 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-24T22:58:56.568 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-24T22:58:56.727 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-24T22:58:56.878 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-24T22:58:56.985 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-24T22:58:57.043 INFO:teuthology.orchestra.run.smithi162.stdout:performing post-bootstrap initialization ... ok 2024-04-24T22:58:57.054 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-24T22:58:57.180 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-24T22:58:57.357 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-24T22:58:57.715 INFO:teuthology.orchestra.run.smithi162.stdout:syncing data to disk ... ok 2024-04-24T22:58:57.858 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T22:58:57.984 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-24T22:58:58.082 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-24T22:58:58.186 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up postgresql-client (14+238) ... 2024-04-24T22:58:58.312 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-24T22:58:58.743 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:58:58.743 INFO:teuthology.orchestra.run.smithi043.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-24T22:58:58.743 INFO:teuthology.orchestra.run.smithi043.stdout:which means they are currently configured by ifupdown: 2024-04-24T22:58:58.744 INFO:teuthology.orchestra.run.smithi043.stdout:- ens1f0 2024-04-24T22:58:58.744 INFO:teuthology.orchestra.run.smithi043.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-24T22:58:58.744 INFO:teuthology.orchestra.run.smithi043.stdout:remove their configuration from /etc/network/interfaces. 2024-04-24T22:58:58.744 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:58:58.880 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-24T22:58:59.202 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-24T22:58:59.507 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-24T22:58:59.981 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-24T22:59:00.124 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-24T22:59:00.250 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-24T22:59:00.376 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up postgresql-common (238) ... 2024-04-24T22:59:00.810 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T22:59:00.910 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-24T22:59:01.028 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql (14+238) ... 2024-04-24T22:59:01.154 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T22:59:01.263 INFO:teuthology.orchestra.run.smithi043.stdout:Adding user postgres to group ssl-cert 2024-04-24T22:59:01.280 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T22:59:01.508 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:01.508 INFO:teuthology.orchestra.run.smithi043.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-24T22:59:01.534 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T22:59:01.534 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T22:59:01.718 INFO:teuthology.orchestra.run.smithi043.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-24T22:59:01.718 INFO:teuthology.orchestra.run.smithi043.stdout:Removing obsolete dictionary files: 2024-04-24T22:59:02.040 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T22:59:02.116 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-24T22:59:02.287 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-24T22:59:02.444 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T22:59:02.580 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T22:59:02.686 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-24T22:59:03.024 INFO:teuthology.orchestra.run.smithi043.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-24T22:59:03.045 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-24T22:59:03.096 INFO:teuthology.orchestra.run.smithi043.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-24T22:59:03.096 INFO:teuthology.orchestra.run.smithi043.stdout:This user must also own the server process. 2024-04-24T22:59:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:03.096 INFO:teuthology.orchestra.run.smithi043.stdout:The database cluster will be initialized with locale "en_US". 2024-04-24T22:59:03.096 INFO:teuthology.orchestra.run.smithi043.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-24T22:59:03.097 INFO:teuthology.orchestra.run.smithi043.stdout:The default text search configuration will be set to "english". 2024-04-24T22:59:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:03.097 INFO:teuthology.orchestra.run.smithi043.stdout:Data page checksums are disabled. 2024-04-24T22:59:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:03.097 INFO:teuthology.orchestra.run.smithi043.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-24T22:59:03.097 INFO:teuthology.orchestra.run.smithi043.stdout:creating subdirectories ... ok 2024-04-24T22:59:03.097 INFO:teuthology.orchestra.run.smithi043.stdout:selecting dynamic shared memory implementation ... posix 2024-04-24T22:59:03.112 INFO:teuthology.orchestra.run.smithi043.stdout:selecting default max_connections ... 100 2024-04-24T22:59:03.134 INFO:teuthology.orchestra.run.smithi043.stdout:selecting default shared_buffers ... 128MB 2024-04-24T22:59:03.145 INFO:teuthology.orchestra.run.smithi043.stdout:selecting default time zone ... Etc/UTC 2024-04-24T22:59:03.146 INFO:teuthology.orchestra.run.smithi043.stdout:creating configuration files ... ok 2024-04-24T22:59:03.266 INFO:teuthology.orchestra.run.smithi043.stdout:running bootstrap script ... ok 2024-04-24T22:59:03.589 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-24T22:59:03.698 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T22:59:03.986 INFO:teuthology.orchestra.run.smithi043.stdout:performing post-bootstrap initialization ... ok 2024-04-24T22:59:04.139 INFO:teuthology.orchestra.run.smithi162.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T22:59:04.145 DEBUG:teuthology.parallel:result is None 2024-04-24T22:59:04.622 INFO:teuthology.orchestra.run.smithi043.stdout:syncing data to disk ... ok 2024-04-24T22:59:05.005 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-24T22:59:07.767 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T22:59:07.893 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-24T22:59:08.019 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up postgresql (14+238) ... 2024-04-24T22:59:08.129 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-24T22:59:08.230 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-24T22:59:08.477 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T22:59:08.477 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-24T22:59:09.065 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T22:59:09.158 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-24T22:59:09.468 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T22:59:09.620 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T22:59:11.018 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-24T22:59:11.107 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T22:59:11.614 INFO:teuthology.orchestra.run.smithi043.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T22:59:11.620 DEBUG:teuthology.parallel:result is None 2024-04-24T22:59:11.621 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T22:59:11.777 DEBUG:teuthology.orchestra.run.smithi043:> dpkg-query -W -f '${Version}' ceph 2024-04-24T22:59:11.798 INFO:teuthology.orchestra.run.smithi043.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-24T22:59:11.799 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-24T22:59:11.799 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-24T22:59:11.801 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T22:59:12.019 DEBUG:teuthology.orchestra.run.smithi162:> dpkg-query -W -f '${Version}' ceph 2024-04-24T22:59:12.039 INFO:teuthology.orchestra.run.smithi162.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-24T22:59:12.040 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-24T22:59:12.040 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-24T22:59:12.042 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-24T22:59:12.042 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:12.042 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T22:59:12.057 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:12.057 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T22:59:12.094 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-24T22:59:12.094 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:12.095 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T22:59:12.111 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T22:59:12.167 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:12.167 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T22:59:12.180 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T22:59:12.233 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-24T22:59:12.233 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:12.233 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T22:59:12.247 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T22:59:12.303 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:12.303 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T22:59:12.316 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T22:59:12.372 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-24T22:59:12.372 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:12.372 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T22:59:12.386 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T22:59:12.446 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:12.447 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T22:59:12.460 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T22:59:12.517 INFO:teuthology.run_tasks:Running task ceph... 2024-04-24T22:59:12.606 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-24T22:59:12.606 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /var/log/ceph 2024-04-24T22:59:12.609 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /var/log/ceph 2024-04-24T22:59:12.621 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-24T22:59:12.621 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T22:59:12.665 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T22:59:12.677 INFO:tasks.ceph:Creating extra log directories... 2024-04-24T22:59:12.678 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T22:59:12.720 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T22:59:12.739 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-24T22:59:12.740 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-24T22:59:12.740 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-24T22:59:12.740 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:12.740 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-24T22:59:12.779 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-24T22:59:12.856 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:12.856 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-24T22:59:12.862 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-24T22:59:12.943 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-24T22:59:12.944 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-24T22:59:12.944 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672162', 'branch': 'squid', 'description': 'fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_blogbench traceless/50pc}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7672162', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 8528, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '122/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi043.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHFT6u11gSFQRdk5urlkReFURvi4pwMHs1ad51Li94iDbIdEvBvrfhpM40YrhaeGbid9MsiTVKlOuKQoILFmmps=', 'smithi162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG9Wv2GoXPqO4HErfCIy9w7FrNofWkF1vGw7kZeRePbjeK/MqQKzT26bu54jZR5yuVtyQU294vXu1G1n7o79BFU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'check-counter': {'counters': {'mds': ['mds.dir_split']}}}, {'workunit': {'clients': {'all': ['suites/blogbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-24_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-24T22:59:12.944 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T22:59:12.947 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T22:59:12.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T22:59:12.996 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T22:59:13.041 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:13.041 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T22:59:13.058 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T22:59:13.058 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 2024-04-24T22:59:13.107 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T22:59:13.107 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:59:13.107 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 871 Links: 1 2024-04-24T22:59:13.107 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:59:13.107 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-24 22:53:05.318014015 +0000 2024-04-24T22:59:13.108 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-24 22:53:05.050016400 +0000 2024-04-24T22:59:13.108 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-24 22:53:05.050016400 +0000 2024-04-24T22:59:13.108 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2024-04-24T22:59:13.108 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T22:59:13.161 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-24T22:59:13.162 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-24T22:59:13.162 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000302727 s, 1.7 MB/s 2024-04-24T22:59:13.163 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T22:59:13.212 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 2024-04-24T22:59:13.259 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T22:59:13.259 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:59:13.259 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-04-24T22:59:13.259 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:59:13.259 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-24 22:53:05.806009672 +0000 2024-04-24T22:59:13.259 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-24 22:53:05.534012093 +0000 2024-04-24T22:59:13.259 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-24 22:53:05.534012093 +0000 2024-04-24T22:59:13.259 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2024-04-24T22:59:13.260 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T22:59:13.314 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-24T22:59:13.314 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-24T22:59:13.314 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000300241 s, 1.7 MB/s 2024-04-24T22:59:13.315 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T22:59:13.364 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 2024-04-24T22:59:13.411 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T22:59:13.411 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:59:13.411 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-04-24T22:59:13.411 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:59:13.412 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-24 22:53:06.286005400 +0000 2024-04-24T22:59:13.412 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-24 22:53:06.042007571 +0000 2024-04-24T22:59:13.412 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-24 22:53:06.042007571 +0000 2024-04-24T22:59:13.412 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2024-04-24T22:59:13.412 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T22:59:13.465 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-24T22:59:13.465 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-24T22:59:13.465 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.00019038 s, 2.7 MB/s 2024-04-24T22:59:13.466 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T22:59:13.516 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 2024-04-24T22:59:13.564 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T22:59:13.564 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:59:13.564 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-04-24T22:59:13.564 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:59:13.565 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-24 22:53:06.782000985 +0000 2024-04-24T22:59:13.565 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-24 22:53:06.514003371 +0000 2024-04-24T22:59:13.565 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-24 22:53:06.514003371 +0000 2024-04-24T22:59:13.565 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2024-04-24T22:59:13.565 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T22:59:13.618 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-24T22:59:13.618 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-24T22:59:13.618 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000249866 s, 2.0 MB/s 2024-04-24T22:59:13.619 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T22:59:13.669 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T22:59:13.669 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:13.669 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T22:59:13.676 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T22:59:13.676 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-04-24T22:59:13.723 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T22:59:13.723 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:59:13.723 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-04-24T22:59:13.724 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:59:13.724 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-04-24 22:53:01.302412886 +0000 2024-04-24T22:59:13.724 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-04-24 22:53:01.058415066 +0000 2024-04-24T22:59:13.724 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-04-24 22:53:01.058415066 +0000 2024-04-24T22:59:13.724 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-04-24T22:59:13.724 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T22:59:13.776 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-04-24T22:59:13.776 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-04-24T22:59:13.777 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000399571 s, 1.3 MB/s 2024-04-24T22:59:13.777 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T22:59:13.827 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-04-24T22:59:13.874 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T22:59:13.874 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:59:13.874 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-04-24T22:59:13.874 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:59:13.874 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-04-24 22:53:01.810408348 +0000 2024-04-24T22:59:13.874 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-04-24 22:53:01.518410957 +0000 2024-04-24T22:59:13.874 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-04-24 22:53:01.518410957 +0000 2024-04-24T22:59:13.874 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-04-24T22:59:13.875 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T22:59:13.927 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-04-24T22:59:13.928 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-04-24T22:59:13.928 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000409133 s, 1.3 MB/s 2024-04-24T22:59:13.929 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T22:59:13.979 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-04-24T22:59:14.025 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T22:59:14.025 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:59:14.025 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-04-24T22:59:14.025 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:59:14.025 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-04-24 22:53:02.314403847 +0000 2024-04-24T22:59:14.025 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-04-24 22:53:02.034406347 +0000 2024-04-24T22:59:14.025 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-04-24 22:53:02.034406347 +0000 2024-04-24T22:59:14.026 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-04-24T22:59:14.026 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T22:59:14.080 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-04-24T22:59:14.080 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-04-24T22:59:14.080 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000445436 s, 1.1 MB/s 2024-04-24T22:59:14.081 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T22:59:14.131 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-04-24T22:59:14.177 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T22:59:14.177 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T22:59:14.178 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-04-24T22:59:14.178 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T22:59:14.178 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-04-24 22:53:02.542401810 +0000 2024-04-24T22:59:14.178 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-04-24 22:53:02.538401846 +0000 2024-04-24T22:59:14.178 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-04-24 22:53:02.538401846 +0000 2024-04-24T22:59:14.178 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-04-24T22:59:14.178 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T22:59:14.231 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-04-24T22:59:14.232 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-04-24T22:59:14.232 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000369688 s, 1.4 MB/s 2024-04-24T22:59:14.233 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T22:59:14.282 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T22:59:14.282 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-24T22:59:14.282 INFO:tasks.ceph:Generating config... 2024-04-24T22:59:14.283 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-24T22:59:14.284 INFO:tasks.ceph:[client] debug client = 20 2024-04-24T22:59:14.284 INFO:tasks.ceph:[client] debug ms = 1 2024-04-24T22:59:14.284 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-24T22:59:14.284 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-24T22:59:14.284 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-24T22:59:14.284 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-24T22:59:14.284 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-24T22:59:14.284 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-24T22:59:14.284 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-24T22:59:14.284 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-24T22:59:14.284 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-24T22:59:14.284 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-24T22:59:14.285 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-24T22:59:14.285 INFO:tasks.ceph:[mds] mds inject traceless reply probability = 0.5 2024-04-24T22:59:14.285 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-24T22:59:14.285 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-24T22:59:14.285 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-24T22:59:14.285 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-24T22:59:14.285 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-24T22:59:14.285 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-24T22:59:14.285 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-24T22:59:14.285 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-24T22:59:14.285 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-24T22:59:14.285 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-24T22:59:14.285 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-24T22:59:14.285 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-24T22:59:14.285 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-24T22:59:14.286 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-24T22:59:14.286 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-24T22:59:14.286 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-24T22:59:14.286 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-24T22:59:14.286 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-24T22:59:14.286 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-24T22:59:14.286 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-24T22:59:14.286 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-24T22:59:14.286 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-24T22:59:14.286 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-24T22:59:14.286 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-24T22:59:14.286 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-24T22:59:14.286 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-24T22:59:14.286 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-24T22:59:14.289 INFO:tasks.ceph:Setting up mon.a... 2024-04-24T22:59:14.290 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-24T22:59:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.keyring 2024-04-24T22:59:14.343 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-24T22:59:14.423 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T22:59:14.479 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.43'), ('mon.b', '172.21.15.162'), ('mon.c', '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]')] 2024-04-24T22:59:14.479 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.43,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-24T22:59:14.480 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:14.480 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T22:59:14.527 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.43 --add b 172.21.15.162 --addv c '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:14.616 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:14.616 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: generated fsid 97891efb-e5ff-41f6-b724-29d534e60717 2024-04-24T22:59:14.616 INFO:teuthology.orchestra.run.smithi043.stdout:setting min_mon_release = quincy 2024-04-24T22:59:14.616 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 0 2024-04-24T22:59:14.617 INFO:teuthology.orchestra.run.smithi043.stdout:fsid 97891efb-e5ff-41f6-b724-29d534e60717 2024-04-24T22:59:14.617 INFO:teuthology.orchestra.run.smithi043.stdout:last_changed 2024-04-24T22:59:14.616829+0000 2024-04-24T22:59:14.617 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-04-24T22:59:14.616829+0000 2024-04-24T22:59:14.617 INFO:teuthology.orchestra.run.smithi043.stdout:min_mon_release 17 (quincy) 2024-04-24T22:59:14.617 INFO:teuthology.orchestra.run.smithi043.stdout:election_strategy: 1 2024-04-24T22:59:14.617 INFO:teuthology.orchestra.run.smithi043.stdout:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-24T22:59:14.617 INFO:teuthology.orchestra.run.smithi043.stdout:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-04-24T22:59:14.617 INFO:teuthology.orchestra.run.smithi043.stdout:2: [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] mon.c 2024-04-24T22:59:14.617 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-24T22:59:14.618 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T22:59:14.623 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 97891efb-e5ff-41f6-b724-29d534e60717... 2024-04-24T22:59:14.624 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T22:59:14.668 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T22:59:14.694 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-04-24T22:59:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2024-04-24T22:59:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T22:59:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2024-04-24T22:59:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2024-04-24T22:59:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2024-04-24T22:59:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2024-04-24T22:59:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2024-04-24T22:59:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2024-04-24T22:59:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2024-04-24T22:59:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T22:59:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2024-04-24T22:59:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T22:59:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T22:59:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2024-04-24T22:59:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2024-04-24T22:59:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2024-04-24T22:59:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2024-04-24T22:59:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2024-04-24T22:59:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2024-04-24T22:59:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2024-04-24T22:59:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2024-04-24T22:59:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T22:59:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T22:59:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2024-04-24T22:59:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T22:59:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2024-04-24T22:59:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2024-04-24T22:59:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2024-04-24T22:59:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2024-04-24T22:59:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2024-04-24T22:59:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = "172.21.15.43,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2024-04-24T22:59:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = 97891efb-e5ff-41f6-b724-29d534e60717 2024-04-24T22:59:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.698 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2024-04-24T22:59:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2024-04-24T22:59:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2024-04-24T22:59:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2024-04-24T22:59:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2024-04-24T22:59:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2024-04-24T22:59:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2024-04-24T22:59:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2024-04-24T22:59:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2024-04-24T22:59:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2024-04-24T22:59:14.700 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug trim objects = true 2024-04-24T22:59:14.700 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.700 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2024-04-24T22:59:14.700 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2024-04-24T22:59:14.700 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.702 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2024-04-24T22:59:14.702 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.702 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2024-04-24T22:59:14.702 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.702 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2024-04-24T22:59:14.702 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.702 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2024-04-24T22:59:14.702 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2024-04-24T22:59:14.703 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.703 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2024-04-24T22:59:14.703 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2024-04-24T22:59:14.703 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2024-04-24T22:59:14.703 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore compression mode = aggressive 2024-04-24T22:59:14.703 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2024-04-24T22:59:14.703 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 20 2024-04-24T22:59:14.703 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 20 2024-04-24T22:59:14.703 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-24T22:59:14.704 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2024-04-24T22:59:14.704 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 10 2024-04-24T22:59:14.704 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T22:59:14.704 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2024-04-24T22:59:14.704 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2024-04-24T22:59:14.705 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2024-04-24T22:59:14.705 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2024-04-24T22:59:14.705 INFO:teuthology.orchestra.run.smithi043.stdout: osd op complaint time = 180 2024-04-24T22:59:14.705 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.705 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2024-04-24T22:59:14.705 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-24T22:59:14.705 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2024-04-24T22:59:14.705 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-04-24T22:59:14.705 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-04-24T22:59:14.705 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-04-24T22:59:14.705 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-04-24T22:59:14.705 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2024-04-24T22:59:14.705 INFO:teuthology.orchestra.run.smithi043.stdout: debug client = 20 2024-04-24T22:59:14.705 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.705 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2024-04-24T22:59:14.706 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-24T22:59:14.706 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-04-24T22:59:14.706 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2024-04-24T22:59:14.706 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-04-24T22:59:14.706 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2024-04-24T22:59:14.706 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2024-04-24T22:59:14.706 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-04-24T22:59:14.706 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2024-04-24T22:59:14.706 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2024-04-24T22:59:14.706 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-04-24T22:59:14.706 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.706 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T22:59:14.706 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T22:59:14.706 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T22:59:14.707 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.707 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T22:59:14.707 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T22:59:14.707 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T22:59:14.707 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.707 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2024-04-24T22:59:14.707 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2024-04-24T22:59:14.707 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.707 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2024-04-24T22:59:14.707 INFO:teuthology.orchestra.run.smithi043.stdout: mon down mkfs grace = 300 2024-04-24T22:59:14.707 INFO:teuthology.orchestra.run.smithi043.stdout: mon op complaint time = 120 2024-04-24T22:59:14.707 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:14.707 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2024-04-24T22:59:14.707 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout: client mount timeout = 600 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout: debug client = 20 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout: rados mon op timeout = 900 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout: rados osd op timeout = 900 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.b] 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.c] 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout:[mds] 2024-04-24T22:59:14.708 INFO:teuthology.orchestra.run.smithi043.stdout: debug mds = 20 2024-04-24T22:59:14.709 INFO:teuthology.orchestra.run.smithi043.stdout: debug mds balancer = 20 2024-04-24T22:59:14.709 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-24T22:59:14.709 INFO:teuthology.orchestra.run.smithi043.stdout: mds bal fragment size max = 10000 2024-04-24T22:59:14.709 INFO:teuthology.orchestra.run.smithi043.stdout: mds bal merge size = 5 2024-04-24T22:59:14.709 INFO:teuthology.orchestra.run.smithi043.stdout: mds bal split bits = 3 2024-04-24T22:59:14.709 INFO:teuthology.orchestra.run.smithi043.stdout: mds bal split size = 100 2024-04-24T22:59:14.709 INFO:teuthology.orchestra.run.smithi043.stdout: mds debug frag = True 2024-04-24T22:59:14.709 INFO:teuthology.orchestra.run.smithi043.stdout: mds debug scatterstat = True 2024-04-24T22:59:14.710 INFO:teuthology.orchestra.run.smithi043.stdout: mds inject traceless reply probability = 0.5 2024-04-24T22:59:14.710 INFO:teuthology.orchestra.run.smithi043.stdout: mds op complaint time = 180 2024-04-24T22:59:14.710 INFO:teuthology.orchestra.run.smithi043.stdout: mds verify scatter = True 2024-04-24T22:59:14.710 INFO:teuthology.orchestra.run.smithi043.stdout: osd op complaint time = 180 2024-04-24T22:59:14.710 INFO:teuthology.orchestra.run.smithi043.stdout: rados mon op timeout = 900 2024-04-24T22:59:14.710 INFO:teuthology.orchestra.run.smithi043.stdout: rados osd op timeout = 900 2024-04-24T22:59:14.712 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2024-04-24T22:59:14.712 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2024-04-24T22:59:14.712 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T22:59:14.712 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2024-04-24T22:59:14.712 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.712 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2024-04-24T22:59:14.712 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.712 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2024-04-24T22:59:14.712 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.712 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2024-04-24T22:59:14.712 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2024-04-24T22:59:14.712 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.713 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2024-04-24T22:59:14.713 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2024-04-24T22:59:14.713 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.713 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T22:59:14.713 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2024-04-24T22:59:14.713 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.713 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T22:59:14.713 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T22:59:14.713 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.713 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2024-04-24T22:59:14.713 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.713 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2024-04-24T22:59:14.714 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2024-04-24T22:59:14.714 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2024-04-24T22:59:14.714 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2024-04-24T22:59:14.714 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2024-04-24T22:59:14.714 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2024-04-24T22:59:14.714 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2024-04-24T22:59:14.714 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T22:59:14.714 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T22:59:14.714 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2024-04-24T22:59:14.714 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.714 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T22:59:14.714 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.715 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2024-04-24T22:59:14.715 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.715 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2024-04-24T22:59:14.715 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.715 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2024-04-24T22:59:14.715 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2024-04-24T22:59:14.716 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2024-04-24T22:59:14.716 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.43,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2024-04-24T22:59:14.716 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = 97891efb-e5ff-41f6-b724-29d534e60717 2024-04-24T22:59:14.716 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.716 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2024-04-24T22:59:14.716 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2024-04-24T22:59:14.716 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.716 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2024-04-24T22:59:14.716 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2024-04-24T22:59:14.716 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2024-04-24T22:59:14.716 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.716 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2024-04-24T22:59:14.717 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2024-04-24T22:59:14.717 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.717 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2024-04-24T22:59:14.717 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2024-04-24T22:59:14.717 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2024-04-24T22:59:14.717 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug trim objects = true 2024-04-24T22:59:14.717 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.717 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2024-04-24T22:59:14.717 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2024-04-24T22:59:14.717 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.717 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2024-04-24T22:59:14.718 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.718 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2024-04-24T22:59:14.718 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.718 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2024-04-24T22:59:14.718 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.718 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2024-04-24T22:59:14.718 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2024-04-24T22:59:14.718 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.718 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2024-04-24T22:59:14.718 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2024-04-24T22:59:14.718 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2024-04-24T22:59:14.718 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore compression mode = aggressive 2024-04-24T22:59:14.719 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2024-04-24T22:59:14.719 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 20 2024-04-24T22:59:14.719 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 20 2024-04-24T22:59:14.719 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-04-24T22:59:14.719 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2024-04-24T22:59:14.719 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 10 2024-04-24T22:59:14.719 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T22:59:14.719 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2024-04-24T22:59:14.719 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2024-04-24T22:59:14.719 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2024-04-24T22:59:14.719 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2024-04-24T22:59:14.719 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-04-24T22:59:14.720 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.720 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2024-04-24T22:59:14.720 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-04-24T22:59:14.720 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2024-04-24T22:59:14.720 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-04-24T22:59:14.720 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-04-24T22:59:14.720 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-04-24T22:59:14.720 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-04-24T22:59:14.720 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2024-04-24T22:59:14.720 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-04-24T22:59:14.720 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.720 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2024-04-24T22:59:14.720 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-04-24T22:59:14.720 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T22:59:14.721 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T22:59:14.722 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.722 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2024-04-24T22:59:14.722 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2024-04-24T22:59:14.722 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.722 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2024-04-24T22:59:14.722 INFO:teuthology.orchestra.run.smithi162.stdout: mon down mkfs grace = 300 2024-04-24T22:59:14.722 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2024-04-24T22:59:14.722 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-24T22:59:14.722 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2024-04-24T22:59:14.722 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2024-04-24T22:59:14.722 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2024-04-24T22:59:14.722 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2024-04-24T22:59:14.722 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T22:59:14.722 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T22:59:14.723 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2024-04-24T22:59:14.723 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-04-24T22:59:14.723 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-04-24T22:59:14.723 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-04-24T22:59:14.723 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-04-24T22:59:14.723 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2024-04-24T22:59:14.723 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2024-04-24T22:59:14.723 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2024-04-24T22:59:14.723 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-04-24T22:59:14.723 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-04-24T22:59:14.723 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2024-04-24T22:59:14.724 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2024-04-24T22:59:14.724 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2024-04-24T22:59:14.724 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-04-24T22:59:14.724 INFO:teuthology.orchestra.run.smithi162.stdout: mds bal fragment size max = 10000 2024-04-24T22:59:14.724 INFO:teuthology.orchestra.run.smithi162.stdout: mds bal merge size = 5 2024-04-24T22:59:14.724 INFO:teuthology.orchestra.run.smithi162.stdout: mds bal split bits = 3 2024-04-24T22:59:14.725 INFO:teuthology.orchestra.run.smithi162.stdout: mds bal split size = 100 2024-04-24T22:59:14.725 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2024-04-24T22:59:14.725 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2024-04-24T22:59:14.725 INFO:teuthology.orchestra.run.smithi162.stdout: mds inject traceless reply probability = 0.5 2024-04-24T22:59:14.725 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2024-04-24T22:59:14.725 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2024-04-24T22:59:14.726 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-04-24T22:59:14.726 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-04-24T22:59:14.726 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-04-24T22:59:14.726 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-24T22:59:14.727 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-24T22:59:14.804 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-24T22:59:14.805 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:14.805 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-24T22:59:14.810 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:14.810 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-24T22:59:14.859 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi043.front.sepia.ceph.com 2024-04-24T22:59:14.860 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:14.860 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T22:59:14.860 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T22:59:14.924 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:14.924 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:14.971 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi162.front.sepia.ceph.com 2024-04-24T22:59:14.971 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:14.971 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T22:59:14.971 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T22:59:14.994 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:14.994 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:15.045 INFO:tasks.ceph:Setting up mon nodes... 2024-04-24T22:59:15.046 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-24T22:59:15.046 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-24T22:59:15.093 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-24T22:59:15.097 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T22:59:15.139 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T22:59:15.151 INFO:tasks.ceph:Setting up mds nodes... 2024-04-24T22:59:15.152 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-24T22:59:15.196 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-24T22:59:15.199 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-24T22:59:15.255 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-24T22:59:15.299 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-24T22:59:15.302 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-24T22:59:15.358 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-24T22:59:15.358 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-24T22:59:15.396 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-24T22:59:15.407 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-24T22:59:15.407 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-24T22:59:15.407 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-24T22:59:15.462 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T22:59:15.462 INFO:tasks.ceph:role: osd.0 2024-04-24T22:59:15.462 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-24T22:59:15.462 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T22:59:15.519 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:59:15.519 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:59:15.519 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:59:15.519 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T22:59:15.520 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:59:15.520 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:59:15.520 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:59:15.520 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T22:59:15.520 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:59:15.520 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:59:15.543 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-04-24T22:59:15.545 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-04-24T22:59:15.545 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-24T22:59:15.600 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-24T22:59:15.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T22:59:15.652 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T22:59:15.652 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-24T22:59:15.705 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T22:59:15.705 INFO:tasks.ceph:role: osd.1 2024-04-24T22:59:15.705 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-24T22:59:15.705 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T22:59:15.758 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:59:15.758 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:59:15.758 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:59:15.758 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T22:59:15.758 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:59:15.758 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:59:15.759 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:59:15.759 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T22:59:15.759 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:59:15.759 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:59:15.782 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-04-24T22:59:15.784 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-04-24T22:59:15.784 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-24T22:59:15.842 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-24T22:59:15.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T22:59:15.893 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T22:59:15.894 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-24T22:59:15.946 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T22:59:15.947 INFO:tasks.ceph:role: osd.2 2024-04-24T22:59:15.947 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-24T22:59:15.947 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-24T22:59:16.002 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:59:16.002 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:59:16.002 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:59:16.002 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T22:59:16.002 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:59:16.002 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:59:16.002 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:59:16.002 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T22:59:16.002 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:59:16.003 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:59:16.025 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-04-24T22:59:16.027 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-04-24T22:59:16.027 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-24T22:59:16.089 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-24T22:59:16.139 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T22:59:16.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T22:59:16.140 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-24T22:59:16.194 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T22:59:16.194 INFO:tasks.ceph:role: osd.3 2024-04-24T22:59:16.194 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-24T22:59:16.194 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-24T22:59:16.250 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:59:16.250 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:59:16.250 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:59:16.250 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T22:59:16.251 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:59:16.251 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:59:16.251 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:59:16.251 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T22:59:16.251 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:59:16.251 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:59:16.274 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-04-24T22:59:16.275 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-04-24T22:59:16.276 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-24T22:59:16.338 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-24T22:59:16.391 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T22:59:16.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T22:59:16.392 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:16.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:16.497+0000 7f8abe0187c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-24T22:59:16.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:16.497+0000 7f8abe0187c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-24T22:59:16.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:16.497+0000 7f8abe0187c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T22:59:16.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:16.497+0000 7f8abe0187c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T22:59:16.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:16.497+0000 7f8abe0187c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T22:59:16.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:16.497+0000 7f8abe0187c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-24T22:59:19.475 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-24T22:59:19.489 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:19.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:19.565+0000 7fcc42bf67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-24T22:59:19.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:19.565+0000 7fcc42bf67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-24T22:59:19.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:19.565+0000 7fcc42bf67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T22:59:19.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:19.565+0000 7fcc42bf67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T22:59:19.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:19.565+0000 7fcc42bf67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T22:59:19.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:19.569+0000 7fcc42bf67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-24T22:59:22.545 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-24T22:59:22.600 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:22.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:22.681+0000 7f77927aa7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-24T22:59:22.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:22.681+0000 7f77927aa7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-24T22:59:22.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:22.681+0000 7f77927aa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T22:59:22.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:22.681+0000 7f77927aa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T22:59:22.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:22.681+0000 7f77927aa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T22:59:22.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:22.681+0000 7f77927aa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-24T22:59:25.647 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-24T22:59:25.704 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:25.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:25.785+0000 7f3b4dc5c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-24T22:59:25.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:25.785+0000 7f3b4dc5c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-24T22:59:25.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:25.785+0000 7f3b4dc5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T22:59:25.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:25.785+0000 7f3b4dc5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T22:59:25.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:25.785+0000 7f3b4dc5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T22:59:25.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:25.785+0000 7f3b4dc5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-24T22:59:28.776 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-24T22:59:28.831 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-24T22:59:28.846 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T22:59:28.846 INFO:tasks.ceph:role: osd.4 2024-04-24T22:59:28.846 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-24T22:59:28.846 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T22:59:28.909 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:59:28.909 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:59:28.909 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:59:28.909 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T22:59:28.910 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:59:28.910 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:59:28.910 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:59:28.910 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T22:59:28.910 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:59:28.910 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:59:29.378 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-04-24T22:59:29.380 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-04-24T22:59:29.380 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-24T22:59:29.532 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-24T22:59:29.543 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T22:59:29.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T22:59:29.544 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-24T22:59:29.600 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T22:59:29.601 INFO:tasks.ceph:role: osd.5 2024-04-24T22:59:29.601 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-24T22:59:29.601 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T22:59:29.665 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:59:29.666 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:59:29.666 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:59:29.666 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T22:59:29.666 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:59:29.666 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:59:29.666 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:59:29.666 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T22:59:29.666 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:59:29.666 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:59:30.097 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-04-24T22:59:30.099 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-04-24T22:59:30.099 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-24T22:59:30.162 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-24T22:59:30.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T22:59:30.214 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T22:59:30.215 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-24T22:59:30.268 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T22:59:30.268 INFO:tasks.ceph:role: osd.6 2024-04-24T22:59:30.268 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-24T22:59:30.268 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-24T22:59:30.329 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:59:30.329 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:59:30.329 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:59:30.329 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T22:59:30.329 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:59:30.330 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:59:30.330 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:59:30.330 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T22:59:30.330 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:59:30.330 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:59:30.786 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-04-24T22:59:30.788 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-04-24T22:59:30.788 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-24T22:59:30.878 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-24T22:59:30.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T22:59:30.891 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T22:59:30.891 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-24T22:59:30.944 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T22:59:30.944 INFO:tasks.ceph:role: osd.7 2024-04-24T22:59:30.944 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-24T22:59:30.944 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-24T22:59:31.009 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T22:59:31.009 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T22:59:31.009 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T22:59:31.009 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T22:59:31.009 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T22:59:31.009 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-04-24T22:59:31.009 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T22:59:31.009 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T22:59:31.009 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T22:59:31.009 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T22:59:31.474 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-04-24T22:59:31.476 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-04-24T22:59:31.476 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-24T22:59:31.600 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-24T22:59:31.611 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T22:59:31.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T22:59:31.612 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:31.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:31.715+0000 7f062521c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-24T22:59:31.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:31.719+0000 7f062521c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-24T22:59:31.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:31.719+0000 7f062521c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T22:59:31.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:31.719+0000 7f062521c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T22:59:31.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:31.719+0000 7f062521c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T22:59:31.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:31.727+0000 7f062521c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-24T22:59:34.714 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-24T22:59:34.728 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:34.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:34.807+0000 7f723e2d87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-24T22:59:34.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:34.807+0000 7f723e2d87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-24T22:59:34.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:34.807+0000 7f723e2d87c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T22:59:34.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:34.807+0000 7f723e2d87c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T22:59:34.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:34.807+0000 7f723e2d87c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T22:59:34.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:34.807+0000 7f723e2d87c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-24T22:59:37.788 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-24T22:59:37.845 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:37.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:37.923+0000 7fd303a217c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-24T22:59:37.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:37.923+0000 7fd303a217c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-24T22:59:37.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:37.923+0000 7fd303a217c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T22:59:37.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:37.923+0000 7fd303a217c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T22:59:37.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:37.923+0000 7fd303a217c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T22:59:37.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:37.923+0000 7fd303a217c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-24T22:59:40.900 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-24T22:59:40.962 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:41.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:41.039+0000 7f6df0b707c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-24T22:59:41.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:41.039+0000 7f6df0b707c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-24T22:59:41.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:41.039+0000 7f6df0b707c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T22:59:41.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:41.039+0000 7f6df0b707c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T22:59:41.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:41.039+0000 7f6df0b707c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T22:59:41.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:41.039+0000 7f6df0b707c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-24T22:59:42.946 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T22:59:42.949 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T22:59:44.016 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-24T22:59:44.030 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-24T22:59:44.030 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:44.030 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-24T22:59:44.044 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:44.044 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-24T22:59:44.099 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:44.099 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-24T22:59:44.155 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:44.155 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-24T22:59:44.210 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:44.210 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-24T22:59:44.267 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:44.267 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-24T22:59:44.323 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:44.323 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-24T22:59:44.336 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:44.336 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-24T22:59:44.387 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:44.388 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-24T22:59:44.444 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:44.444 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-24T22:59:44.499 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:44.499 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-24T22:59:44.553 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:44.553 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-24T22:59:44.613 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:44.613 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-24T22:59:44.619 INFO:tasks.ceph:Adding keys to all mons... 2024-04-24T22:59:44.619 DEBUG:teuthology.orchestra.run.smithi043:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T22:59:44.664 DEBUG:teuthology.orchestra.run.smithi162:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T22:59:44.673 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.y] 2024-04-24T22:59:44.673 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDDjilmXZGcBRAAewFdzeVdq9R9Knf1d9Vmmg== 2024-04-24T22:59:44.673 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-04-24T22:59:44.673 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDDjilmiHC1CxAAfeUpQ4yoyEhtR0aHJBA82g== 2024-04-24T22:59:44.673 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.0] 2024-04-24T22:59:44.673 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDEjilm/JztHRAA3whxpJYd1FS23u2RHKtcGA== 2024-04-24T22:59:44.673 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.1] 2024-04-24T22:59:44.673 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDHjilm59YCIhAAVLLuNxa4WzWy7ggUqKELyg== 2024-04-24T22:59:44.674 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.2] 2024-04-24T22:59:44.674 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDKjilmRlXPKBAAOc9eg5opDtPO2d/7RDX3jg== 2024-04-24T22:59:44.674 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.3] 2024-04-24T22:59:44.674 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDNjilmO7zpLhAAbn2CN216TLDWH9LJ6B76ow== 2024-04-24T22:59:44.674 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.x] 2024-04-24T22:59:44.674 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDDjilm8N5iCBAAyam2FbvEifaO+KtJe4+NwA== 2024-04-24T22:59:44.674 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2024-04-24T22:59:44.674 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDDjilmgizrERAADtPpAlIm4gkABsgt84rpHA== 2024-04-24T22:59:44.674 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.4] 2024-04-24T22:59:44.674 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDTjilmHRfdKhAA0d7+dw1ERz1YB/5KkKCKeA== 2024-04-24T22:59:44.674 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.5] 2024-04-24T22:59:44.674 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDWjilmyV5uMBAAiVfXkUZy6/Ihb9wQH+lQsg== 2024-04-24T22:59:44.674 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.6] 2024-04-24T22:59:44.674 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDZjilm2KpJNxAA43TQW3qgbQD4ZtEANgczuQ== 2024-04-24T22:59:44.674 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.7] 2024-04-24T22:59:44.675 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDdjilmKtipAhAABVYBmXUw0BlFzRtcB96eWQ== 2024-04-24T22:59:44.675 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-04-24T22:59:44.675 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDDjilm2DqiFxAAEw8X1pLxEJdi2ms5IDn5kw== 2024-04-24T22:59:44.675 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.y] 2024-04-24T22:59:44.675 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDDjilmXZGcBRAAewFdzeVdq9R9Knf1d9Vmmg== 2024-04-24T22:59:44.675 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-04-24T22:59:44.676 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDDjilmiHC1CxAAfeUpQ4yoyEhtR0aHJBA82g== 2024-04-24T22:59:44.676 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.0] 2024-04-24T22:59:44.676 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDEjilm/JztHRAA3whxpJYd1FS23u2RHKtcGA== 2024-04-24T22:59:44.676 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.1] 2024-04-24T22:59:44.676 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDHjilm59YCIhAAVLLuNxa4WzWy7ggUqKELyg== 2024-04-24T22:59:44.676 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.2] 2024-04-24T22:59:44.676 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDKjilmRlXPKBAAOc9eg5opDtPO2d/7RDX3jg== 2024-04-24T22:59:44.676 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.3] 2024-04-24T22:59:44.676 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDNjilmO7zpLhAAbn2CN216TLDWH9LJ6B76ow== 2024-04-24T22:59:44.676 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.x] 2024-04-24T22:59:44.676 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDDjilm8N5iCBAAyam2FbvEifaO+KtJe4+NwA== 2024-04-24T22:59:44.676 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-04-24T22:59:44.676 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDDjilmgizrERAADtPpAlIm4gkABsgt84rpHA== 2024-04-24T22:59:44.676 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.4] 2024-04-24T22:59:44.677 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDTjilmHRfdKhAA0d7+dw1ERz1YB/5KkKCKeA== 2024-04-24T22:59:44.677 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.5] 2024-04-24T22:59:44.677 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDWjilmyV5uMBAAiVfXkUZy6/Ihb9wQH+lQsg== 2024-04-24T22:59:44.677 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.6] 2024-04-24T22:59:44.677 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDZjilm2KpJNxAA43TQW3qgbQD4ZtEANgczuQ== 2024-04-24T22:59:44.677 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.7] 2024-04-24T22:59:44.677 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDdjilmKtipAhAABVYBmXUw0BlFzRtcB96eWQ== 2024-04-24T22:59:44.677 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2024-04-24T22:59:44.677 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDDjilm2DqiFxAAEw8X1pLxEJdi2ms5IDn5kw== 2024-04-24T22:59:44.678 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T22:59:44.724 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T22:59:44.769 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T22:59:44.812 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T22:59:44.861 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:44.863 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:44.901 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:44.944 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:44.983 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:45.028 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:45.068 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:45.112 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:45.153 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T22:59:45.196 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T22:59:45.240 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T22:59:45.280 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-24T22:59:45.329 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:45.331 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:45.370 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:45.412 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:45.453 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:45.496 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:45.538 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:45.584 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T22:59:45.627 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T22:59:45.629 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T22:59:45.711 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-24T22:59:45.711 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-24T22:59:45.726 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T22:59:45.817 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-24T22:59:45.828 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-24T22:59:45.842 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T22:59:45.939 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-24T22:59:45.950 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-24T22:59:46.002 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T22:59:46.089 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-24T22:59:46.100 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:46.102 DEBUG:teuthology.orchestra.run.smithi162:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T22:59:46.153 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-24T22:59:46.153 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-24T22:59:46.154 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-24T22:59:46.156 INFO:tasks.ceph.mon.a:Started 2024-04-24T22:59:46.156 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-24T22:59:46.156 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-24T22:59:46.202 INFO:tasks.ceph.mon.b:Started 2024-04-24T22:59:46.202 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-24T22:59:46.202 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-24T22:59:46.204 INFO:tasks.ceph.mon.c:Started 2024-04-24T22:59:46.204 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-24T22:59:46.204 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-24T22:59:46.204 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-24T22:59:46.206 INFO:tasks.ceph.mgr.y:Started 2024-04-24T22:59:46.207 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-24T22:59:46.207 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-24T22:59:46.209 INFO:tasks.ceph.mgr.x:Started 2024-04-24T22:59:46.209 INFO:tasks.ceph:Setting crush tunables to default 2024-04-24T22:59:46.209 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd crush tunables default 2024-04-24T22:59:46.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.320+0000 7f8ed2130640 1 Processor -- start 2024-04-24T22:59:46.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.320+0000 7f8ed2130640 1 -- start start 2024-04-24T22:59:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.320+0000 7f8ed2130640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 0x7f8ecc072820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.320+0000 7f8ed2130640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc14eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.320+0000 7f8ed2130640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ecc0b3bd0 con 0x7f8ecc0733a0 2024-04-24T22:59:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.320+0000 7f8ed2130640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f8ecc0b24f0 con 0x7f8ecc0b37f0 2024-04-24T22:59:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.320+0000 7f8ed2130640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8ecc0b2980 con 0x7f8ecc072d60 2024-04-24T22:59:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.320+0000 7f8ecb7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 0x7f8ecc072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.320+0000 7f8ecaffd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8ecc0733a0 0x7f8ecc144260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:50582/0 (socket says 172.21.15.43:50582) 2024-04-24T22:59:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.320+0000 7f8ecaffd640 1 -- 172.21.15.43:0/584849296 learned_addr learned my addr 172.21.15.43:0/584849296 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T22:59:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.320+0000 7f8ecb7fe640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 msgr2=0x7f8ecc072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.320+0000 7f8ecb7fe640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 msgr2=0x7f8ecc072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.320+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 0x7f8ecc072820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:46.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.320+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 0x7f8ecc072820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-24T22:59:46.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.320+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc14eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:46.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.324+0000 7f8ecbfff640 1 -- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 msgr2=0x7f8ecc14eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-24T22:59:46.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.324+0000 7f8ecbfff640 1 -- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 msgr2=0x7f8ecc14eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:46.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.324+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc14eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:46.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.324+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc14eb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-24T22:59:46.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.524+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 0x7f8ecc072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:46.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.524+0000 7f8ecb7fe640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 msgr2=0x7f8ecc072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:46.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.524+0000 7f8ecb7fe640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 msgr2=0x7f8ecc072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:46.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.524+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 0x7f8ecc072820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:46.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.524+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 0x7f8ecc072820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-24T22:59:46.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.528+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc14eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:46.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.528+0000 7f8ecbfff640 1 -- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 msgr2=0x7f8ecc14eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:46.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.528+0000 7f8ecbfff640 1 -- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 msgr2=0x7f8ecc14eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:46.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.528+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc14eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:46.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.528+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc14eb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-24T22:59:46.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.928+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 0x7f8ecc072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:46.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.928+0000 7f8ecb7fe640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 msgr2=0x7f8ecc072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:46.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.928+0000 7f8ecb7fe640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 msgr2=0x7f8ecc072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:46.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.928+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 0x7f8ecc072820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:46.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.928+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 0x7f8ecc072820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-24T22:59:46.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.932+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc14eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:46.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.932+0000 7f8ecbfff640 1 -- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 msgr2=0x7f8ecc14eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:46.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.932+0000 7f8ecbfff640 1 -- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 msgr2=0x7f8ecc14eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:46.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.932+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc14eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:46.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:46.932+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc14eb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-24T22:59:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:47.732+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 0x7f8ecc072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:47.732+0000 7f8ecb7fe640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 msgr2=0x7f8ecc072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:47.732+0000 7f8ecb7fe640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 msgr2=0x7f8ecc072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:47.732+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 0x7f8ecc072820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:47.732+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 0x7f8ecc072820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-24T22:59:47.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:47.736+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc14eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:47.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:47.736+0000 7f8ecbfff640 1 -- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 msgr2=0x7f8ecc14eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:47.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:47.736+0000 7f8ecbfff640 1 -- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 msgr2=0x7f8ecc14eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:47.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:47.736+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc14eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:47.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:47.736+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc14eb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-24T22:59:49.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.320+0000 7f8ec97fa640 1 -- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 msgr2=0x7f8ecc14eb00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T22:59:49.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.320+0000 7f8ec97fa640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc14eb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.320+0000 7f8ec97fa640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 msgr2=0x7f8ecc072820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T22:59:49.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.320+0000 7f8ec97fa640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.43:3300/0 conn(0x7f8ecc0b37f0 0x7f8ecc072820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:49.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.320+0000 7f8ec97fa640 1 -- 172.21.15.43:0/584849296 >> v1:172.21.15.43:6789/0 conn(0x7f8ecc0733a0 legacy=0x7f8ecc144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:49.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.320+0000 7f8ec97fa640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 0x7f8eb800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:49.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.320+0000 7f8ec97fa640 1 -- 172.21.15.43:0/584849296 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ecc06fdd0 con 0x7f8eb8005900 2024-04-24T22:59:49.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.320+0000 7f8ec97fa640 1 -- 172.21.15.43:0/584849296 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8ecc0b24f0 con 0x7f8eb8009570 2024-04-24T22:59:49.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.324+0000 7f8ecaffd640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 0x7f8eb800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:49.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.324+0000 7f8ecaffd640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 msgr2=0x7f8eb800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:49.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.324+0000 7f8ecaffd640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 msgr2=0x7f8eb800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:49.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.324+0000 7f8ecaffd640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 0x7f8eb800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:49.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.324+0000 7f8ecaffd640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 0x7f8eb800ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-24T22:59:49.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.528+0000 7f8ecaffd640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 0x7f8eb800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:49.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.528+0000 7f8ecaffd640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 msgr2=0x7f8eb800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:49.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.528+0000 7f8ecaffd640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 msgr2=0x7f8eb800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:49.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.528+0000 7f8ecaffd640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 0x7f8eb800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:49.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.528+0000 7f8ecaffd640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 0x7f8eb800ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-24T22:59:49.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.932+0000 7f8ecaffd640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 0x7f8eb800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:49.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.932+0000 7f8ecaffd640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 msgr2=0x7f8eb800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:49.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.932+0000 7f8ecaffd640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 msgr2=0x7f8eb800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:49.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.932+0000 7f8ecaffd640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 0x7f8eb800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:49.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:49.932+0000 7f8ecaffd640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 0x7f8eb800ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-24T22:59:50.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:50.736+0000 7f8ecaffd640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 0x7f8eb800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:50.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:50.736+0000 7f8ecaffd640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 msgr2=0x7f8eb800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-24T22:59:50.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:50.736+0000 7f8ecaffd640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 msgr2=0x7f8eb800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T22:59:50.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:50.736+0000 7f8ecaffd640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 0x7f8eb800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T22:59:50.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:50.736+0000 7f8ecaffd640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 0x7f8eb800ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-24T22:59:51.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.596+0000 7f8eca7fc640 1 -- 172.21.15.43:0/584849296 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3563645756 0 0) 0x7f8ecc06fdd0 con 0x7f8eb8005900 2024-04-24T22:59:51.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.596+0000 7f8eca7fc640 1 -- 172.21.15.43:0/584849296 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8eb4003530 con 0x7f8eb8005900 2024-04-24T22:59:51.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8eca7fc640 1 -- 172.21.15.43:0/584849296 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3749173969 0 0) 0x7f8eb4003530 con 0x7f8eb8005900 2024-04-24T22:59:51.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8eca7fc640 1 -- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 msgr2=0x7f8eb800ba30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T22:59:51.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8eca7fc640 1 --2- 172.21.15.43:0/584849296 >> v2:172.21.15.162:3300/0 conn(0x7f8eb8009570 0x7f8eb800ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8eca7fc640 1 -- 172.21.15.43:0/584849296 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb800d140 con 0x7f8eb8005900 2024-04-24T22:59:51.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8eca7fc640 1 -- 172.21.15.43:0/584849296 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f8ebc00f040 con 0x7f8eb8005900 2024-04-24T22:59:51.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8eca7fc640 1 -- 172.21.15.43:0/584849296 >> v1:172.21.15.162:6789/0 conn(0x7f8eb8005900 legacy=0x7f8eb8007d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8ecbfff640 1 -- 172.21.15.43:0/584849296 reap_dead start 2024-04-24T22:59:51.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8eca7fc640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8eb4003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8eca7fc640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb4004070 0x7f8eb4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8eca7fc640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4004e70 0x7f8eb400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8eca7fc640 1 -- 172.21.15.43:0/584849296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8ecc0b24f0 con 0x7f8eb4004070 2024-04-24T22:59:51.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8eca7fc640 1 -- 172.21.15.43:0/584849296 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb4005690 con 0x7f8eb4004e70 2024-04-24T22:59:51.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8eca7fc640 1 -- 172.21.15.43:0/584849296 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb400bf10 con 0x7f8ecc072d60 2024-04-24T22:59:51.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8eb4003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8ecaffd640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb4004070 0x7f8eb4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4004e70 0x7f8eb400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8ecb7fe640 1 -- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4004e70 msgr2=0x7f8eb400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:51.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4004e70 0x7f8eb400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8ecb7fe640 1 -- 172.21.15.43:0/584849296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb4004070 msgr2=0x7f8eb4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:51.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb4004070 0x7f8eb4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.600+0000 7f8ecb7fe640 1 -- 172.21.15.43:0/584849296 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb4003530 con 0x7f8ecc072d60 2024-04-24T22:59:51.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.608+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8eb4003a10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0142f0 tx=0x7f8ebc01d890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60af0bfb85bcd49e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:51.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.608+0000 7f8eca7fc640 1 -- 172.21.15.43:0/584849296 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc00ec40 con 0x7f8ecc072d60 2024-04-24T22:59:51.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.608+0000 7f8eca7fc640 1 -- 172.21.15.43:0/584849296 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ebc0a9640 con 0x7f8ecc072d60 2024-04-24T22:59:51.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.608+0000 7f8eca7fc640 1 -- 172.21.15.43:0/584849296 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc0a9a30 con 0x7f8ecc072d60 2024-04-24T22:59:51.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.608+0000 7f8ed2130640 1 -- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 msgr2=0x7f8eb4003a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.608+0000 7f8ed2130640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8eb4003a10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0142f0 tx=0x7f8ebc01d890 comp rx=0 tx=0).stop 2024-04-24T22:59:51.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.608+0000 7f8ed2130640 1 -- 172.21.15.43:0/584849296 shutdown_connections 2024-04-24T22:59:51.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.608+0000 7f8ed2130640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4004e70 0x7f8eb400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.608+0000 7f8ed2130640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb4004070 0x7f8eb4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.608+0000 7f8ed2130640 1 --2- 172.21.15.43:0/584849296 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8eb4003a10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.608+0000 7f8ed2130640 1 -- 172.21.15.43:0/584849296 >> 172.21.15.43:0/584849296 conn(0x7f8ecc0b5690 msgr2=0x7f8ecc0b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:51.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.608+0000 7f8ed2130640 1 -- 172.21.15.43:0/584849296 shutdown_connections 2024-04-24T22:59:51.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.608+0000 7f8ed2130640 1 -- 172.21.15.43:0/584849296 wait complete. 2024-04-24T22:59:51.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.612+0000 7f8ed2130640 1 Processor -- start 2024-04-24T22:59:51.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.612+0000 7f8ed2130640 1 -- start start 2024-04-24T22:59:51.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ed2130640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4004070 0x7f8ecc1459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ed2130640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb4004e70 0x7f8ecc146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ed2130640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc1e06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:51.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ed2130640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8ecc147950 con 0x7f8eb4004e70 2024-04-24T22:59:51.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ed2130640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ecc1477d0 con 0x7f8eb4004070 2024-04-24T22:59:51.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ed2130640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8ecc147ad0 con 0x7f8ecc072d60 2024-04-24T22:59:51.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ecb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4004070 0x7f8ecc1459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ecb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4004070 0x7f8ecc1459c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.43:47084/0 (socket says 172.21.15.43:47084) 2024-04-24T22:59:51.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ecaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb4004e70 0x7f8ecc146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/2589836137 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc1e06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:51.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ecb7fe640 1 -- 172.21.15.43:0/2589836137 learned_addr learned my addr 172.21.15.43:0/2589836137 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T22:59:51.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ecbfff640 1 -- 172.21.15.43:0/2589836137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4004070 msgr2=0x7f8ecc1459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/2589836137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4004070 0x7f8ecc1459c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ecbfff640 1 -- 172.21.15.43:0/2589836137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb4004e70 msgr2=0x7f8ecc146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/2589836137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb4004e70 0x7f8ecc146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ecbfff640 1 -- 172.21.15.43:0/2589836137 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ecc071a30 con 0x7f8ecc072d60 2024-04-24T22:59:51.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ecb7fe640 1 --2- 172.21.15.43:0/2589836137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4004070 0x7f8ecc1459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T22:59:51.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.616+0000 7f8ecbfff640 1 --2- 172.21.15.43:0/2589836137 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc1e06d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800c090 tx=0x7f8ec4009f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:51.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.624+0000 7f8eb3fff640 1 -- 172.21.15.43:0/2589836137 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec401b070 con 0x7f8ecc072d60 2024-04-24T22:59:51.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.624+0000 7f8eb3fff640 1 -- 172.21.15.43:0/2589836137 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec4015d50 con 0x7f8ecc072d60 2024-04-24T22:59:51.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.624+0000 7f8ed2130640 1 -- 172.21.15.43:0/2589836137 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ecc146cd0 con 0x7f8ecc072d60 2024-04-24T22:59:51.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.624+0000 7f8eb3fff640 1 -- 172.21.15.43:0/2589836137 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec40206a0 con 0x7f8ecc072d60 2024-04-24T22:59:51.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.624+0000 7f8ed2130640 1 -- 172.21.15.43:0/2589836137 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ecc071750 con 0x7f8ecc072d60 2024-04-24T22:59:51.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.624+0000 7f8eb3fff640 1 -- 172.21.15.43:0/2589836137 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8ec4020840 con 0x7f8ecc072d60 2024-04-24T22:59:51.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.624+0000 7f8eb3fff640 1 -- 172.21.15.43:0/2589836137 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8ec4017c00 con 0x7f8ecc072d60 2024-04-24T22:59:51.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.624+0000 7f8ed2130640 1 -- 172.21.15.43:0/2589836137 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ecc04f580 con 0x7f8ecc072d60 2024-04-24T22:59:51.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.628+0000 7f8eb3fff640 1 -- 172.21.15.43:0/2589836137 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8ec4010050 con 0x7f8ecc072d60 2024-04-24T22:59:51.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.716+0000 7f8ed2130640 1 -- 172.21.15.43:0/2589836137 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8ecc144040 con 0x7f8ecc072d60 2024-04-24T22:59:51.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.728+0000 7f8eb3fff640 1 -- 172.21.15.43:0/2589836137 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f8ec4017e00 con 0x7f8ecc072d60 2024-04-24T22:59:51.732 INFO:teuthology.orchestra.run.smithi043.stderr:adjusted tunables profile to default 2024-04-24T22:59:51.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.728+0000 7f8ed2130640 1 -- 172.21.15.43:0/2589836137 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 msgr2=0x7f8ecc1e06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:51.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.728+0000 7f8ed2130640 1 --2- 172.21.15.43:0/2589836137 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc1e06d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800c090 tx=0x7f8ec4009f10 comp rx=0 tx=0).stop 2024-04-24T22:59:51.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.728+0000 7f8ed2130640 1 -- 172.21.15.43:0/2589836137 shutdown_connections 2024-04-24T22:59:51.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.728+0000 7f8ed2130640 1 --2- 172.21.15.43:0/2589836137 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ecc072d60 0x7f8ecc1e06d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.728+0000 7f8ed2130640 1 --2- 172.21.15.43:0/2589836137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb4004e70 0x7f8ecc146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.728+0000 7f8ed2130640 1 --2- 172.21.15.43:0/2589836137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4004070 0x7f8ecc1459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:51.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.728+0000 7f8ed2130640 1 -- 172.21.15.43:0/2589836137 >> 172.21.15.43:0/2589836137 conn(0x7f8ecc0b5690 msgr2=0x7f8ecc13cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:51.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.728+0000 7f8ed2130640 1 -- 172.21.15.43:0/2589836137 shutdown_connections 2024-04-24T22:59:51.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:51.728+0000 7f8ed2130640 1 -- 172.21.15.43:0/2589836137 wait complete. 2024-04-24T22:59:51.758 INFO:tasks.ceph:check_enable_crimson: False 2024-04-24T22:59:51.759 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-24T22:59:51.759 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:51.759 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-24T22:59:51.771 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:51.771 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-24T22:59:51.826 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:51.827 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-24T22:59:51.831 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:51.828+0000 7f33e86d5180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T22:59:51.843 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T22:59:51.843 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-24T22:59:51.862 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:51.859+0000 7f4af1dae180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T22:59:51.903 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:51.903 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-24T22:59:51.916 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:51.916 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-24T22:59:51.972 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:51.972 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-24T22:59:52.028 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-24T22:59:52.028 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-24T22:59:52.084 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 7fcdad35-0067-4caf-ad89-01d224bc5a6f 0 2024-04-24T22:59:52.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.247+0000 7fc7feb0b640 1 Processor -- start 2024-04-24T22:59:52.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.247+0000 7fc7feb0b640 1 -- start start 2024-04-24T22:59:52.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.247+0000 7fc7feb0b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc7f814b360 0x7fc7f80b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.247+0000 7fc7feb0b640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f80bdc50 con 0x7fc7f80b9590 2024-04-24T22:59:52.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.247+0000 7fc7feb0b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f80b5740 con 0x7fc7f80bd870 2024-04-24T22:59:52.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.247+0000 7fc7feb0b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc7f80b5a20 con 0x7fc7f814b360 2024-04-24T22:59:52.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7fc8a7640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc7f80bd870 0x7fc7f814ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:59506/0 (socket says 172.21.15.162:59506) 2024-04-24T22:59:52.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7fc8a7640 1 -- 172.21.15.162:0/1235414161 learned_addr learned my addr 172.21.15.162:0/1235414161 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-24T22:59:52.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7fd0a8640 1 --2- 172.21.15.162:0/1235414161 >> v2:172.21.15.162:3300/0 conn(0x7fc7f814b360 0x7fc7f80b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7fd0a8640 1 -- 172.21.15.162:0/1235414161 >> v1:172.21.15.162:6789/0 conn(0x7fc7f80bd870 legacy=0x7fc7f814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7fd0a8640 1 -- 172.21.15.162:0/1235414161 >> v1:172.21.15.43:6789/0 conn(0x7fc7f80b9590 legacy=0x7fc7f81411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:52.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7fd0a8640 1 -- 172.21.15.162:0/1235414161 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f80b5d00 con 0x7fc7f814b360 2024-04-24T22:59:52.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7fd0a8640 1 --2- 172.21.15.162:0/1235414161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f814b360 0x7fc7f80b49d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0009d90 tx=0x7fc7f001c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5227439756f16b29 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:52.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7f77fe640 1 -- 172.21.15.162:0/1235414161 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00b2070 con 0x7fc7f814b360 2024-04-24T22:59:52.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7f77fe640 1 -- 172.21.15.162:0/1235414161 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f00a5870 con 0x7fc7f814b360 2024-04-24T22:59:52.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7f77fe640 1 -- 172.21.15.162:0/1235414161 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00a5c40 con 0x7fc7f814b360 2024-04-24T22:59:52.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7feb0b640 1 -- 172.21.15.162:0/1235414161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f814b360 msgr2=0x7fc7f80b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7feb0b640 1 --2- 172.21.15.162:0/1235414161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f814b360 0x7fc7f80b49d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0009d90 tx=0x7fc7f001c860 comp rx=0 tx=0).stop 2024-04-24T22:59:52.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7feb0b640 1 -- 172.21.15.162:0/1235414161 shutdown_connections 2024-04-24T22:59:52.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7feb0b640 1 --2- 172.21.15.162:0/1235414161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f814b360 0x7fc7f80b49d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7feb0b640 1 -- 172.21.15.162:0/1235414161 >> 172.21.15.162:0/1235414161 conn(0x7fc7f8072f20 msgr2=0x7fc7f80bcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:52.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7feb0b640 1 -- 172.21.15.162:0/1235414161 shutdown_connections 2024-04-24T22:59:52.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.251+0000 7fc7feb0b640 1 -- 172.21.15.162:0/1235414161 wait complete. 2024-04-24T22:59:52.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7feb0b640 1 Processor -- start 2024-04-24T22:59:52.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7feb0b640 1 -- start start 2024-04-24T22:59:52.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7feb0b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7f80bd870 0x7fc7f81384a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7feb0b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7f814b360 0x7fc7f8149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7feb0b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f81e34f0 0x7fc7f8135000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7feb0b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f8155d10 con 0x7fc7f80bd870 2024-04-24T22:59:52.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7feb0b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f8155b90 con 0x7fc7f81e34f0 2024-04-24T22:59:52.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7feb0b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f8155e90 con 0x7fc7f814b360 2024-04-24T22:59:52.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7f7fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7f814b360 0x7fc7f8149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7fd0a8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f81e34f0 0x7fc7f8135000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7f7fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7f814b360 0x7fc7f8149cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:46038/0 (socket says 172.21.15.162:46038) 2024-04-24T22:59:52.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7f7fff640 1 -- 172.21.15.162:0/834694781 learned_addr learned my addr 172.21.15.162:0/834694781 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-24T22:59:52.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7fd0a8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f81e34f0 0x7fc7f8135000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57382/0 (socket says 172.21.15.162:57382) 2024-04-24T22:59:52.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7fc8a7640 1 --2- 172.21.15.162:0/834694781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7f80bd870 0x7fc7f81384a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7f7fff640 1 -- 172.21.15.162:0/834694781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f81e34f0 msgr2=0x7fc7f8135000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7f7fff640 1 --2- 172.21.15.162:0/834694781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f81e34f0 0x7fc7f8135000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7f7fff640 1 -- 172.21.15.162:0/834694781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7f80bd870 msgr2=0x7fc7f81384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7f7fff640 1 --2- 172.21.15.162:0/834694781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7f80bd870 0x7fc7f81384a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7f7fff640 1 -- 172.21.15.162:0/834694781 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f8142520 con 0x7fc7f814b360 2024-04-24T22:59:52.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7fd0a8640 1 --2- 172.21.15.162:0/834694781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f81e34f0 0x7fc7f8135000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T22:59:52.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7f7fff640 1 --2- 172.21.15.162:0/834694781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7f814b360 0x7fc7f8149cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000c430 tx=0x7fc7e000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:52.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7f57fa640 1 -- 172.21.15.162:0/834694781 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0007020 con 0x7fc7f814b360 2024-04-24T22:59:52.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7f57fa640 1 -- 172.21.15.162:0/834694781 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e00071c0 con 0x7fc7f814b360 2024-04-24T22:59:52.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7feb0b640 1 -- 172.21.15.162:0/834694781 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f80bbf70 con 0x7fc7f814b360 2024-04-24T22:59:52.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7f57fa640 1 -- 172.21.15.162:0/834694781 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00075b0 con 0x7fc7f814b360 2024-04-24T22:59:52.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7feb0b640 1 -- 172.21.15.162:0/834694781 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f8142240 con 0x7fc7f814b360 2024-04-24T22:59:52.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7f57fa640 1 -- 172.21.15.162:0/834694781 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc7e0019020 con 0x7fc7f814b360 2024-04-24T22:59:52.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7f57fa640 1 -- 172.21.15.162:0/834694781 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fc7e0012420 con 0x7fc7f814b360 2024-04-24T22:59:52.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.255+0000 7fc7feb0b640 1 -- 172.21.15.162:0/834694781 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f804f580 con 0x7fc7f814b360 2024-04-24T22:59:52.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.259+0000 7fc7f57fa640 1 -- 172.21.15.162:0/834694781 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc7e0006d50 con 0x7fc7f814b360 2024-04-24T22:59:52.329 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:52.324+0000 7f33e86d5180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T22:59:52.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.327+0000 7fc7feb0b640 1 -- 172.21.15.162:0/834694781 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7fcdad35-0067-4caf-ad89-01d224bc5a6f", "id": 0} v 0) -- 0x7fc7f8145700 con 0x7fc7f814b360 2024-04-24T22:59:52.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.331+0000 7fc7f57fa640 1 -- 172.21.15.162:0/834694781 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7fcdad35-0067-4caf-ad89-01d224bc5a6f", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fc7e0011590 con 0x7fc7f814b360 2024-04-24T22:59:52.336 INFO:teuthology.orchestra.run.smithi162.stdout:0 2024-04-24T22:59:52.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.335+0000 7fc7feb0b640 1 -- 172.21.15.162:0/834694781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7f814b360 msgr2=0x7fc7f8149cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.335+0000 7fc7feb0b640 1 --2- 172.21.15.162:0/834694781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7f814b360 0x7fc7f8149cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000c430 tx=0x7fc7e000c8f0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.335+0000 7fc7feb0b640 1 -- 172.21.15.162:0/834694781 shutdown_connections 2024-04-24T22:59:52.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.335+0000 7fc7feb0b640 1 --2- 172.21.15.162:0/834694781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f81e34f0 0x7fc7f8135000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.335+0000 7fc7feb0b640 1 --2- 172.21.15.162:0/834694781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7f814b360 0x7fc7f8149cc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.335+0000 7fc7feb0b640 1 --2- 172.21.15.162:0/834694781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7f80bd870 0x7fc7f81384a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.335+0000 7fc7feb0b640 1 -- 172.21.15.162:0/834694781 >> 172.21.15.162:0/834694781 conn(0x7fc7f8072f20 msgr2=0x7fc7f8147850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:52.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.335+0000 7fc7feb0b640 1 -- 172.21.15.162:0/834694781 shutdown_connections 2024-04-24T22:59:52.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.335+0000 7fc7feb0b640 1 -- 172.21.15.162:0/834694781 wait complete. 2024-04-24T22:59:52.344 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:52.343+0000 7f4af1dae180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T22:59:52.354 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 5ba8bdb6-887f-4a96-953c-00f6c9bff92b 1 2024-04-24T22:59:52.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.467+0000 7f5b7be86640 1 Processor -- start 2024-04-24T22:59:52.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.467+0000 7f5b7be86640 1 -- start start 2024-04-24T22:59:52.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.467+0000 7f5b7be86640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5b74072ec0 0x7f5b741488f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.467+0000 7f5b7be86640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b740b3bb0 0x7f5b7414fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.467+0000 7f5b7be86640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b740b4e60 con 0x7f5b740b5e00 2024-04-24T22:59:52.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.467+0000 7f5b7be86640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f5b740b5100 con 0x7f5b74072ec0 2024-04-24T22:59:52.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.467+0000 7f5b7be86640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5b740732a0 con 0x7f5b740b3bb0 2024-04-24T22:59:52.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.467+0000 7f5b7a423640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b740b3bb0 0x7f5b7414fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.467+0000 7f5b79421640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f5b740b5e00 0x7f5b740b34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:59512/0 (socket says 172.21.15.162:59512) 2024-04-24T22:59:52.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.467+0000 7f5b79421640 1 -- 172.21.15.162:0/1729919460 learned_addr learned my addr 172.21.15.162:0/1729919460 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-24T22:59:52.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.467+0000 7f5b79c22640 1 --2- 172.21.15.162:0/1729919460 >> v2:172.21.15.43:3300/0 conn(0x7f5b74072ec0 0x7f5b741488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.467+0000 7f5b7a423640 1 -- 172.21.15.162:0/1729919460 >> v2:172.21.15.43:3300/0 conn(0x7f5b74072ec0 msgr2=0x7f5b741488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:52.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.467+0000 7f5b7a423640 1 --2- 172.21.15.162:0/1729919460 >> v2:172.21.15.43:3300/0 conn(0x7f5b74072ec0 0x7f5b741488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.467+0000 7f5b7a423640 1 -- 172.21.15.162:0/1729919460 >> v1:172.21.15.162:6789/0 conn(0x7f5b740b5e00 legacy=0x7f5b740b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.467+0000 7f5b7a423640 1 -- 172.21.15.162:0/1729919460 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b740b19d0 con 0x7f5b740b3bb0 2024-04-24T22:59:52.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.471+0000 7f5b7a423640 1 --2- 172.21.15.162:0/1729919460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b3bb0 0x7f5b7414fc60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5b74145300 tx=0x7f5b6c01c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16b7be7a979617dd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:52.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.471+0000 7f5b78c20640 1 -- 172.21.15.162:0/1729919460 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0b2070 con 0x7f5b740b3bb0 2024-04-24T22:59:52.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.471+0000 7f5b78c20640 1 -- 172.21.15.162:0/1729919460 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0a57e0 con 0x7f5b740b3bb0 2024-04-24T22:59:52.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.471+0000 7f5b78c20640 1 -- 172.21.15.162:0/1729919460 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0a5bb0 con 0x7f5b740b3bb0 2024-04-24T22:59:52.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.471+0000 7f5b7be86640 1 -- 172.21.15.162:0/1729919460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b3bb0 msgr2=0x7f5b7414fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.471+0000 7f5b7be86640 1 --2- 172.21.15.162:0/1729919460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b3bb0 0x7f5b7414fc60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5b74145300 tx=0x7f5b6c01c810 comp rx=0 tx=0).stop 2024-04-24T22:59:52.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.471+0000 7f5b7be86640 1 -- 172.21.15.162:0/1729919460 shutdown_connections 2024-04-24T22:59:52.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.471+0000 7f5b7be86640 1 --2- 172.21.15.162:0/1729919460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b3bb0 0x7f5b7414fc60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.471+0000 7f5b7be86640 1 --2- 172.21.15.162:0/1729919460 >> v2:172.21.15.43:3300/0 conn(0x7f5b74072ec0 0x7f5b741488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.471+0000 7f5b7be86640 1 -- 172.21.15.162:0/1729919460 >> 172.21.15.162:0/1729919460 conn(0x7f5b7406c300 msgr2=0x7f5b7406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:52.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.471+0000 7f5b7be86640 1 -- 172.21.15.162:0/1729919460 shutdown_connections 2024-04-24T22:59:52.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.471+0000 7f5b7be86640 1 -- 172.21.15.162:0/1729919460 wait complete. 2024-04-24T22:59:52.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.471+0000 7f5b7be86640 1 Processor -- start 2024-04-24T22:59:52.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.471+0000 7f5b7be86640 1 -- start start 2024-04-24T22:59:52.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7be86640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b74072ec0 0x7f5b74141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7be86640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b740b3bb0 0x7f5b741e1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7be86640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b5e00 0x7f5b741de370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7be86640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5b740b0e10 con 0x7f5b74072ec0 2024-04-24T22:59:52.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7be86640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5b740b0c90 con 0x7f5b740b5e00 2024-04-24T22:59:52.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7be86640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5b741529c0 con 0x7f5b740b3bb0 2024-04-24T22:59:52.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7a423640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b5e00 0x7f5b741de370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b79421640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b740b3bb0 0x7f5b741e1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7a423640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b5e00 0x7f5b741de370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57404/0 (socket says 172.21.15.162:57404) 2024-04-24T22:59:52.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7a423640 1 -- 172.21.15.162:0/2982220591 learned_addr learned my addr 172.21.15.162:0/2982220591 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-24T22:59:52.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b79c22640 1 --2- 172.21.15.162:0/2982220591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b74072ec0 0x7f5b74141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7a423640 1 -- 172.21.15.162:0/2982220591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b740b3bb0 msgr2=0x7f5b741e1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7a423640 1 --2- 172.21.15.162:0/2982220591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b740b3bb0 0x7f5b741e1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7a423640 1 -- 172.21.15.162:0/2982220591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b74072ec0 msgr2=0x7f5b74141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7a423640 1 --2- 172.21.15.162:0/2982220591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b74072ec0 0x7f5b74141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7a423640 1 -- 172.21.15.162:0/2982220591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7414be30 con 0x7f5b740b5e00 2024-04-24T22:59:52.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b79421640 1 --2- 172.21.15.162:0/2982220591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b740b3bb0 0x7f5b741e1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T22:59:52.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7a423640 1 --2- 172.21.15.162:0/2982220591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b5e00 0x7f5b741de370 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0b0040 tx=0x7f5b6c0195b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:52.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b6a7fc640 1 -- 172.21.15.162:0/2982220591 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0b2070 con 0x7f5b740b5e00 2024-04-24T22:59:52.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b6a7fc640 1 -- 172.21.15.162:0/2982220591 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0bc070 con 0x7f5b740b5e00 2024-04-24T22:59:52.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7be86640 1 -- 172.21.15.162:0/2982220591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b741e1ff0 con 0x7f5b740b5e00 2024-04-24T22:59:52.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b6a7fc640 1 -- 172.21.15.162:0/2982220591 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0ada70 con 0x7f5b740b5e00 2024-04-24T22:59:52.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7be86640 1 -- 172.21.15.162:0/2982220591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b7414db20 con 0x7f5b740b5e00 2024-04-24T22:59:52.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b6a7fc640 1 -- 172.21.15.162:0/2982220591 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5b6c0a5660 con 0x7f5b740b5e00 2024-04-24T22:59:52.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b6a7fc640 1 -- 172.21.15.162:0/2982220591 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f5b6c0b77f0 con 0x7f5b740b5e00 2024-04-24T22:59:52.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.475+0000 7f5b7be86640 1 -- 172.21.15.162:0/2982220591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b7414c000 con 0x7f5b740b5e00 2024-04-24T22:59:52.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.479+0000 7f5b6a7fc640 1 -- 172.21.15.162:0/2982220591 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5b6c016520 con 0x7f5b740b5e00 2024-04-24T22:59:52.526 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:52.524+0000 7f33e86d5180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T22:59:52.549 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.547+0000 7f5b7be86640 1 -- 172.21.15.162:0/2982220591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5ba8bdb6-887f-4a96-953c-00f6c9bff92b", "id": 1} v 0) -- 0x7f5b7404f580 con 0x7f5b740b5e00 2024-04-24T22:59:52.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.551+0000 7f5b6a7fc640 1 -- 172.21.15.162:0/2982220591 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5ba8bdb6-887f-4a96-953c-00f6c9bff92b", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f5b6c0adce0 con 0x7f5b740b5e00 2024-04-24T22:59:52.556 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-04-24T22:59:52.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.555+0000 7f5b7be86640 1 -- 172.21.15.162:0/2982220591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b5e00 msgr2=0x7f5b741de370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.555+0000 7f5b7be86640 1 --2- 172.21.15.162:0/2982220591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b5e00 0x7f5b741de370 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0b0040 tx=0x7f5b6c0195b0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.555+0000 7f5b7be86640 1 -- 172.21.15.162:0/2982220591 shutdown_connections 2024-04-24T22:59:52.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.555+0000 7f5b7be86640 1 --2- 172.21.15.162:0/2982220591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b5e00 0x7f5b741de370 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.555+0000 7f5b7be86640 1 --2- 172.21.15.162:0/2982220591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b740b3bb0 0x7f5b741e1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.555+0000 7f5b7be86640 1 --2- 172.21.15.162:0/2982220591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b74072ec0 0x7f5b74141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.555+0000 7f5b7be86640 1 -- 172.21.15.162:0/2982220591 >> 172.21.15.162:0/2982220591 conn(0x7f5b7406c300 msgr2=0x7f5b74144400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:52.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.555+0000 7f5b7be86640 1 -- 172.21.15.162:0/2982220591 shutdown_connections 2024-04-24T22:59:52.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.555+0000 7f5b7be86640 1 -- 172.21.15.162:0/2982220591 wait complete. 2024-04-24T22:59:52.564 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:52.563+0000 7f4af1dae180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T22:59:52.573 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 90a65037-45c9-4627-88ce-793d48a647dc 2 2024-04-24T22:59:52.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.683+0000 7f571c9c7640 1 Processor -- start 2024-04-24T22:59:52.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.683+0000 7f571c9c7640 1 -- start start 2024-04-24T22:59:52.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.683+0000 7f571c9c7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571814dc70 0x7f5718150060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.683+0000 7f571c9c7640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57180b6de0 con 0x7f5718070ea0 2024-04-24T22:59:52.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.683+0000 7f571c9c7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57180721c0 con 0x7f57180b6a00 2024-04-24T22:59:52.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.683+0000 7f571c9c7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f57180716e0 con 0x7f571814dc70 2024-04-24T22:59:52.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.683+0000 7f5716d9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571814dc70 0x7f5718150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.683+0000 7f571659c640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f57180b6a00 0x7f5718147940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:59522/0 (socket says 172.21.15.162:59522) 2024-04-24T22:59:52.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.683+0000 7f571659c640 1 -- 172.21.15.162:0/2506037598 learned_addr learned my addr 172.21.15.162:0/2506037598 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-24T22:59:52.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.687+0000 7f5716d9d640 1 -- 172.21.15.162:0/2506037598 >> v1:172.21.15.162:6789/0 conn(0x7f57180b6a00 legacy=0x7f5718147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.687+0000 7f5716d9d640 1 -- 172.21.15.162:0/2506037598 >> v1:172.21.15.43:6789/0 conn(0x7f5718070ea0 legacy=0x7f571813e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:52.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.687+0000 7f5716d9d640 1 -- 172.21.15.162:0/2506037598 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57180719c0 con 0x7f571814dc70 2024-04-24T22:59:52.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.687+0000 7f5716d9d640 1 --2- 172.21.15.162:0/2506037598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571814dc70 0x7f5718150060 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5710009dc0 tx=0x7f571001c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5144c12e2cbbbb41 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:52.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.687+0000 7f571559a640 1 -- 172.21.15.162:0/2506037598 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57100b2070 con 0x7f571814dc70 2024-04-24T22:59:52.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.687+0000 7f571559a640 1 -- 172.21.15.162:0/2506037598 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57100a58e0 con 0x7f571814dc70 2024-04-24T22:59:52.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.687+0000 7f571559a640 1 -- 172.21.15.162:0/2506037598 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57100a5cb0 con 0x7f571814dc70 2024-04-24T22:59:52.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.687+0000 7f571c9c7640 1 -- 172.21.15.162:0/2506037598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571814dc70 msgr2=0x7f5718150060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.687+0000 7f571c9c7640 1 --2- 172.21.15.162:0/2506037598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571814dc70 0x7f5718150060 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5710009dc0 tx=0x7f571001c800 comp rx=0 tx=0).stop 2024-04-24T22:59:52.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.687+0000 7f571c9c7640 1 -- 172.21.15.162:0/2506037598 shutdown_connections 2024-04-24T22:59:52.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.687+0000 7f571c9c7640 1 --2- 172.21.15.162:0/2506037598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571814dc70 0x7f5718150060 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.687+0000 7f571c9c7640 1 -- 172.21.15.162:0/2506037598 >> 172.21.15.162:0/2506037598 conn(0x7f571806c300 msgr2=0x7f571806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:52.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.687+0000 7f571c9c7640 1 -- 172.21.15.162:0/2506037598 shutdown_connections 2024-04-24T22:59:52.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.687+0000 7f571c9c7640 1 -- 172.21.15.162:0/2506037598 wait complete. 2024-04-24T22:59:52.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f571c9c7640 1 Processor -- start 2024-04-24T22:59:52.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f571c9c7640 1 -- start start 2024-04-24T22:59:52.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f571c9c7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5718070ea0 0x7f5718134a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f571c9c7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57180b6a00 0x7f5718135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f571c9c7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571814dc70 0x7f57181374d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f571c9c7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f57180b0da0 con 0x7f571814dc70 2024-04-24T22:59:52.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f571c9c7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f57180b0c20 con 0x7f5718070ea0 2024-04-24T22:59:52.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f571c9c7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f571813e980 con 0x7f57180b6a00 2024-04-24T22:59:52.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f571659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5718070ea0 0x7f5718134a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f5715d9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57180b6a00 0x7f5718135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f5715d9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57180b6a00 0x7f5718135790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:46052/0 (socket says 172.21.15.162:46052) 2024-04-24T22:59:52.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f571659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5718070ea0 0x7f5718134a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57420/0 (socket says 172.21.15.162:57420) 2024-04-24T22:59:52.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f5715d9b640 1 -- 172.21.15.162:0/720646824 learned_addr learned my addr 172.21.15.162:0/720646824 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-24T22:59:52.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f5716d9d640 1 --2- 172.21.15.162:0/720646824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571814dc70 0x7f57181374d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f5715d9b640 1 -- 172.21.15.162:0/720646824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5718070ea0 msgr2=0x7f5718134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f5715d9b640 1 --2- 172.21.15.162:0/720646824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5718070ea0 0x7f5718134a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f5715d9b640 1 -- 172.21.15.162:0/720646824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571814dc70 msgr2=0x7f57181374d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f5715d9b640 1 --2- 172.21.15.162:0/720646824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571814dc70 0x7f57181374d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f5715d9b640 1 -- 172.21.15.162:0/720646824 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571813a500 con 0x7f57180b6a00 2024-04-24T22:59:52.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f5716d9d640 1 --2- 172.21.15.162:0/720646824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571814dc70 0x7f57181374d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:52.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f5715d9b640 1 --2- 172.21.15.162:0/720646824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57180b6a00 0x7f5718135790 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f570000b410 tx=0x7f570000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:52.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f570effd640 1 -- 172.21.15.162:0/720646824 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700015030 con 0x7f57180b6a00 2024-04-24T22:59:52.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f570effd640 1 -- 172.21.15.162:0/720646824 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5700004020 con 0x7f57180b6a00 2024-04-24T22:59:52.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f571c9c7640 1 -- 172.21.15.162:0/720646824 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5718133cd0 con 0x7f57180b6a00 2024-04-24T22:59:52.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f570effd640 1 -- 172.21.15.162:0/720646824 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700004450 con 0x7f57180b6a00 2024-04-24T22:59:52.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f571c9c7640 1 -- 172.21.15.162:0/720646824 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5718134290 con 0x7f57180b6a00 2024-04-24T22:59:52.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f570effd640 1 -- 172.21.15.162:0/720646824 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5700018070 con 0x7f57180b6a00 2024-04-24T22:59:52.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f570effd640 1 -- 172.21.15.162:0/720646824 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f570001a410 con 0x7f57180b6a00 2024-04-24T22:59:52.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.691+0000 7f571c9c7640 1 -- 172.21.15.162:0/720646824 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f571804f580 con 0x7f57180b6a00 2024-04-24T22:59:52.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.695+0000 7f570effd640 1 -- 172.21.15.162:0/720646824 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5700003660 con 0x7f57180b6a00 2024-04-24T22:59:52.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.763+0000 7f571c9c7640 1 -- 172.21.15.162:0/720646824 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "90a65037-45c9-4627-88ce-793d48a647dc", "id": 2} v 0) -- 0x7f571813a220 con 0x7f57180b6a00 2024-04-24T22:59:52.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.767+0000 7f570effd640 1 -- 172.21.15.162:0/720646824 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "90a65037-45c9-4627-88ce-793d48a647dc", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f5700003cf0 con 0x7f57180b6a00 2024-04-24T22:59:52.769 INFO:teuthology.orchestra.run.smithi162.stdout:2 2024-04-24T22:59:52.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.767+0000 7f571c9c7640 1 -- 172.21.15.162:0/720646824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57180b6a00 msgr2=0x7f5718135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.767+0000 7f571c9c7640 1 --2- 172.21.15.162:0/720646824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57180b6a00 0x7f5718135790 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f570000b410 tx=0x7f570000b8d0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.767+0000 7f571c9c7640 1 -- 172.21.15.162:0/720646824 shutdown_connections 2024-04-24T22:59:52.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.767+0000 7f571c9c7640 1 --2- 172.21.15.162:0/720646824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571814dc70 0x7f57181374d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.767+0000 7f571c9c7640 1 --2- 172.21.15.162:0/720646824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57180b6a00 0x7f5718135790 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.767+0000 7f571c9c7640 1 --2- 172.21.15.162:0/720646824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5718070ea0 0x7f5718134a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.767+0000 7f571c9c7640 1 -- 172.21.15.162:0/720646824 >> 172.21.15.162:0/720646824 conn(0x7f571806c300 msgr2=0x7f57180ba360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:52.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.767+0000 7f571c9c7640 1 -- 172.21.15.162:0/720646824 shutdown_connections 2024-04-24T22:59:52.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.767+0000 7f571c9c7640 1 -- 172.21.15.162:0/720646824 wait complete. 2024-04-24T22:59:52.785 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 616f92c4-db5d-4167-8d08-c7a9d999fe81 3 2024-04-24T22:59:52.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.899+0000 7f24a16ca640 1 Processor -- start 2024-04-24T22:59:52.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.899+0000 7f24a16ca640 1 -- start start 2024-04-24T22:59:52.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.899+0000 7f24a16ca640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f249c061e90 0x7f249c14aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.899+0000 7f24a16ca640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f249c062270 con 0x7f249c14b020 2024-04-24T22:59:52.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.899+0000 7f24a16ca640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f249c0afed0 con 0x7f249c147530 2024-04-24T22:59:52.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.899+0000 7f24a16ca640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f249c1484d0 con 0x7f249c061e90 2024-04-24T22:59:52.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.899+0000 7f249affd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f249c061e90 0x7f249c14aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.899+0000 7f249affd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f249c061e90 0x7f249c14aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57424/0 (socket says 172.21.15.162:57424) 2024-04-24T22:59:52.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.899+0000 7f249affd640 1 -- 172.21.15.162:0/3106367088 learned_addr learned my addr 172.21.15.162:0/3106367088 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-24T22:59:52.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.899+0000 7f249affd640 1 -- 172.21.15.162:0/3106367088 >> v1:172.21.15.162:6789/0 conn(0x7f249c147530 legacy=0x7f249c144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.899+0000 7f249affd640 1 -- 172.21.15.162:0/3106367088 >> v1:172.21.15.43:6789/0 conn(0x7f249c14b020 legacy=0x7f249c151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.899+0000 7f249affd640 1 -- 172.21.15.162:0/3106367088 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249c0b01b0 con 0x7f249c061e90 2024-04-24T22:59:52.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.903+0000 7f249affd640 1 --2- 172.21.15.162:0/3106367088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f249c061e90 0x7f249c14aae0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2494009870 tx=0x7f249401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fc9b7b50952743b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:52.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.903+0000 7f2499ffb640 1 -- 172.21.15.162:0/3106367088 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24940b0070 con 0x7f249c061e90 2024-04-24T22:59:52.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.903+0000 7f2499ffb640 1 -- 172.21.15.162:0/3106367088 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24940ab600 con 0x7f249c061e90 2024-04-24T22:59:52.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.903+0000 7f2499ffb640 1 -- 172.21.15.162:0/3106367088 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24940ab9d0 con 0x7f249c061e90 2024-04-24T22:59:52.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.903+0000 7f24a16ca640 1 -- 172.21.15.162:0/3106367088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f249c061e90 msgr2=0x7f249c14aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.903+0000 7f24a16ca640 1 --2- 172.21.15.162:0/3106367088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f249c061e90 0x7f249c14aae0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2494009870 tx=0x7f249401c440 comp rx=0 tx=0).stop 2024-04-24T22:59:52.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.903+0000 7f24a16ca640 1 -- 172.21.15.162:0/3106367088 shutdown_connections 2024-04-24T22:59:52.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.903+0000 7f24a16ca640 1 --2- 172.21.15.162:0/3106367088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f249c061e90 0x7f249c14aae0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.903+0000 7f24a16ca640 1 -- 172.21.15.162:0/3106367088 >> 172.21.15.162:0/3106367088 conn(0x7f249c06b9f0 msgr2=0x7f249c0b93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:52.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.903+0000 7f24a16ca640 1 -- 172.21.15.162:0/3106367088 shutdown_connections 2024-04-24T22:59:52.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.903+0000 7f24a16ca640 1 -- 172.21.15.162:0/3106367088 wait complete. 2024-04-24T22:59:52.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.903+0000 7f24a16ca640 1 Processor -- start 2024-04-24T22:59:52.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.903+0000 7f24a16ca640 1 -- start start 2024-04-24T22:59:52.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f24a16ca640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f249c061e90 0x7f249c1491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f24a16ca640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f249c147530 0x7f249c1dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f24a16ca640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f249c14b020 0x7f249c1e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:52.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f24a16ca640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f249c144e50 con 0x7f249c147530 2024-04-24T22:59:52.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f24a16ca640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f249c0afb50 con 0x7f249c14b020 2024-04-24T22:59:52.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f24a16ca640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f249c144fd0 con 0x7f249c061e90 2024-04-24T22:59:52.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f249b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f249c14b020 0x7f249c1e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f249affd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f249c061e90 0x7f249c1491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f249b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f249c14b020 0x7f249c1e00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57436/0 (socket says 172.21.15.162:57436) 2024-04-24T22:59:52.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f249b7fe640 1 -- 172.21.15.162:0/155968723 learned_addr learned my addr 172.21.15.162:0/155968723 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-24T22:59:52.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f249a7fc640 1 --2- 172.21.15.162:0/155968723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f249c147530 0x7f249c1dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:52.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f249affd640 1 -- 172.21.15.162:0/155968723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f249c14b020 msgr2=0x7f249c1e00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f249affd640 1 --2- 172.21.15.162:0/155968723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f249c14b020 0x7f249c1e00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f249affd640 1 -- 172.21.15.162:0/155968723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f249c147530 msgr2=0x7f249c1dfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f249affd640 1 --2- 172.21.15.162:0/155968723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f249c147530 0x7f249c1dfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f249affd640 1 -- 172.21.15.162:0/155968723 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249c14a940 con 0x7f249c061e90 2024-04-24T22:59:52.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f249b7fe640 1 --2- 172.21.15.162:0/155968723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f249c14b020 0x7f249c1e00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T22:59:52.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f249a7fc640 1 --2- 172.21.15.162:0/155968723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f249c147530 0x7f249c1dfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T22:59:52.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f249affd640 1 --2- 172.21.15.162:0/155968723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f249c061e90 0x7f249c1491e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f24940ab000 tx=0x7f24940191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:52.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f24837fe640 1 -- 172.21.15.162:0/155968723 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24940b0040 con 0x7f249c061e90 2024-04-24T22:59:52.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f24837fe640 1 -- 172.21.15.162:0/155968723 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24940b4440 con 0x7f249c061e90 2024-04-24T22:59:52.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f24837fe640 1 -- 172.21.15.162:0/155968723 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24940b4810 con 0x7f249c061e90 2024-04-24T22:59:52.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f24a16ca640 1 -- 172.21.15.162:0/155968723 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f249c071760 con 0x7f249c061e90 2024-04-24T22:59:52.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f24a16ca640 1 -- 172.21.15.162:0/155968723 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f249c13c640 con 0x7f249c061e90 2024-04-24T22:59:52.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f24837fe640 1 -- 172.21.15.162:0/155968723 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f24940bb020 con 0x7f249c061e90 2024-04-24T22:59:52.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f24837fe640 1 -- 172.21.15.162:0/155968723 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f24940bdda0 con 0x7f249c061e90 2024-04-24T22:59:52.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.907+0000 7f24a16ca640 1 -- 172.21.15.162:0/155968723 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f249c04f580 con 0x7f249c061e90 2024-04-24T22:59:52.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.911+0000 7f24837fe640 1 -- 172.21.15.162:0/155968723 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f24940c2020 con 0x7f249c061e90 2024-04-24T22:59:52.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.979+0000 7f24a16ca640 1 -- 172.21.15.162:0/155968723 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "616f92c4-db5d-4167-8d08-c7a9d999fe81", "id": 3} v 0) -- 0x7f249c1468d0 con 0x7f249c061e90 2024-04-24T22:59:52.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.983+0000 7f24837fe640 1 -- 172.21.15.162:0/155968723 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "616f92c4-db5d-4167-8d08-c7a9d999fe81", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f2494016150 con 0x7f249c061e90 2024-04-24T22:59:52.985 INFO:teuthology.orchestra.run.smithi162.stdout:3 2024-04-24T22:59:52.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.983+0000 7f24a16ca640 1 -- 172.21.15.162:0/155968723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f249c061e90 msgr2=0x7f249c1491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:52.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.983+0000 7f24a16ca640 1 --2- 172.21.15.162:0/155968723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f249c061e90 0x7f249c1491e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f24940ab000 tx=0x7f24940191e0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.983+0000 7f24a16ca640 1 -- 172.21.15.162:0/155968723 shutdown_connections 2024-04-24T22:59:52.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.983+0000 7f24a16ca640 1 --2- 172.21.15.162:0/155968723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f249c14b020 0x7f249c1e00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.983+0000 7f24a16ca640 1 --2- 172.21.15.162:0/155968723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f249c147530 0x7f249c1dfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.983+0000 7f24a16ca640 1 --2- 172.21.15.162:0/155968723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f249c061e90 0x7f249c1491e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:52.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.983+0000 7f24a16ca640 1 -- 172.21.15.162:0/155968723 >> 172.21.15.162:0/155968723 conn(0x7f249c06b9f0 msgr2=0x7f249c0b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:52.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.983+0000 7f24a16ca640 1 -- 172.21.15.162:0/155968723 shutdown_connections 2024-04-24T22:59:52.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:52.983+0000 7f24a16ca640 1 -- 172.21.15.162:0/155968723 wait complete. 2024-04-24T22:59:53.002 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 1067858b-54f4-4223-aef0-d91d33711fd6 4 2024-04-24T22:59:53.108 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:53.104+0000 7f33e86d5180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T22:59:53.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.111+0000 7fe579969640 1 Processor -- start 2024-04-24T22:59:53.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.111+0000 7fe579969640 1 -- start start 2024-04-24T22:59:53.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.111+0000 7fe579969640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe574072e00 0x7fe5740b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.111+0000 7fe579969640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5740b74f0 con 0x7fe57414ada0 2024-04-24T22:59:53.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.111+0000 7fe579969640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5740731e0 con 0x7fe574141550 2024-04-24T22:59:53.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.111+0000 7fe579969640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe5740b6de0 con 0x7fe574072e00 2024-04-24T22:59:53.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.111+0000 7fe572ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe574072e00 0x7fe5740b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.111+0000 7fe572ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe574072e00 0x7fe5740b68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:46060/0 (socket says 172.21.15.162:46060) 2024-04-24T22:59:53.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.111+0000 7fe572ffd640 1 -- 172.21.15.162:0/4258414480 learned_addr learned my addr 172.21.15.162:0/4258414480 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-24T22:59:53.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.115+0000 7fe572ffd640 1 -- 172.21.15.162:0/4258414480 >> v1:172.21.15.162:6789/0 conn(0x7fe574141550 legacy=0x7fe5741419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.115+0000 7fe571ffb640 1 -- 172.21.15.162:0/4258414480 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1825075421 0 0) 0x7fe5740731e0 con 0x7fe574141550 2024-04-24T22:59:53.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.115+0000 7fe572ffd640 1 -- 172.21.15.162:0/4258414480 >> v1:172.21.15.43:6789/0 conn(0x7fe57414ada0 legacy=0x7fe57414b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.115+0000 7fe572ffd640 1 -- 172.21.15.162:0/4258414480 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5740b59d0 con 0x7fe574072e00 2024-04-24T22:59:53.118 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.115+0000 7fe572ffd640 1 --2- 172.21.15.162:0/4258414480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe574072e00 0x7fe5740b68a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe5640098a0 tx=0x7fe56401c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b951bcf4655966d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:53.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.115+0000 7fe571ffb640 1 -- 172.21.15.162:0/4258414480 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5640b0070 con 0x7fe574072e00 2024-04-24T22:59:53.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.115+0000 7fe571ffb640 1 -- 172.21.15.162:0/4258414480 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5640ab600 con 0x7fe574072e00 2024-04-24T22:59:53.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.115+0000 7fe571ffb640 1 -- 172.21.15.162:0/4258414480 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5640ab9d0 con 0x7fe574072e00 2024-04-24T22:59:53.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.115+0000 7fe579969640 1 -- 172.21.15.162:0/4258414480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe574072e00 msgr2=0x7fe5740b68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.115+0000 7fe579969640 1 --2- 172.21.15.162:0/4258414480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe574072e00 0x7fe5740b68a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe5640098a0 tx=0x7fe56401c460 comp rx=0 tx=0).stop 2024-04-24T22:59:53.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.115+0000 7fe579969640 1 -- 172.21.15.162:0/4258414480 shutdown_connections 2024-04-24T22:59:53.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.115+0000 7fe579969640 1 --2- 172.21.15.162:0/4258414480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe574072e00 0x7fe5740b68a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.115+0000 7fe579969640 1 -- 172.21.15.162:0/4258414480 >> 172.21.15.162:0/4258414480 conn(0x7fe5740b7880 msgr2=0x7fe5740b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:53.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.115+0000 7fe579969640 1 -- 172.21.15.162:0/4258414480 shutdown_connections 2024-04-24T22:59:53.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.115+0000 7fe579969640 1 -- 172.21.15.162:0/4258414480 wait complete. 2024-04-24T22:59:53.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe579969640 1 Processor -- start 2024-04-24T22:59:53.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe579969640 1 -- start start 2024-04-24T22:59:53.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe579969640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe574072e00 0x7fe574145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe579969640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe574141550 0x7fe574146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe579969640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe57414ada0 0x7fe5741448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe579969640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe574155a30 con 0x7fe574141550 2024-04-24T22:59:53.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe579969640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe5740b5d40 con 0x7fe574072e00 2024-04-24T22:59:53.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe579969640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe574155bb0 con 0x7fe57414ada0 2024-04-24T22:59:53.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe572ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe574072e00 0x7fe574145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe5737fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe57414ada0 0x7fe5741448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe572ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe574072e00 0x7fe574145c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57452/0 (socket says 172.21.15.162:57452) 2024-04-24T22:59:53.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe572ffd640 1 -- 172.21.15.162:0/2433380321 learned_addr learned my addr 172.21.15.162:0/2433380321 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-24T22:59:53.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe5727fc640 1 --2- 172.21.15.162:0/2433380321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe574141550 0x7fe574146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe5737fe640 1 -- 172.21.15.162:0/2433380321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe574072e00 msgr2=0x7fe574145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe5737fe640 1 --2- 172.21.15.162:0/2433380321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe574072e00 0x7fe574145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe5737fe640 1 -- 172.21.15.162:0/2433380321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe574141550 msgr2=0x7fe574146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe5737fe640 1 --2- 172.21.15.162:0/2433380321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe574141550 0x7fe574146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe5737fe640 1 -- 172.21.15.162:0/2433380321 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5741479c0 con 0x7fe57414ada0 2024-04-24T22:59:53.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe572ffd640 1 --2- 172.21.15.162:0/2433380321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe574072e00 0x7fe574145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T22:59:53.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe5737fe640 1 --2- 172.21.15.162:0/2433380321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe57414ada0 0x7fe5741448c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe57414b910 tx=0x7fe56c00cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:53.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe55bfff640 1 -- 172.21.15.162:0/2433380321 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c003b80 con 0x7fe57414ada0 2024-04-24T22:59:53.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe55bfff640 1 -- 172.21.15.162:0/2433380321 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe56c003d20 con 0x7fe57414ada0 2024-04-24T22:59:53.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe579969640 1 -- 172.21.15.162:0/2433380321 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe574140b80 con 0x7fe57414ada0 2024-04-24T22:59:53.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe55bfff640 1 -- 172.21.15.162:0/2433380321 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c005310 con 0x7fe57414ada0 2024-04-24T22:59:53.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe579969640 1 -- 172.21.15.162:0/2433380321 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5741e0340 con 0x7fe57414ada0 2024-04-24T22:59:53.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe55bfff640 1 -- 172.21.15.162:0/2433380321 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe56c0054b0 con 0x7fe57414ada0 2024-04-24T22:59:53.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe55bfff640 1 -- 172.21.15.162:0/2433380321 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe56c012930 con 0x7fe57414ada0 2024-04-24T22:59:53.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.119+0000 7fe579969640 1 -- 172.21.15.162:0/2433380321 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe57404f580 con 0x7fe57414ada0 2024-04-24T22:59:53.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.123+0000 7fe55bfff640 1 -- 172.21.15.162:0/2433380321 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe5740b74f0 con 0x7fe57414ada0 2024-04-24T22:59:53.135 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:53.131+0000 7f4af1dae180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T22:59:53.164 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:53.160+0000 7f33e86d5180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T22:59:53.189 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:53.187+0000 7f4af1dae180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T22:59:53.193 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.191+0000 7fe579969640 1 -- 172.21.15.162:0/2433380321 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1067858b-54f4-4223-aef0-d91d33711fd6", "id": 4} v 0) -- 0x7fe57413be40 con 0x7fe57414ada0 2024-04-24T22:59:53.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.195+0000 7fe55bfff640 1 -- 172.21.15.162:0/2433380321 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1067858b-54f4-4223-aef0-d91d33711fd6", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fe56c012bd0 con 0x7fe57414ada0 2024-04-24T22:59:53.198 INFO:teuthology.orchestra.run.smithi162.stdout:4 2024-04-24T22:59:53.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.195+0000 7fe579969640 1 -- 172.21.15.162:0/2433380321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe57414ada0 msgr2=0x7fe5741448c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.195+0000 7fe579969640 1 --2- 172.21.15.162:0/2433380321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe57414ada0 0x7fe5741448c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe57414b910 tx=0x7fe56c00cb90 comp rx=0 tx=0).stop 2024-04-24T22:59:53.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.195+0000 7fe579969640 1 -- 172.21.15.162:0/2433380321 shutdown_connections 2024-04-24T22:59:53.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.195+0000 7fe579969640 1 --2- 172.21.15.162:0/2433380321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe57414ada0 0x7fe5741448c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.195+0000 7fe579969640 1 --2- 172.21.15.162:0/2433380321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe574141550 0x7fe574146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.195+0000 7fe579969640 1 --2- 172.21.15.162:0/2433380321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe574072e00 0x7fe574145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.195+0000 7fe579969640 1 -- 172.21.15.162:0/2433380321 >> 172.21.15.162:0/2433380321 conn(0x7fe5740b7880 msgr2=0x7fe5740722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:53.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.195+0000 7fe579969640 1 -- 172.21.15.162:0/2433380321 shutdown_connections 2024-04-24T22:59:53.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.195+0000 7fe579969640 1 -- 172.21.15.162:0/2433380321 wait complete. 2024-04-24T22:59:53.215 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 781ecc98-c6be-4e7a-bacc-afd91a7e8bd2 5 2024-04-24T22:59:53.221 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:53.216+0000 7f33e86d5180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T22:59:53.245 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:53.243+0000 7f4af1dae180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T22:59:53.300 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:53.296+0000 7f33e86d5180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T22:59:53.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.319+0000 7f8bf01a3640 1 Processor -- start 2024-04-24T22:59:53.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.319+0000 7f8bf01a3640 1 -- start start 2024-04-24T22:59:53.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.319+0000 7f8bf01a3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8be8061e90 0x7f8be8144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.319+0000 7f8bf01a3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8be813e190 0x7f8be813e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.319+0000 7f8bf01a3640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8be8070650 con 0x7f8be8147830 2024-04-24T22:59:53.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.319+0000 7f8bf01a3640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8be8144f40 con 0x7f8be8061e90 2024-04-24T22:59:53.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.319+0000 7f8bf01a3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8be8070930 con 0x7f8be813e190 2024-04-24T22:59:53.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.319+0000 7f8bedf3f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8be8061e90 0x7f8be8144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.319+0000 7f8bed73e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8be813e190 0x7f8be813e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.319+0000 7f8bedf3f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8be8061e90 0x7f8be8144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57464/0 (socket says 172.21.15.162:57464) 2024-04-24T22:59:53.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.319+0000 7f8bedf3f640 1 -- 172.21.15.162:0/1806631859 learned_addr learned my addr 172.21.15.162:0/1806631859 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-24T22:59:53.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.319+0000 7f8bedf3f640 1 -- 172.21.15.162:0/1806631859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8be813e190 msgr2=0x7f8be813e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:53.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.319+0000 7f8bedf3f640 1 --2- 172.21.15.162:0/1806631859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8be813e190 0x7f8be813e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.319+0000 7f8bedf3f640 1 -- 172.21.15.162:0/1806631859 >> v1:172.21.15.43:6789/0 conn(0x7f8be8147830 legacy=0x7f8be8147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:53.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.319+0000 7f8bedf3f640 1 -- 172.21.15.162:0/1806631859 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be81448f0 con 0x7f8be8061e90 2024-04-24T22:59:53.325 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:53.323+0000 7f4af1dae180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T22:59:53.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.323+0000 7f8bedf3f640 1 --2- 172.21.15.162:0/1806631859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be8061e90 0x7f8be8144260 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8be81450c0 tx=0x7f8be401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ecaad659d52b951 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:53.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.323+0000 7f8becf3d640 1 -- 172.21.15.162:0/1806631859 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be40b1070 con 0x7f8be8061e90 2024-04-24T22:59:53.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.323+0000 7f8becf3d640 1 -- 172.21.15.162:0/1806631859 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be40a8050 con 0x7f8be8061e90 2024-04-24T22:59:53.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.323+0000 7f8becf3d640 1 -- 172.21.15.162:0/1806631859 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be40ac860 con 0x7f8be8061e90 2024-04-24T22:59:53.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.323+0000 7f8bf01a3640 1 -- 172.21.15.162:0/1806631859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be8061e90 msgr2=0x7f8be8144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.323+0000 7f8bf01a3640 1 --2- 172.21.15.162:0/1806631859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be8061e90 0x7f8be8144260 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8be81450c0 tx=0x7f8be401c440 comp rx=0 tx=0).stop 2024-04-24T22:59:53.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.323+0000 7f8bf01a3640 1 -- 172.21.15.162:0/1806631859 shutdown_connections 2024-04-24T22:59:53.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.323+0000 7f8bf01a3640 1 --2- 172.21.15.162:0/1806631859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8be813e190 0x7f8be813e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.323+0000 7f8bf01a3640 1 --2- 172.21.15.162:0/1806631859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be8061e90 0x7f8be8144260 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.323+0000 7f8bf01a3640 1 -- 172.21.15.162:0/1806631859 >> 172.21.15.162:0/1806631859 conn(0x7f8be806b9f0 msgr2=0x7f8be80b93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:53.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.323+0000 7f8bf01a3640 1 -- 172.21.15.162:0/1806631859 shutdown_connections 2024-04-24T22:59:53.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.323+0000 7f8bf01a3640 1 -- 172.21.15.162:0/1806631859 wait complete. 2024-04-24T22:59:53.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bf01a3640 1 Processor -- start 2024-04-24T22:59:53.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bf01a3640 1 -- start start 2024-04-24T22:59:53.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bf01a3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8be8061e90 0x7f8be80b7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bf01a3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be813e190 0x7f8be80b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bf01a3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be8147830 0x7f8be81ddb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bf01a3640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8be814f550 con 0x7f8be813e190 2024-04-24T22:59:53.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bf01a3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8be814f3d0 con 0x7f8be8147830 2024-04-24T22:59:53.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bf01a3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8be814f6d0 con 0x7f8be8061e90 2024-04-24T22:59:53.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bedf3f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8be8061e90 0x7f8be80b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bee740640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be8147830 0x7f8be81ddb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bedf3f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8be8061e90 0x7f8be80b7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:46080/0 (socket says 172.21.15.162:46080) 2024-04-24T22:59:53.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bee740640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be8147830 0x7f8be81ddb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57472/0 (socket says 172.21.15.162:57472) 2024-04-24T22:59:53.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bedf3f640 1 -- 172.21.15.162:0/706591559 learned_addr learned my addr 172.21.15.162:0/706591559 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-24T22:59:53.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bed73e640 1 --2- 172.21.15.162:0/706591559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be813e190 0x7f8be80b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bedf3f640 1 -- 172.21.15.162:0/706591559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be8147830 msgr2=0x7f8be81ddb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bedf3f640 1 --2- 172.21.15.162:0/706591559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be8147830 0x7f8be81ddb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bedf3f640 1 -- 172.21.15.162:0/706591559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be813e190 msgr2=0x7f8be80b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bedf3f640 1 --2- 172.21.15.162:0/706591559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be813e190 0x7f8be80b7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bedf3f640 1 -- 172.21.15.162:0/706591559 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be80b8410 con 0x7f8be8061e90 2024-04-24T22:59:53.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bedf3f640 1 --2- 172.21.15.162:0/706591559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8be8061e90 0x7f8be80b7440 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8be40af040 tx=0x7f8be401ac80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:53.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bda7fc640 1 -- 172.21.15.162:0/706591559 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be40bb020 con 0x7f8be8061e90 2024-04-24T22:59:53.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bda7fc640 1 -- 172.21.15.162:0/706591559 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be40acdf0 con 0x7f8be8061e90 2024-04-24T22:59:53.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bf01a3640 1 -- 172.21.15.162:0/706591559 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be8144240 con 0x7f8be8061e90 2024-04-24T22:59:53.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bda7fc640 1 -- 172.21.15.162:0/706591559 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be40b1040 con 0x7f8be8061e90 2024-04-24T22:59:53.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bf01a3640 1 -- 172.21.15.162:0/706591559 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be8142e30 con 0x7f8be8061e90 2024-04-24T22:59:53.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bf01a3640 1 -- 172.21.15.162:0/706591559 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be804f580 con 0x7f8be8061e90 2024-04-24T22:59:53.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bda7fc640 1 -- 172.21.15.162:0/706591559 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8be40be020 con 0x7f8be8061e90 2024-04-24T22:59:53.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.327+0000 7f8bda7fc640 1 -- 172.21.15.162:0/706591559 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f8be40ab3e0 con 0x7f8be8061e90 2024-04-24T22:59:53.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.331+0000 7f8bda7fc640 1 -- 172.21.15.162:0/706591559 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8be40c5030 con 0x7f8be8061e90 2024-04-24T22:59:53.354 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:53.352+0000 7f33e86d5180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T22:59:53.380 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:53.375+0000 7f4af1dae180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T22:59:53.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.395+0000 7f8bf01a3640 1 -- 172.21.15.162:0/706591559 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "781ecc98-c6be-4e7a-bacc-afd91a7e8bd2", "id": 5} v 0) -- 0x7f8be8146fa0 con 0x7f8be8061e90 2024-04-24T22:59:53.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.399+0000 7f8bda7fc640 1 -- 172.21.15.162:0/706591559 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "781ecc98-c6be-4e7a-bacc-afd91a7e8bd2", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f8be80b8410 con 0x7f8be8061e90 2024-04-24T22:59:53.403 INFO:teuthology.orchestra.run.smithi162.stdout:5 2024-04-24T22:59:53.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.399+0000 7f8bf01a3640 1 -- 172.21.15.162:0/706591559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8be8061e90 msgr2=0x7f8be80b7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.399+0000 7f8bf01a3640 1 --2- 172.21.15.162:0/706591559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8be8061e90 0x7f8be80b7440 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8be40af040 tx=0x7f8be401ac80 comp rx=0 tx=0).stop 2024-04-24T22:59:53.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.403+0000 7f8bf01a3640 1 -- 172.21.15.162:0/706591559 shutdown_connections 2024-04-24T22:59:53.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.403+0000 7f8bf01a3640 1 --2- 172.21.15.162:0/706591559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8be8147830 0x7f8be81ddb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.403+0000 7f8bf01a3640 1 --2- 172.21.15.162:0/706591559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be813e190 0x7f8be80b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.403+0000 7f8bf01a3640 1 --2- 172.21.15.162:0/706591559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8be8061e90 0x7f8be80b7440 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.403+0000 7f8bf01a3640 1 -- 172.21.15.162:0/706591559 >> 172.21.15.162:0/706591559 conn(0x7f8be806b9f0 msgr2=0x7f8be80b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:53.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.403+0000 7f8bf01a3640 1 -- 172.21.15.162:0/706591559 shutdown_connections 2024-04-24T22:59:53.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.403+0000 7f8bf01a3640 1 -- 172.21.15.162:0/706591559 wait complete. 2024-04-24T22:59:53.420 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 7819a72c-42d8-4699-b5da-c2321f36bab2 6 2024-04-24T22:59:53.435 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:53.432+0000 7f33e86d5180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T22:59:53.459 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:53.455+0000 7f4af1dae180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T22:59:53.491 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:53.488+0000 7f33e86d5180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T22:59:53.518 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:53.511+0000 7f4af1dae180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T22:59:53.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.563+0000 7fdffcb76640 1 Processor -- start 2024-04-24T22:59:53.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.563+0000 7fdffcb76640 1 -- start start 2024-04-24T22:59:53.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdffcb76640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdff8145c50 0x7fdff8150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdffcb76640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff80705f0 con 0x7fdff8073080 2024-04-24T22:59:53.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdffcb76640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff80b6b00 con 0x7fdff806f430 2024-04-24T22:59:53.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdffcb76640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdff80b68b0 con 0x7fdff8145c50 2024-04-24T22:59:53.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdff659c640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fdff806f430 0x7fdff80b17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:59540/0 (socket says 172.21.15.162:59540) 2024-04-24T22:59:53.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdff659c640 1 -- 172.21.15.162:0/2321526473 learned_addr learned my addr 172.21.15.162:0/2321526473 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-24T22:59:53.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdff6d9d640 1 --2- 172.21.15.162:0/2321526473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdff8145c50 0x7fdff8150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdff559a640 1 -- 172.21.15.162:0/2321526473 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593016138 0 0) 0x7fdff80b6b00 con 0x7fdff806f430 2024-04-24T22:59:53.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdff559a640 1 -- 172.21.15.162:0/2321526473 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfe0003530 con 0x7fdff806f430 2024-04-24T22:59:53.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdff6d9d640 1 -- 172.21.15.162:0/2321526473 >> v1:172.21.15.162:6789/0 conn(0x7fdff806f430 legacy=0x7fdff80b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdff6d9d640 1 -- 172.21.15.162:0/2321526473 >> v1:172.21.15.43:6789/0 conn(0x7fdff8073080 legacy=0x7fdff8145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:53.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdff6d9d640 1 -- 172.21.15.162:0/2321526473 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff80b6de0 con 0x7fdff8145c50 2024-04-24T22:59:53.571 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdff6d9d640 1 --2- 172.21.15.162:0/2321526473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdff8145c50 0x7fdff8150ce0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009dc0 tx=0x7fdff001c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1239c6d3557207fc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:53.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdff559a640 1 -- 172.21.15.162:0/2321526473 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff00b2070 con 0x7fdff8145c50 2024-04-24T22:59:53.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdff559a640 1 -- 172.21.15.162:0/2321526473 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff00a5840 con 0x7fdff8145c50 2024-04-24T22:59:53.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdff559a640 1 -- 172.21.15.162:0/2321526473 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff00a5c10 con 0x7fdff8145c50 2024-04-24T22:59:53.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdffcb76640 1 -- 172.21.15.162:0/2321526473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdff8145c50 msgr2=0x7fdff8150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdffcb76640 1 --2- 172.21.15.162:0/2321526473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdff8145c50 0x7fdff8150ce0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009dc0 tx=0x7fdff001c830 comp rx=0 tx=0).stop 2024-04-24T22:59:53.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdffcb76640 1 -- 172.21.15.162:0/2321526473 shutdown_connections 2024-04-24T22:59:53.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdffcb76640 1 --2- 172.21.15.162:0/2321526473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdff8145c50 0x7fdff8150ce0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdffcb76640 1 -- 172.21.15.162:0/2321526473 >> 172.21.15.162:0/2321526473 conn(0x7fdff80b7880 msgr2=0x7fdff80b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:53.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdffcb76640 1 -- 172.21.15.162:0/2321526473 shutdown_connections 2024-04-24T22:59:53.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.567+0000 7fdffcb76640 1 -- 172.21.15.162:0/2321526473 wait complete. 2024-04-24T22:59:53.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdffcb76640 1 Processor -- start 2024-04-24T22:59:53.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdffcb76640 1 -- start start 2024-04-24T22:59:53.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdffcb76640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdff806f430 0x7fdff813a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdffcb76640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdff8073080 0x7fdff80b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.575 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdffcb76640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff8145c50 0x7fdff80b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdffcb76640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdff8070340 con 0x7fdff8145c50 2024-04-24T22:59:53.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdffcb76640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdff80701c0 con 0x7fdff8073080 2024-04-24T22:59:53.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdffcb76640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdff8153a40 con 0x7fdff806f430 2024-04-24T22:59:53.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdff659c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdff806f430 0x7fdff813a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdff5d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdff8073080 0x7fdff80b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdff659c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdff806f430 0x7fdff813a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:46104/0 (socket says 172.21.15.162:46104) 2024-04-24T22:59:53.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdff659c640 1 -- 172.21.15.162:0/700566829 learned_addr learned my addr 172.21.15.162:0/700566829 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-24T22:59:53.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdff6d9d640 1 --2- 172.21.15.162:0/700566829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff8145c50 0x7fdff80b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdff659c640 1 -- 172.21.15.162:0/700566829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdff8073080 msgr2=0x7fdff80b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdff659c640 1 --2- 172.21.15.162:0/700566829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdff8073080 0x7fdff80b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdff659c640 1 -- 172.21.15.162:0/700566829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff8145c50 msgr2=0x7fdff80b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdff659c640 1 --2- 172.21.15.162:0/700566829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff8145c50 0x7fdff80b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdff659c640 1 -- 172.21.15.162:0/700566829 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff8148dc0 con 0x7fdff806f430 2024-04-24T22:59:53.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdff5d9b640 1 --2- 172.21.15.162:0/700566829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdff8073080 0x7fdff80b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T22:59:53.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdff659c640 1 --2- 172.21.15.162:0/700566829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdff806f430 0x7fdff813a320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800c480 tx=0x7fdfe800c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:53.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdfe6ffd640 1 -- 172.21.15.162:0/700566829 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8017070 con 0x7fdff806f430 2024-04-24T22:59:53.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdfe6ffd640 1 -- 172.21.15.162:0/700566829 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe8005cf0 con 0x7fdff806f430 2024-04-24T22:59:53.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdfe6ffd640 1 -- 172.21.15.162:0/700566829 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8007290 con 0x7fdff806f430 2024-04-24T22:59:53.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdffcb76640 1 -- 172.21.15.162:0/700566829 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff81480e0 con 0x7fdff806f430 2024-04-24T22:59:53.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdffcb76640 1 -- 172.21.15.162:0/700566829 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff8149040 con 0x7fdff806f430 2024-04-24T22:59:53.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdfe6ffd640 1 -- 172.21.15.162:0/700566829 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdfe801a070 con 0x7fdff806f430 2024-04-24T22:59:53.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdfe6ffd640 1 -- 172.21.15.162:0/700566829 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fdfe80129f0 con 0x7fdff806f430 2024-04-24T22:59:53.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.571+0000 7fdffcb76640 1 -- 172.21.15.162:0/700566829 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff804f560 con 0x7fdff806f430 2024-04-24T22:59:53.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.575+0000 7fdfe6ffd640 1 -- 172.21.15.162:0/700566829 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fdfe8021020 con 0x7fdff806f430 2024-04-24T22:59:53.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.639+0000 7fdffcb76640 1 -- 172.21.15.162:0/700566829 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7819a72c-42d8-4699-b5da-c2321f36bab2", "id": 6} v 0) -- 0x7fdff8147e00 con 0x7fdff806f430 2024-04-24T22:59:53.648 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:53.644+0000 7f33e86d5180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T22:59:53.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.651+0000 7fdfe6ffd640 1 -- 172.21.15.162:0/700566829 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7819a72c-42d8-4699-b5da-c2321f36bab2", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fdff8148dc0 con 0x7fdff806f430 2024-04-24T22:59:53.653 INFO:teuthology.orchestra.run.smithi162.stdout:6 2024-04-24T22:59:53.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.651+0000 7fdffcb76640 1 -- 172.21.15.162:0/700566829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdff806f430 msgr2=0x7fdff813a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.651+0000 7fdffcb76640 1 --2- 172.21.15.162:0/700566829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdff806f430 0x7fdff813a320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800c480 tx=0x7fdfe800c940 comp rx=0 tx=0).stop 2024-04-24T22:59:53.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.651+0000 7fdffcb76640 1 -- 172.21.15.162:0/700566829 shutdown_connections 2024-04-24T22:59:53.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.651+0000 7fdffcb76640 1 --2- 172.21.15.162:0/700566829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff8145c50 0x7fdff80b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.651+0000 7fdffcb76640 1 --2- 172.21.15.162:0/700566829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdff8073080 0x7fdff80b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.651+0000 7fdffcb76640 1 --2- 172.21.15.162:0/700566829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdff806f430 0x7fdff813a320 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.651+0000 7fdffcb76640 1 -- 172.21.15.162:0/700566829 >> 172.21.15.162:0/700566829 conn(0x7fdff80b7880 msgr2=0x7fdff8143340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:53.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.651+0000 7fdffcb76640 1 -- 172.21.15.162:0/700566829 shutdown_connections 2024-04-24T22:59:53.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.651+0000 7fdffcb76640 1 -- 172.21.15.162:0/700566829 wait complete. 2024-04-24T22:59:53.670 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 11f817d6-d19a-4326-aa63-61a72c39f5af 7 2024-04-24T22:59:53.673 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:53.671+0000 7f4af1dae180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T22:59:53.713 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:53.708+0000 7f33e86d5180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T22:59:53.737 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:53.735+0000 7f4af1dae180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T22:59:53.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.783+0000 7ff68fb37640 1 Processor -- start 2024-04-24T22:59:53.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.783+0000 7ff68fb37640 1 -- start start 2024-04-24T22:59:53.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.783+0000 7ff68fb37640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff688061e90 0x7ff68814b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.783+0000 7ff68fb37640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6880aea60 0x7ff6881445d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68fb37640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff688062270 con 0x7ff6880af980 2024-04-24T22:59:53.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68fb37640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff68814ab10 con 0x7ff688061e90 2024-04-24T22:59:53.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68fb37640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff68814adf0 con 0x7ff6880aea60 2024-04-24T22:59:53.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68d8d3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff688061e90 0x7ff68814b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68d0d2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6880aea60 0x7ff6881445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68d0d2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6880aea60 0x7ff6881445d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:46116/0 (socket says 172.21.15.162:46116) 2024-04-24T22:59:53.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68d0d2640 1 -- 172.21.15.162:0/2800357140 learned_addr learned my addr 172.21.15.162:0/2800357140 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-24T22:59:53.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68d8d3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff688061e90 0x7ff68814b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57486/0 (socket says 172.21.15.162:57486) 2024-04-24T22:59:53.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68d0d2640 1 -- 172.21.15.162:0/2800357140 >> v2:172.21.15.162:3300/0 conn(0x7ff688061e90 msgr2=0x7ff68814b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:53.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68d0d2640 1 --2- 172.21.15.162:0/2800357140 >> v2:172.21.15.162:3300/0 conn(0x7ff688061e90 0x7ff68814b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68d0d2640 1 -- 172.21.15.162:0/2800357140 >> v1:172.21.15.43:6789/0 conn(0x7ff6880af980 legacy=0x7ff6880b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:53.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68d0d2640 1 -- 172.21.15.162:0/2800357140 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6880afed0 con 0x7ff6880aea60 2024-04-24T22:59:53.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68d8d3640 1 --2- 172.21.15.162:0/2800357140 >> v2:172.21.15.162:3300/0 conn(0x7ff688061e90 0x7ff68814b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T22:59:53.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68d0d2640 1 --2- 172.21.15.162:0/2800357140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6880aea60 0x7ff6881445d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff68814ac90 tx=0x7ff67801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cdcc95e32dfab34 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:53.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68c8d1640 1 -- 172.21.15.162:0/2800357140 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6780ab5f0 con 0x7ff6880aea60 2024-04-24T22:59:53.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68c8d1640 1 -- 172.21.15.162:0/2800357140 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6780b0070 con 0x7ff6880aea60 2024-04-24T22:59:53.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.787+0000 7ff68c8d1640 1 -- 172.21.15.162:0/2800357140 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6780ab9b0 con 0x7ff6880aea60 2024-04-24T22:59:53.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 -- 172.21.15.162:0/2800357140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6880aea60 msgr2=0x7ff6881445d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 --2- 172.21.15.162:0/2800357140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6880aea60 0x7ff6881445d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff68814ac90 tx=0x7ff67801c3f0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 -- 172.21.15.162:0/2800357140 shutdown_connections 2024-04-24T22:59:53.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 --2- 172.21.15.162:0/2800357140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6880aea60 0x7ff6881445d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 --2- 172.21.15.162:0/2800357140 >> v2:172.21.15.162:3300/0 conn(0x7ff688061e90 0x7ff68814b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 -- 172.21.15.162:0/2800357140 >> 172.21.15.162:0/2800357140 conn(0x7ff68806b9f0 msgr2=0x7ff6880b93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:53.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 -- 172.21.15.162:0/2800357140 shutdown_connections 2024-04-24T22:59:53.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 -- 172.21.15.162:0/2800357140 wait complete. 2024-04-24T22:59:53.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 Processor -- start 2024-04-24T22:59:53.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 -- start start 2024-04-24T22:59:53.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688061e90 0x7ff688149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6880af980 0x7ff68813bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff68814a360 0x7ff68813c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:53.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff688154e60 con 0x7ff6880af980 2024-04-24T22:59:53.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff688144f20 con 0x7ff68814a360 2024-04-24T22:59:53.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff688154fe0 con 0x7ff688061e90 2024-04-24T22:59:53.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68d8d3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688061e90 0x7ff688149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68d8d3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688061e90 0x7ff688149150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:46128/0 (socket says 172.21.15.162:46128) 2024-04-24T22:59:53.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68e0d4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff68814a360 0x7ff68813c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68d8d3640 1 -- 172.21.15.162:0/4264943755 learned_addr learned my addr 172.21.15.162:0/4264943755 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-24T22:59:53.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68d0d2640 1 --2- 172.21.15.162:0/4264943755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6880af980 0x7ff68813bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:53.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68d8d3640 1 -- 172.21.15.162:0/4264943755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff68814a360 msgr2=0x7ff68813c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68d8d3640 1 --2- 172.21.15.162:0/4264943755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff68814a360 0x7ff68813c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68d8d3640 1 -- 172.21.15.162:0/4264943755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6880af980 msgr2=0x7ff68813bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68d8d3640 1 --2- 172.21.15.162:0/4264943755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6880af980 0x7ff68813bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68d8d3640 1 -- 172.21.15.162:0/4264943755 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68813b9a0 con 0x7ff688061e90 2024-04-24T22:59:53.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68d8d3640 1 --2- 172.21.15.162:0/4264943755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688061e90 0x7ff688149150 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff684009f60 tx=0x7ff684009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:53.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff67e7fc640 1 -- 172.21.15.162:0/4264943755 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684018020 con 0x7ff688061e90 2024-04-24T22:59:53.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff67e7fc640 1 -- 172.21.15.162:0/4264943755 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff684014680 con 0x7ff688061e90 2024-04-24T22:59:53.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 -- 172.21.15.162:0/4264943755 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff68813e280 con 0x7ff688061e90 2024-04-24T22:59:53.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff67e7fc640 1 -- 172.21.15.162:0/4264943755 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684014a50 con 0x7ff688061e90 2024-04-24T22:59:53.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 -- 172.21.15.162:0/4264943755 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff688149690 con 0x7ff688061e90 2024-04-24T22:59:53.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff67e7fc640 1 -- 172.21.15.162:0/4264943755 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff68401b020 con 0x7ff688061e90 2024-04-24T22:59:53.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff67e7fc640 1 -- 172.21.15.162:0/4264943755 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff68401da60 con 0x7ff688061e90 2024-04-24T22:59:53.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.791+0000 7ff68fb37640 1 -- 172.21.15.162:0/4264943755 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff68804f580 con 0x7ff688061e90 2024-04-24T22:59:53.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.795+0000 7ff67e7fc640 1 -- 172.21.15.162:0/4264943755 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff684022030 con 0x7ff688061e90 2024-04-24T22:59:53.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.863+0000 7ff68fb37640 1 -- 172.21.15.162:0/4264943755 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "11f817d6-d19a-4326-aa63-61a72c39f5af", "id": 7} v 0) -- 0x7ff68806c810 con 0x7ff688061e90 2024-04-24T22:59:53.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.875+0000 7ff67e7fc640 1 -- 172.21.15.162:0/4264943755 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "11f817d6-d19a-4326-aa63-61a72c39f5af", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff684010040 con 0x7ff688061e90 2024-04-24T22:59:53.877 INFO:teuthology.orchestra.run.smithi162.stdout:7 2024-04-24T22:59:53.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.875+0000 7ff68fb37640 1 -- 172.21.15.162:0/4264943755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688061e90 msgr2=0x7ff688149150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:53.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.875+0000 7ff68fb37640 1 --2- 172.21.15.162:0/4264943755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688061e90 0x7ff688149150 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff684009f60 tx=0x7ff684009f90 comp rx=0 tx=0).stop 2024-04-24T22:59:53.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.875+0000 7ff68fb37640 1 -- 172.21.15.162:0/4264943755 shutdown_connections 2024-04-24T22:59:53.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.875+0000 7ff68fb37640 1 --2- 172.21.15.162:0/4264943755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff68814a360 0x7ff68813c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.875+0000 7ff68fb37640 1 --2- 172.21.15.162:0/4264943755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6880af980 0x7ff68813bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.875+0000 7ff68fb37640 1 --2- 172.21.15.162:0/4264943755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688061e90 0x7ff688149150 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:53.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.875+0000 7ff68fb37640 1 -- 172.21.15.162:0/4264943755 >> 172.21.15.162:0/4264943755 conn(0x7ff68806b9f0 msgr2=0x7ff688146ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:53.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.875+0000 7ff68fb37640 1 -- 172.21.15.162:0/4264943755 shutdown_connections 2024-04-24T22:59:53.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-24T22:59:53.875+0000 7ff68fb37640 1 -- 172.21.15.162:0/4264943755 wait complete. 2024-04-24T22:59:53.892 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-24T22:59:53.893 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-24T22:59:53.895 INFO:tasks.ceph.osd.0:Started 2024-04-24T22:59:53.895 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-24T22:59:53.896 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-24T22:59:53.898 INFO:tasks.ceph.osd.1:Started 2024-04-24T22:59:53.898 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-24T22:59:53.898 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-24T22:59:53.900 INFO:tasks.ceph.osd.2:Started 2024-04-24T22:59:53.901 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-24T22:59:53.901 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-24T22:59:53.903 INFO:tasks.ceph.osd.3:Started 2024-04-24T22:59:53.903 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-24T22:59:53.903 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-24T22:59:53.938 INFO:tasks.ceph.osd.4:Started 2024-04-24T22:59:53.938 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-24T22:59:53.938 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-24T22:59:53.940 INFO:tasks.ceph.osd.5:Started 2024-04-24T22:59:53.940 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-24T22:59:53.941 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-24T22:59:53.943 INFO:tasks.ceph.osd.6:Started 2024-04-24T22:59:53.943 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-24T22:59:53.943 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-24T22:59:53.945 INFO:tasks.ceph.osd.7:Started 2024-04-24T22:59:53.945 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T22:59:54.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.088+0000 7fa9e8de5640 1 Processor -- start 2024-04-24T22:59:54.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.088+0000 7fa9e8de5640 1 -- start start 2024-04-24T22:59:54.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.088+0000 7fa9e8de5640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa9e4072c50 0x7fa9e4148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:54.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.088+0000 7fa9e8de5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9e413f5d0 0x7fa9e4149110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:54.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.088+0000 7fa9e8de5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9e4073030 con 0x7fa9e406d5a0 2024-04-24T22:59:54.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.088+0000 7fa9e8de5640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa9e40b3a00 con 0x7fa9e4072c50 2024-04-24T22:59:54.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.088+0000 7fa9e8de5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa9e4148740 con 0x7fa9e413f5d0 2024-04-24T22:59:54.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.088+0000 7fa9e37fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa9e4072c50 0x7fa9e4148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:54.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.088+0000 7fa9e37fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa9e4072c50 0x7fa9e4148bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43260/0 (socket says 172.21.15.43:43260) 2024-04-24T22:59:54.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.088+0000 7fa9e37fe640 1 -- 172.21.15.43:0/2658996611 learned_addr learned my addr 172.21.15.43:0/2658996611 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T22:59:54.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.088+0000 7fa9e3fff640 1 --2- 172.21.15.43:0/2658996611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9e413f5d0 0x7fa9e4149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:54.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.088+0000 7fa9e37fe640 1 -- 172.21.15.43:0/2658996611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9e413f5d0 msgr2=0x7fa9e4149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T22:59:54.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.088+0000 7fa9e37fe640 1 --2- 172.21.15.43:0/2658996611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9e413f5d0 0x7fa9e4149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:54.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.088+0000 7fa9e37fe640 1 -- 172.21.15.43:0/2658996611 >> v1:172.21.15.162:6789/0 conn(0x7fa9e406d5a0 legacy=0x7fa9e413eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:54.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.088+0000 7fa9e37fe640 1 -- 172.21.15.43:0/2658996611 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e40b1330 con 0x7fa9e4072c50 2024-04-24T22:59:54.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.092+0000 7fa9e37fe640 1 --2- 172.21.15.43:0/2658996611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9e4072c50 0x7fa9e4148bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009870 tx=0x7fa9d401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c423563747586a93 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:54.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.092+0000 7fa9e27fc640 1 -- 172.21.15.43:0/2658996611 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40aa5f0 con 0x7fa9e4072c50 2024-04-24T22:59:54.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.092+0000 7fa9e27fc640 1 -- 172.21.15.43:0/2658996611 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d40af070 con 0x7fa9e4072c50 2024-04-24T22:59:54.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.092+0000 7fa9e27fc640 1 -- 172.21.15.43:0/2658996611 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40aa9b0 con 0x7fa9e4072c50 2024-04-24T22:59:54.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.092+0000 7fa9e8de5640 1 -- 172.21.15.43:0/2658996611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9e4072c50 msgr2=0x7fa9e4148bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:54.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.092+0000 7fa9e8de5640 1 --2- 172.21.15.43:0/2658996611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9e4072c50 0x7fa9e4148bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009870 tx=0x7fa9d401c4d0 comp rx=0 tx=0).stop 2024-04-24T22:59:54.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.092+0000 7fa9e8de5640 1 -- 172.21.15.43:0/2658996611 shutdown_connections 2024-04-24T22:59:54.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.092+0000 7fa9e8de5640 1 --2- 172.21.15.43:0/2658996611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9e413f5d0 0x7fa9e4149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:54.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.092+0000 7fa9e8de5640 1 --2- 172.21.15.43:0/2658996611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9e4072c50 0x7fa9e4148bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:54.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.092+0000 7fa9e8de5640 1 -- 172.21.15.43:0/2658996611 >> 172.21.15.43:0/2658996611 conn(0x7fa9e40b63b0 msgr2=0x7fa9e40b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:54.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.092+0000 7fa9e8de5640 1 -- 172.21.15.43:0/2658996611 shutdown_connections 2024-04-24T22:59:54.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.092+0000 7fa9e8de5640 1 -- 172.21.15.43:0/2658996611 wait complete. 2024-04-24T22:59:54.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.092+0000 7fa9e8de5640 1 Processor -- start 2024-04-24T22:59:54.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.092+0000 7fa9e8de5640 1 -- start start 2024-04-24T22:59:54.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e8de5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9e4072c50 0x7fa9e4147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:54.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e8de5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9e413f5d0 0x7fa9e4142350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:54.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e8de5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9e41409b0 0x7fa9e4140e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:54.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9e4072c50 0x7fa9e4147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:54.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e8de5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e40707e0 con 0x7fa9e4072c50 2024-04-24T22:59:54.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9e4072c50 0x7fa9e4147890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43272/0 (socket says 172.21.15.43:43272) 2024-04-24T22:59:54.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e37fe640 1 -- 172.21.15.43:0/1938947035 learned_addr learned my addr 172.21.15.43:0/1938947035 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T22:59:54.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e8de5640 1 -- 172.21.15.43:0/1938947035 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e406dd00 con 0x7fa9e41409b0 2024-04-24T22:59:54.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e8de5640 1 -- 172.21.15.43:0/1938947035 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa9e4070960 con 0x7fa9e413f5d0 2024-04-24T22:59:54.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e2ffd640 1 --2- 172.21.15.43:0/1938947035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9e413f5d0 0x7fa9e4142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:54.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e3fff640 1 --2- 172.21.15.43:0/1938947035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9e41409b0 0x7fa9e4140e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:54.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e37fe640 1 -- 172.21.15.43:0/1938947035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9e413f5d0 msgr2=0x7fa9e4142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:54.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e37fe640 1 --2- 172.21.15.43:0/1938947035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9e413f5d0 0x7fa9e4142350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:54.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e37fe640 1 -- 172.21.15.43:0/1938947035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9e41409b0 msgr2=0x7fa9e4140e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:54.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e37fe640 1 --2- 172.21.15.43:0/1938947035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9e41409b0 0x7fa9e4140e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:54.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e37fe640 1 -- 172.21.15.43:0/1938947035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e4141370 con 0x7fa9e4072c50 2024-04-24T22:59:54.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e37fe640 1 --2- 172.21.15.43:0/1938947035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9e4072c50 0x7fa9e4147890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40ac040 tx=0x7fa9d401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:54.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9dbfff640 1 -- 172.21.15.43:0/1938947035 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40aae60 con 0x7fa9e4072c50 2024-04-24T22:59:54.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9dbfff640 1 -- 172.21.15.43:0/1938947035 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d40bd610 con 0x7fa9e4072c50 2024-04-24T22:59:54.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e8de5640 1 -- 172.21.15.43:0/1938947035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e4141e50 con 0x7fa9e4072c50 2024-04-24T22:59:54.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9dbfff640 1 -- 172.21.15.43:0/1938947035 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40bda00 con 0x7fa9e4072c50 2024-04-24T22:59:54.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e8de5640 1 -- 172.21.15.43:0/1938947035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e41481b0 con 0x7fa9e4072c50 2024-04-24T22:59:54.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9dbfff640 1 -- 172.21.15.43:0/1938947035 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa9d40c6440 con 0x7fa9e4072c50 2024-04-24T22:59:54.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9dbfff640 1 -- 172.21.15.43:0/1938947035 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa9d40b3580 con 0x7fa9e4072c50 2024-04-24T22:59:54.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.096+0000 7fa9e8de5640 1 -- 172.21.15.43:0/1938947035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9e404f510 con 0x7fa9e4072c50 2024-04-24T22:59:54.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.100+0000 7fa9dbfff640 1 -- 172.21.15.43:0/1938947035 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa9e4141370 con 0x7fa9e4072c50 2024-04-24T22:59:54.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.156+0000 7fa9e8de5640 1 -- 172.21.15.43:0/1938947035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9e413e950 con 0x7fa9e4072c50 2024-04-24T22:59:54.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.156+0000 7fa9dbfff640 1 -- 172.21.15.43:0/1938947035 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa9d40cc030 con 0x7fa9e4072c50 2024-04-24T22:59:54.161 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T22:59:54.161 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":10,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T22:59:53.868689+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T22:59:54.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.156+0000 7fa9e8de5640 1 -- 172.21.15.43:0/1938947035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9e4072c50 msgr2=0x7fa9e4147890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:54.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.156+0000 7fa9e8de5640 1 --2- 172.21.15.43:0/1938947035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9e4072c50 0x7fa9e4147890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40ac040 tx=0x7fa9d401ad10 comp rx=0 tx=0).stop 2024-04-24T22:59:54.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.156+0000 7fa9e8de5640 1 -- 172.21.15.43:0/1938947035 shutdown_connections 2024-04-24T22:59:54.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.156+0000 7fa9e8de5640 1 --2- 172.21.15.43:0/1938947035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9e41409b0 0x7fa9e4140e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:54.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.156+0000 7fa9e8de5640 1 --2- 172.21.15.43:0/1938947035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9e413f5d0 0x7fa9e4142350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:54.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.156+0000 7fa9e8de5640 1 --2- 172.21.15.43:0/1938947035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9e4072c50 0x7fa9e4147890 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:54.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.156+0000 7fa9e8de5640 1 -- 172.21.15.43:0/1938947035 >> 172.21.15.43:0/1938947035 conn(0x7fa9e40b63b0 msgr2=0x7fa9e4148bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:54.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.156+0000 7fa9e8de5640 1 -- 172.21.15.43:0/1938947035 shutdown_connections 2024-04-24T22:59:54.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T22:59:54.156+0000 7fa9e8de5640 1 -- 172.21.15.43:0/1938947035 wait complete. 2024-04-24T22:59:54.178 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-24T22:59:54.178 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-24T22:59:54.310 INFO:tasks.ceph.mgr.y.smithi043.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-24T22:59:54.310 INFO:tasks.ceph.mgr.y.smithi043.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-24T22:59:54.310 INFO:tasks.ceph.mgr.y.smithi043.stderr: from numpy import show_config as show_numpy_config 2024-04-24T22:59:54.350 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:54.344+0000 7f33e86d5180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T22:59:54.356 INFO:tasks.ceph.mgr.x.smithi162.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-24T22:59:54.356 INFO:tasks.ceph.mgr.x.smithi162.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-24T22:59:54.356 INFO:tasks.ceph.mgr.x.smithi162.stderr: from numpy import show_config as show_numpy_config 2024-04-24T22:59:54.428 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:54.427+0000 7f4af1dae180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T22:59:54.489 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:54.484+0000 7f33e86d5180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T22:59:54.508 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-04-24T22:59:54.504+0000 7fd478ce87c0 -1 Falling back to public interface 2024-04-24T22:59:54.512 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-04-24T22:59:54.508+0000 7f347337c7c0 -1 Falling back to public interface 2024-04-24T22:59:54.519 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-04-24T22:59:54.516+0000 7fcfc97d27c0 -1 Falling back to public interface 2024-04-24T22:59:54.519 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-04-24T22:59:54.516+0000 7f102c2b97c0 -1 Falling back to public interface 2024-04-24T22:59:54.566 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-04-24T22:59:54.563+0000 7ff55973b7c0 -1 Falling back to public interface 2024-04-24T22:59:54.566 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-04-24T22:59:54.563+0000 7f3d45f7b7c0 -1 Falling back to public interface 2024-04-24T22:59:54.567 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-04-24T22:59:54.563+0000 7f1bc11097c0 -1 Falling back to public interface 2024-04-24T22:59:54.585 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-04-24T22:59:54.583+0000 7f276b4907c0 -1 Falling back to public interface 2024-04-24T22:59:54.610 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:54.607+0000 7f4af1dae180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T22:59:54.666 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:54.664+0000 7f33e86d5180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T22:59:54.733 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:54.728+0000 7f33e86d5180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T22:59:54.768 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:54.763+0000 7f4af1dae180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T22:59:54.831 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:54.827+0000 7f4af1dae180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T22:59:54.874 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:54.868+0000 7f33e86d5180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T22:59:54.966 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:54.963+0000 7f4af1dae180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T22:59:54.983 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T22:59:55.099 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.096+0000 7f3fc3202640 1 Processor -- start 2024-04-24T22:59:55.099 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.096+0000 7f3fc3202640 1 -- start start 2024-04-24T22:59:55.100 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.096+0000 7f3fc3202640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3fbc1491b0 0x7f3fbc1495f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:55.100 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.096+0000 7f3fc3202640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fbc0b6000 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.100 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.096+0000 7f3fc3202640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fbc0b3d40 con 0x7f3fbc13f1e0 2024-04-24T22:59:55.100 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.096+0000 7f3fc3202640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f3fbc148a40 con 0x7f3fbc1491b0 2024-04-24T22:59:55.100 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.096+0000 7f3fc0f9e640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3fbc0b5c20 0x7f3fbc0b3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:35572/0 (socket says 172.21.15.43:35572) 2024-04-24T22:59:55.100 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.096+0000 7f3fc0f9e640 1 -- 172.21.15.43:0/1247037734 learned_addr learned my addr 172.21.15.43:0/1247037734 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T22:59:55.100 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.096+0000 7f3fbbfff640 1 --2- 172.21.15.43:0/1247037734 >> v2:172.21.15.43:3300/0 conn(0x7f3fbc1491b0 0x7f3fbc1495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:55.100 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.096+0000 7f3fbb7fe640 1 -- 172.21.15.43:0/1247037734 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 194562437 0 0) 0x7f3fbc0b6000 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.101 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.096+0000 7f3fbb7fe640 1 -- 172.21.15.43:0/1247037734 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fac003530 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.101 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.096+0000 7f3fbbfff640 1 -- 172.21.15.43:0/1247037734 >> v1:172.21.15.162:6789/0 conn(0x7f3fbc13f1e0 legacy=0x7f3fbc13f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:55.101 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.096+0000 7f3fbbfff640 1 -- 172.21.15.43:0/1247037734 >> v1:172.21.15.43:6789/0 conn(0x7f3fbc0b5c20 legacy=0x7f3fbc0b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:55.101 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.096+0000 7f3fbbfff640 1 -- 172.21.15.43:0/1247037734 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fbc148c90 con 0x7f3fbc1491b0 2024-04-24T22:59:55.102 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.096+0000 7f3fbbfff640 1 --2- 172.21.15.43:0/1247037734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc1491b0 0x7f3fbc1495f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80097c0 tx=0x7f3fa801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbc6d94d88bb0bf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:55.102 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fbb7fe640 1 -- 172.21.15.43:0/1247037734 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa80b0070 con 0x7f3fbc1491b0 2024-04-24T22:59:55.102 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fbb7fe640 1 -- 172.21.15.43:0/1247037734 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa80ab600 con 0x7f3fbc1491b0 2024-04-24T22:59:55.102 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fbb7fe640 1 -- 172.21.15.43:0/1247037734 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa80ab9d0 con 0x7f3fbc1491b0 2024-04-24T22:59:55.103 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 -- 172.21.15.43:0/1247037734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc1491b0 msgr2=0x7f3fbc1495f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:55.103 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 --2- 172.21.15.43:0/1247037734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc1491b0 0x7f3fbc1495f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80097c0 tx=0x7f3fa801c4c0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.103 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 -- 172.21.15.43:0/1247037734 shutdown_connections 2024-04-24T22:59:55.103 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 --2- 172.21.15.43:0/1247037734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc1491b0 0x7f3fbc1495f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.103 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 -- 172.21.15.43:0/1247037734 >> 172.21.15.43:0/1247037734 conn(0x7f3fbc0b9fc0 msgr2=0x7f3fbc0ba3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:55.103 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 -- 172.21.15.43:0/1247037734 shutdown_connections 2024-04-24T22:59:55.104 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 -- 172.21.15.43:0/1247037734 wait complete. 2024-04-24T22:59:55.106 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 Processor -- start 2024-04-24T22:59:55.106 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 -- start start 2024-04-24T22:59:55.106 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc0b5c20 0x7f3fbc145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:55.106 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc13f1e0 0x7f3fbc144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:55.106 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fbc134dd0 0x7f3fbc143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T22:59:55.106 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc153990 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.107 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc153810 con 0x7f3fbc13f1e0 2024-04-24T22:59:55.107 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3fbc153b10 con 0x7f3fbc134dd0 2024-04-24T22:59:55.107 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc0f9e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc0b5c20 0x7f3fbc145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:55.107 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc0f9e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc0b5c20 0x7f3fbc145af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43290/0 (socket says 172.21.15.43:43290) 2024-04-24T22:59:55.107 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc0f9e640 1 -- 172.21.15.43:0/22350012 learned_addr learned my addr 172.21.15.43:0/22350012 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T22:59:55.107 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fbbfff640 1 --2- 172.21.15.43:0/22350012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc13f1e0 0x7f3fbc144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:55.107 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc179f640 1 --2- 172.21.15.43:0/22350012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fbc134dd0 0x7f3fbc143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T22:59:55.107 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc0f9e640 1 -- 172.21.15.43:0/22350012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fbc134dd0 msgr2=0x7f3fbc143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:55.107 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc0f9e640 1 --2- 172.21.15.43:0/22350012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fbc134dd0 0x7f3fbc143730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.107 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc0f9e640 1 -- 172.21.15.43:0/22350012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc13f1e0 msgr2=0x7f3fbc144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:55.107 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc0f9e640 1 --2- 172.21.15.43:0/22350012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc13f1e0 0x7f3fbc144bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.107 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc0f9e640 1 -- 172.21.15.43:0/22350012 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fbc1e1430 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.107 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fbbfff640 1 --2- 172.21.15.43:0/22350012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc13f1e0 0x7f3fbc144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T22:59:55.108 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc0f9e640 1 --2- 172.21.15.43:0/22350012 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc0b5c20 0x7f3fbc145af0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000c4d0 tx=0x7f3fb000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T22:59:55.108 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fb97fa640 1 -- 172.21.15.43:0/22350012 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0017070 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.108 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fb97fa640 1 -- 172.21.15.43:0/22350012 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb0005cf0 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.108 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 -- 172.21.15.43:0/22350012 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fbc146030 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.108 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fb97fa640 1 -- 172.21.15.43:0/22350012 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0007270 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.108 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fc3202640 1 -- 172.21.15.43:0/22350012 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fbc136c20 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.108 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fb97fa640 1 -- 172.21.15.43:0/22350012 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3fb001a070 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.108 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.100+0000 7f3fb97fa640 1 -- 172.21.15.43:0/22350012 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f3fb001cc10 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.108 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.104+0000 7f3fc3202640 1 -- 172.21.15.43:0/22350012 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fbc068bf0 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.108 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.104+0000 7f3fb97fa640 1 -- 172.21.15.43:0/22350012 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3fb001c440 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.165 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.160+0000 7f3fc3202640 1 -- 172.21.15.43:0/22350012 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3fbc074870 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.166 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.160+0000 7f3fb97fa640 1 -- 172.21.15.43:0/22350012 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f3fb0007410 con 0x7f3fbc0b5c20 2024-04-24T22:59:55.166 INFO:teuthology.misc.health.smithi043.stdout: 2024-04-24T22:59:55.166 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":10,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T22:59:53.868689+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T22:59:55.167 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.164+0000 7f3fc3202640 1 -- 172.21.15.43:0/22350012 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc0b5c20 msgr2=0x7f3fbc145af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T22:59:55.167 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.164+0000 7f3fc3202640 1 --2- 172.21.15.43:0/22350012 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc0b5c20 0x7f3fbc145af0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000c4d0 tx=0x7f3fb000c990 comp rx=0 tx=0).stop 2024-04-24T22:59:55.167 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.164+0000 7f3fc3202640 1 -- 172.21.15.43:0/22350012 shutdown_connections 2024-04-24T22:59:55.168 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.164+0000 7f3fc3202640 1 --2- 172.21.15.43:0/22350012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fbc134dd0 0x7f3fbc143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.168 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.164+0000 7f3fc3202640 1 --2- 172.21.15.43:0/22350012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc13f1e0 0x7f3fbc144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.168 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.164+0000 7f3fc3202640 1 --2- 172.21.15.43:0/22350012 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc0b5c20 0x7f3fbc145af0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T22:59:55.168 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.164+0000 7f3fc3202640 1 -- 172.21.15.43:0/22350012 >> 172.21.15.43:0/22350012 conn(0x7f3fbc0b9fc0 msgr2=0x7f3fbc13e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T22:59:55.168 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.164+0000 7f3fc3202640 1 -- 172.21.15.43:0/22350012 shutdown_connections 2024-04-24T22:59:55.168 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T22:59:55.164+0000 7f3fc3202640 1 -- 172.21.15.43:0/22350012 wait complete. 2024-04-24T22:59:55.181 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-24T22:59:55.508 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:55.504+0000 7f33e86d5180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T22:59:55.586 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:55.584+0000 7f33e86d5180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T22:59:55.597 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:55.595+0000 7f4af1dae180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T22:59:55.672 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:55.667+0000 7f4af1dae180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T22:59:55.777 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:55.772+0000 7f33e86d5180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T22:59:55.853 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:55.851+0000 7f4af1dae180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T22:59:55.854 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:55.848+0000 7f33e86d5180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T22:59:55.926 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:55.923+0000 7f4af1dae180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T22:59:56.160 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:56.156+0000 7f33e86d5180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T22:59:56.216 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:56.211+0000 7f4af1dae180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T22:59:56.225 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:56.220+0000 7f33e86d5180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T22:59:56.280 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-04-24T22:59:56.275+0000 7f4af1dae180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T22:59:57.264 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:57.260+0000 7f338fb21640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-24T22:59:57.264 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-24T22:59:57.260+0000 7f338fb21640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-24T22:59:58.204 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-04-24T22:59:58.199+0000 7f1bc11097c0 -1 osd.5 0 log_to_monitors true 2024-04-24T22:59:58.344 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-04-24T22:59:58.339+0000 7ff55973b7c0 -1 osd.4 0 log_to_monitors true 2024-04-24T22:59:58.352 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-04-24T22:59:58.348+0000 7f102c2b97c0 -1 osd.3 0 log_to_monitors true 2024-04-24T22:59:58.380 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-04-24T22:59:58.376+0000 7fd478ce87c0 -1 osd.0 0 log_to_monitors true 2024-04-24T22:59:58.417 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-04-24T22:59:58.412+0000 7fcfc97d27c0 -1 osd.2 0 log_to_monitors true 2024-04-24T22:59:58.438 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-04-24T22:59:58.432+0000 7f347337c7c0 -1 osd.1 0 log_to_monitors true 2024-04-24T22:59:58.466 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-04-24T22:59:58.463+0000 7f276b4907c0 -1 osd.6 0 log_to_monitors true 2024-04-24T22:59:58.470 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-04-24T22:59:58.467+0000 7f3d45f7b7c0 -1 osd.7 0 log_to_monitors true 2024-04-24T22:59:59.911 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-04-24T22:59:59.907+0000 7f1bbd8c4640 -1 osd.5 0 waiting for initial osdmap 2024-04-24T22:59:59.934 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-04-24T22:59:59.931+0000 7f1bb4ee7640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:00:01.251 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-04-24T23:00:01.247+0000 7f2767439640 -1 osd.6 0 waiting for initial osdmap 2024-04-24T23:00:01.260 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-04-24T23:00:01.255+0000 7f3d41f24640 -1 osd.7 0 waiting for initial osdmap 2024-04-24T23:00:01.281 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-04-24T23:00:01.275+0000 7ff555ef6640 -1 osd.4 0 waiting for initial osdmap 2024-04-24T23:00:01.281 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-04-24T23:00:01.279+0000 7f275f26e640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:00:01.289 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-04-24T23:00:01.287+0000 7f3d39d59640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:00:01.313 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-04-24T23:00:01.311+0000 7ff54d519640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:00:01.345 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-04-24T23:00:01.340+0000 7fcfc577b640 -1 osd.2 0 waiting for initial osdmap 2024-04-24T23:00:01.371 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-04-24T23:00:01.368+0000 7fcfbd5b0640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:00:01.469 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-04-24T23:00:01.464+0000 7fd474c91640 -1 osd.0 0 waiting for initial osdmap 2024-04-24T23:00:01.494 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-04-24T23:00:01.492+0000 7f346f325640 -1 osd.1 0 waiting for initial osdmap 2024-04-24T23:00:01.495 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-04-24T23:00:01.492+0000 7fd46cac6640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:00:01.527 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-04-24T23:00:01.524+0000 7f346715a640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:00:01.537 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-04-24T23:00:01.532+0000 7f1028262640 -1 osd.3 0 waiting for initial osdmap 2024-04-24T23:00:01.555 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-04-24T23:00:01.552+0000 7f1020097640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T23:00:01.988 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:02.111 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4ad33e640 1 Processor -- start 2024-04-24T23:00:02.111 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4ad33e640 1 -- start start 2024-04-24T23:00:02.113 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4ad33e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4a80b6ce0 0x7fa4a813e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:02.113 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4ad33e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa4a8071020 0x7fa4a813e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:02.113 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4ad33e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa4a8070910 0x7fa4a8147a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:02.113 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4ad33e640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa4a8071b00 con 0x7fa4a8070910 2024-04-24T23:00:02.113 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4ad33e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa4a80b70c0 con 0x7fa4a8071020 2024-04-24T23:00:02.113 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4ad33e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a80714b0 con 0x7fa4a80b6ce0 2024-04-24T23:00:02.113 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4a77fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa4a8070910 0x7fa4a8147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:02.113 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4a77fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa4a8070910 0x7fa4a8147a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58696/0 (socket says 172.21.15.43:58696) 2024-04-24T23:00:02.113 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4a77fe640 1 -- 172.21.15.43:0/613294295 learned_addr learned my addr 172.21.15.43:0/613294295 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:02.113 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa49e7fc640 1 --2- 172.21.15.43:0/613294295 >> v2:172.21.15.162:3300/0 conn(0x7fa4a8071020 0x7fa4a813e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:02.113 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4a6ffd640 1 --2- 172.21.15.43:0/613294295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4a80b6ce0 0x7fa4a813e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:02.114 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4a77fe640 1 -- 172.21.15.43:0/613294295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4a80b6ce0 msgr2=0x7fa4a813e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:02.114 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4a77fe640 1 --2- 172.21.15.43:0/613294295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4a80b6ce0 0x7fa4a813e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.114 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4a77fe640 1 -- 172.21.15.43:0/613294295 >> v2:172.21.15.162:3300/0 conn(0x7fa4a8071020 msgr2=0x7fa4a813e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:02.114 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4a77fe640 1 --2- 172.21.15.43:0/613294295 >> v2:172.21.15.162:3300/0 conn(0x7fa4a8071020 0x7fa4a813e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.114 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4a77fe640 1 -- 172.21.15.43:0/613294295 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a8071790 con 0x7fa4a8070910 2024-04-24T23:00:02.114 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa49e7fc640 1 --2- 172.21.15.43:0/613294295 >> v2:172.21.15.162:3300/0 conn(0x7fa4a8071020 0x7fa4a813e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:02.114 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.108+0000 7fa4a6ffd640 1 --2- 172.21.15.43:0/613294295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4a80b6ce0 0x7fa4a813e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:02.115 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4a77fe640 1 --2- 172.21.15.43:0/613294295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4a8070910 0x7fa4a8147a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa4a806d230 tx=0x7fa4a001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd520fe6d7df30df server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:02.115 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4a67fc640 1 -- 172.21.15.43:0/613294295 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a00a56b0 con 0x7fa4a8070910 2024-04-24T23:00:02.115 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4a67fc640 1 -- 172.21.15.43:0/613294295 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a00a5850 con 0x7fa4a8070910 2024-04-24T23:00:02.115 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4a67fc640 1 -- 172.21.15.43:0/613294295 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a00a5c20 con 0x7fa4a8070910 2024-04-24T23:00:02.115 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 -- 172.21.15.43:0/613294295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4a8070910 msgr2=0x7fa4a8147a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:02.116 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 --2- 172.21.15.43:0/613294295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4a8070910 0x7fa4a8147a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa4a806d230 tx=0x7fa4a001c960 comp rx=0 tx=0).stop 2024-04-24T23:00:02.116 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 -- 172.21.15.43:0/613294295 shutdown_connections 2024-04-24T23:00:02.116 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 --2- 172.21.15.43:0/613294295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4a8070910 0x7fa4a8147a00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.116 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 --2- 172.21.15.43:0/613294295 >> v2:172.21.15.162:3300/0 conn(0x7fa4a8071020 0x7fa4a813e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.116 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 --2- 172.21.15.43:0/613294295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4a80b6ce0 0x7fa4a813e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.116 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 -- 172.21.15.43:0/613294295 >> 172.21.15.43:0/613294295 conn(0x7fa4a806c4f0 msgr2=0x7fa4a806c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:02.116 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 -- 172.21.15.43:0/613294295 shutdown_connections 2024-04-24T23:00:02.116 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 -- 172.21.15.43:0/613294295 wait complete. 2024-04-24T23:00:02.118 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 Processor -- start 2024-04-24T23:00:02.118 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 -- start start 2024-04-24T23:00:02.118 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4a8070910 0x7fa4a8144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:02.119 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4a80b6ce0 0x7fa4a8143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:02.119 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4a81e00c0 0x7fa4a81e0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:02.119 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a80b5200 con 0x7fa4a8070910 2024-04-24T23:00:02.119 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a80b5080 con 0x7fa4a80b6ce0 2024-04-24T23:00:02.119 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a80b5380 con 0x7fa4a81e00c0 2024-04-24T23:00:02.119 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4a6ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4a8070910 0x7fa4a8144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:02.119 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4a6ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4a8070910 0x7fa4a8144d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58700/0 (socket says 172.21.15.43:58700) 2024-04-24T23:00:02.119 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4a6ffd640 1 -- 172.21.15.43:0/1756206844 learned_addr learned my addr 172.21.15.43:0/1756206844 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:02.119 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4a77fe640 1 --2- 172.21.15.43:0/1756206844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4a81e00c0 0x7fa4a81e0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:02.119 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4a6ffd640 1 -- 172.21.15.43:0/1756206844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4a81e00c0 msgr2=0x7fa4a81e0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:02.119 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4a6ffd640 1 --2- 172.21.15.43:0/1756206844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4a81e00c0 0x7fa4a81e0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.119 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4a6ffd640 1 -- 172.21.15.43:0/1756206844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4a80b6ce0 msgr2=0x7fa4a8143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:02.119 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4a6ffd640 1 --2- 172.21.15.43:0/1756206844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4a80b6ce0 0x7fa4a8143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.119 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4a6ffd640 1 -- 172.21.15.43:0/1756206844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a80b38e0 con 0x7fa4a8070910 2024-04-24T23:00:02.119 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4a77fe640 1 --2- 172.21.15.43:0/1756206844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4a81e00c0 0x7fa4a81e0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:02.120 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4a6ffd640 1 --2- 172.21.15.43:0/1756206844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4a8070910 0x7fa4a8144d70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa49800c7f0 tx=0x7fa49800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:02.120 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa49ffff640 1 -- 172.21.15.43:0/1756206844 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498007a30 con 0x7fa4a8070910 2024-04-24T23:00:02.120 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa49ffff640 1 -- 172.21.15.43:0/1756206844 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa498007bd0 con 0x7fa4a8070910 2024-04-24T23:00:02.120 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa49ffff640 1 -- 172.21.15.43:0/1756206844 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4980113f0 con 0x7fa4a8070910 2024-04-24T23:00:02.120 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 -- 172.21.15.43:0/1756206844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a8144090 con 0x7fa4a8070910 2024-04-24T23:00:02.120 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.112+0000 7fa4ad33e640 1 -- 172.21.15.43:0/1756206844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a80b3b60 con 0x7fa4a8070910 2024-04-24T23:00:02.120 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.116+0000 7fa4ad33e640 1 -- 172.21.15.43:0/1756206844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a8068bf0 con 0x7fa4a8070910 2024-04-24T23:00:02.121 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.116+0000 7fa49ffff640 1 -- 172.21.15.43:0/1756206844 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7fa498011590 con 0x7fa4a8070910 2024-04-24T23:00:02.121 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.116+0000 7fa49ffff640 1 --2- 172.21.15.43:0/1756206844 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa488067860 0x7fa488069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:02.121 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.116+0000 7fa49ffff640 1 -- 172.21.15.43:0/1756206844 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2791+0+0 (secure 0 0 0) 0x7fa498085160 con 0x7fa4a8070910 2024-04-24T23:00:02.121 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.116+0000 7fa49e7fc640 1 --2- 172.21.15.43:0/1756206844 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa488067860 0x7fa488069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:02.121 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.116+0000 7fa49e7fc640 1 --2- 172.21.15.43:0/1756206844 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa488067860 0x7fa488069d20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80ba520 tx=0x7fa490008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:02.124 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.120+0000 7fa49ffff640 1 -- 172.21.15.43:0/1756206844 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa4a8144090 con 0x7fa4a8070910 2024-04-24T23:00:02.283 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.280+0000 7fa4ad33e640 1 -- 172.21.15.43:0/1756206844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4a80b56e0 con 0x7fa4a8070910 2024-04-24T23:00:02.284 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.280+0000 7fa49ffff640 1 -- 172.21.15.43:0/1756206844 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8076 (secure 0 0 0) 0x7fa4a80b38e0 con 0x7fa4a8070910 2024-04-24T23:00:02.284 INFO:teuthology.misc.health.smithi043.stdout: 2024-04-24T23:00:02.284 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":14,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:01.291567+0000","last_up_change":"2024-04-24T23:00:01.291567+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:02.287 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.284+0000 7fa4ad33e640 1 -- 172.21.15.43:0/1756206844 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa488067860 msgr2=0x7fa488069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:02.287 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.284+0000 7fa4ad33e640 1 --2- 172.21.15.43:0/1756206844 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa488067860 0x7fa488069d20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80ba520 tx=0x7fa490008040 comp rx=0 tx=0).stop 2024-04-24T23:00:02.287 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.284+0000 7fa4ad33e640 1 -- 172.21.15.43:0/1756206844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4a8070910 msgr2=0x7fa4a8144d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:02.287 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.284+0000 7fa4ad33e640 1 --2- 172.21.15.43:0/1756206844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4a8070910 0x7fa4a8144d70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa49800c7f0 tx=0x7fa49800ccb0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.287 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.284+0000 7fa4ad33e640 1 -- 172.21.15.43:0/1756206844 shutdown_connections 2024-04-24T23:00:02.287 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.284+0000 7fa4ad33e640 1 --2- 172.21.15.43:0/1756206844 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa488067860 0x7fa488069d20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.287 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.284+0000 7fa4ad33e640 1 --2- 172.21.15.43:0/1756206844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4a81e00c0 0x7fa4a81e0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.287 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.284+0000 7fa4ad33e640 1 --2- 172.21.15.43:0/1756206844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4a80b6ce0 0x7fa4a8143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.288 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.284+0000 7fa4ad33e640 1 --2- 172.21.15.43:0/1756206844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4a8070910 0x7fa4a8144d70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:02.288 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.284+0000 7fa4ad33e640 1 -- 172.21.15.43:0/1756206844 >> 172.21.15.43:0/1756206844 conn(0x7fa4a806c4f0 msgr2=0x7fa4a806c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:02.288 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.284+0000 7fa4ad33e640 1 -- 172.21.15.43:0/1756206844 shutdown_connections 2024-04-24T23:00:02.288 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:02.284+0000 7fa4ad33e640 1 -- 172.21.15.43:0/1756206844 wait complete. 2024-04-24T23:00:02.302 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-04-24T23:00:09.109 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:09.235 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f5320c38640 1 Processor -- start 2024-04-24T23:00:09.235 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f5320c38640 1 -- start start 2024-04-24T23:00:09.237 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f5320c38640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f531c0b3790 0x7f531c13e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.237 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f5320c38640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f531c13e7c0 0x7f531c144980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.237 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f5320c38640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531c0b3b70 con 0x7f531c144ec0 2024-04-24T23:00:09.237 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f5320c38640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f531c0b2450 con 0x7f531c13e7c0 2024-04-24T23:00:09.237 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f5320c38640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f531c0b2730 con 0x7f531c0b3790 2024-04-24T23:00:09.238 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f531ad9d640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f531c144ec0 0x7f531c1478c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37886/0 (socket says 172.21.15.43:37886) 2024-04-24T23:00:09.238 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f531ad9d640 1 -- 172.21.15.43:0/2234654759 learned_addr learned my addr 172.21.15.43:0/2234654759 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:09.238 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f5319d9b640 1 --2- 172.21.15.43:0/2234654759 >> v2:172.21.15.43:3300/0 conn(0x7f531c13e7c0 0x7f531c144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.238 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f531a59c640 1 --2- 172.21.15.43:0/2234654759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f531c0b3790 0x7f531c13e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.238 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f531959a640 1 -- 172.21.15.43:0/2234654759 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2600384159 0 0) 0x7f531c0b3b70 con 0x7f531c144ec0 2024-04-24T23:00:09.238 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f531959a640 1 -- 172.21.15.43:0/2234654759 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5304003530 con 0x7f531c144ec0 2024-04-24T23:00:09.238 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f5319d9b640 1 -- 172.21.15.43:0/2234654759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f531c0b3790 msgr2=0x7f531c13e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:09.238 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f5319d9b640 1 --2- 172.21.15.43:0/2234654759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f531c0b3790 0x7f531c13e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.238 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f5319d9b640 1 -- 172.21.15.43:0/2234654759 >> v1:172.21.15.43:6789/0 conn(0x7f531c144ec0 legacy=0x7f531c1478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.238 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.232+0000 7f5319d9b640 1 -- 172.21.15.43:0/2234654759 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c144460 con 0x7f531c13e7c0 2024-04-24T23:00:09.239 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5319d9b640 1 --2- 172.21.15.43:0/2234654759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c13e7c0 0x7f531c144980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f53100097c0 tx=0x7f531001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdb890f0c99f5e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.239 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f531959a640 1 -- 172.21.15.43:0/2234654759 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53100b0070 con 0x7f531c13e7c0 2024-04-24T23:00:09.239 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f531959a640 1 -- 172.21.15.43:0/2234654759 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53100ab600 con 0x7f531c13e7c0 2024-04-24T23:00:09.239 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f531959a640 1 -- 172.21.15.43:0/2234654759 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53100ab9d0 con 0x7f531c13e7c0 2024-04-24T23:00:09.240 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 -- 172.21.15.43:0/2234654759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c13e7c0 msgr2=0x7f531c144980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.240 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 --2- 172.21.15.43:0/2234654759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c13e7c0 0x7f531c144980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f53100097c0 tx=0x7f531001c410 comp rx=0 tx=0).stop 2024-04-24T23:00:09.240 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 -- 172.21.15.43:0/2234654759 shutdown_connections 2024-04-24T23:00:09.240 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 --2- 172.21.15.43:0/2234654759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c13e7c0 0x7f531c144980 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.240 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 --2- 172.21.15.43:0/2234654759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f531c0b3790 0x7f531c13e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.241 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 -- 172.21.15.43:0/2234654759 >> 172.21.15.43:0/2234654759 conn(0x7f531c0b5630 msgr2=0x7f531c0b5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:09.241 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 -- 172.21.15.43:0/2234654759 shutdown_connections 2024-04-24T23:00:09.241 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 -- 172.21.15.43:0/2234654759 wait complete. 2024-04-24T23:00:09.243 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 Processor -- start 2024-04-24T23:00:09.243 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 -- start start 2024-04-24T23:00:09.243 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f531c0b3790 0x7f531c143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.244 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c13e7c0 0x7f531c070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.244 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f531c144ec0 0x7f531c1e1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.244 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f531c0b21d0 con 0x7f531c13e7c0 2024-04-24T23:00:09.244 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f531c0b2050 con 0x7f531c144ec0 2024-04-24T23:00:09.244 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5320c38640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f531c151c30 con 0x7f531c0b3790 2024-04-24T23:00:09.244 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5319d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c13e7c0 0x7f531c070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.244 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5319d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c13e7c0 0x7f531c070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58730/0 (socket says 172.21.15.43:58730) 2024-04-24T23:00:09.244 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5319d9b640 1 -- 172.21.15.43:0/3850472825 learned_addr learned my addr 172.21.15.43:0/3850472825 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:09.244 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f531ad9d640 1 --2- 172.21.15.43:0/3850472825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f531c144ec0 0x7f531c1e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.244 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f531a59c640 1 --2- 172.21.15.43:0/3850472825 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f531c0b3790 0x7f531c143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.244 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5319d9b640 1 -- 172.21.15.43:0/3850472825 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f531c0b3790 msgr2=0x7f531c143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.244 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5319d9b640 1 --2- 172.21.15.43:0/3850472825 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f531c0b3790 0x7f531c143570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.244 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5319d9b640 1 -- 172.21.15.43:0/3850472825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f531c144ec0 msgr2=0x7f531c1e1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.244 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5319d9b640 1 --2- 172.21.15.43:0/3850472825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f531c144ec0 0x7f531c1e1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.245 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.236+0000 7f5319d9b640 1 -- 172.21.15.43:0/3850472825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c071120 con 0x7f531c13e7c0 2024-04-24T23:00:09.245 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.240+0000 7f5319d9b640 1 --2- 172.21.15.43:0/3850472825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c13e7c0 0x7f531c070be0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f53100ae040 tx=0x7f53100191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.245 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.240+0000 7f530affd640 1 -- 172.21.15.43:0/3850472825 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53100b0040 con 0x7f531c13e7c0 2024-04-24T23:00:09.245 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.240+0000 7f530affd640 1 -- 172.21.15.43:0/3850472825 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53100b43f0 con 0x7f531c13e7c0 2024-04-24T23:00:09.245 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.240+0000 7f530affd640 1 -- 172.21.15.43:0/3850472825 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53100b4800 con 0x7f531c13e7c0 2024-04-24T23:00:09.245 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.240+0000 7f5320c38640 1 -- 172.21.15.43:0/3850472825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531c0713a0 con 0x7f531c13e7c0 2024-04-24T23:00:09.245 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.240+0000 7f5320c38640 1 -- 172.21.15.43:0/3850472825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f531c137270 con 0x7f531c13e7c0 2024-04-24T23:00:09.245 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.240+0000 7f5320c38640 1 -- 172.21.15.43:0/3850472825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f531c068bf0 con 0x7f531c13e7c0 2024-04-24T23:00:09.246 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.240+0000 7f530affd640 1 -- 172.21.15.43:0/3850472825 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53100b49a0 con 0x7f531c13e7c0 2024-04-24T23:00:09.246 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.240+0000 7f530affd640 1 --2- 172.21.15.43:0/3850472825 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f52fc0678c0 0x7f52fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.246 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.240+0000 7f530affd640 1 -- 172.21.15.43:0/3850472825 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f531011f390 con 0x7f531c13e7c0 2024-04-24T23:00:09.246 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.240+0000 7f531a59c640 1 --2- 172.21.15.43:0/3850472825 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f52fc0678c0 0x7f52fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.246 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.240+0000 7f531a59c640 1 --2- 172.21.15.43:0/3850472825 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f52fc0678c0 0x7f52fc069d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f530c0096f0 tx=0x7f530c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.336 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.332+0000 7f530affd640 1 -- 172.21.15.43:0/3850472825 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f531c071120 con 0x7f531c13e7c0 2024-04-24T23:00:09.508 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.504+0000 7f5320c38640 1 -- 172.21.15.43:0/3850472825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f531c0b4ab0 con 0x7f531c13e7c0 2024-04-24T23:00:09.510 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.504+0000 7f530affd640 1 -- 172.21.15.43:0/3850472825 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12884 (secure 0 0 0) 0x7f5310016090 con 0x7f531c13e7c0 2024-04-24T23:00:09.511 INFO:teuthology.misc.health.smithi043.stdout: 2024-04-24T23:00:09.511 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":17,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:04.336463+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:09.513 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.508+0000 7f5320c38640 1 -- 172.21.15.43:0/3850472825 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f52fc0678c0 msgr2=0x7f52fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.513 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.508+0000 7f5320c38640 1 --2- 172.21.15.43:0/3850472825 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f52fc0678c0 0x7f52fc069d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f530c0096f0 tx=0x7f530c008040 comp rx=0 tx=0).stop 2024-04-24T23:00:09.513 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.508+0000 7f5320c38640 1 -- 172.21.15.43:0/3850472825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c13e7c0 msgr2=0x7f531c070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.513 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.508+0000 7f5320c38640 1 --2- 172.21.15.43:0/3850472825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c13e7c0 0x7f531c070be0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f53100ae040 tx=0x7f53100191b0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.513 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.508+0000 7f5320c38640 1 -- 172.21.15.43:0/3850472825 shutdown_connections 2024-04-24T23:00:09.513 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.508+0000 7f5320c38640 1 --2- 172.21.15.43:0/3850472825 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f52fc0678c0 0x7f52fc069d80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.513 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.508+0000 7f5320c38640 1 --2- 172.21.15.43:0/3850472825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f531c144ec0 0x7f531c1e1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.513 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.508+0000 7f5320c38640 1 --2- 172.21.15.43:0/3850472825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c13e7c0 0x7f531c070be0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.514 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.508+0000 7f5320c38640 1 --2- 172.21.15.43:0/3850472825 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f531c0b3790 0x7f531c143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.514 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.508+0000 7f5320c38640 1 -- 172.21.15.43:0/3850472825 >> 172.21.15.43:0/3850472825 conn(0x7f531c0b5630 msgr2=0x7f531c13a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:09.514 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.508+0000 7f5320c38640 1 -- 172.21.15.43:0/3850472825 shutdown_connections 2024-04-24T23:00:09.514 INFO:teuthology.misc.health.smithi043.stderr:2024-04-24T23:00:09.508+0000 7f5320c38640 1 -- 172.21.15.43:0/3850472825 wait complete. 2024-04-24T23:00:09.529 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-24T23:00:09.529 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-24T23:00:09.529 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-24T23:00:09.530 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-24T23:00:09.532 INFO:tasks.ceph.mds.a:Started 2024-04-24T23:00:09.532 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-24T23:00:09.532 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-24T23:00:09.535 INFO:tasks.ceph.mds.b:Started 2024-04-24T23:00:09.535 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-24T23:00:09.535 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:09.621 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2024-04-24T23:00:09.636 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-04-24T23:00:09.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.656+0000 7fa22b267640 1 Processor -- start 2024-04-24T23:00:09.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.656+0000 7fa22b267640 1 -- start start 2024-04-24T23:00:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa22b267640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa224070d30 0x7fa224072c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa22b267640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2240b6090 0x7fa2240b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa22b267640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa2241414c0 0x7fa224141930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa22b267640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa224141e70 con 0x7fa224070d30 2024-04-24T23:00:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa22b267640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa224073170 con 0x7fa2241414c0 2024-04-24T23:00:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa22b267640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa2240b5ab0 con 0x7fa2240b6090 2024-04-24T23:00:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa229003640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa224070d30 0x7fa224072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa229003640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa224070d30 0x7fa224072c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58748/0 (socket says 172.21.15.43:58748) 2024-04-24T23:00:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa229003640 1 -- 172.21.15.43:0/1647483378 learned_addr learned my addr 172.21.15.43:0/1647483378 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa229003640 1 -- 172.21.15.43:0/1647483378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2240b6090 msgr2=0x7fa2240b64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa229003640 1 --2- 172.21.15.43:0/1647483378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2240b6090 0x7fa2240b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa229003640 1 -- 172.21.15.43:0/1647483378 >> v2:172.21.15.162:3300/0 conn(0x7fa2241414c0 msgr2=0x7fa224141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa229804640 1 --2- 172.21.15.43:0/1647483378 >> v2:172.21.15.162:3300/0 conn(0x7fa2241414c0 0x7fa224141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa229003640 1 --2- 172.21.15.43:0/1647483378 >> v2:172.21.15.162:3300/0 conn(0x7fa2241414c0 0x7fa224141930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa229003640 1 -- 172.21.15.43:0/1647483378 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa224071110 con 0x7fa224070d30 2024-04-24T23:00:09.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa229003640 1 --2- 172.21.15.43:0/1647483378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa224070d30 0x7fa224072c30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2240b42d0 tx=0x7fa22001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d341281d6c0d7e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa21bfff640 1 -- 172.21.15.43:0/1647483378 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2200b1070 con 0x7fa224070d30 2024-04-24T23:00:09.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa21bfff640 1 -- 172.21.15.43:0/1647483378 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2200ac630 con 0x7fa224070d30 2024-04-24T23:00:09.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa21bfff640 1 -- 172.21.15.43:0/1647483378 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2200a8050 con 0x7fa224070d30 2024-04-24T23:00:09.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa22b267640 1 -- 172.21.15.43:0/1647483378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa224070d30 msgr2=0x7fa224072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa22b267640 1 --2- 172.21.15.43:0/1647483378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa224070d30 0x7fa224072c30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2240b42d0 tx=0x7fa22001c520 comp rx=0 tx=0).stop 2024-04-24T23:00:09.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa22b267640 1 -- 172.21.15.43:0/1647483378 shutdown_connections 2024-04-24T23:00:09.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa22b267640 1 --2- 172.21.15.43:0/1647483378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2240b6090 0x7fa2240b64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa22b267640 1 --2- 172.21.15.43:0/1647483378 >> v2:172.21.15.162:3300/0 conn(0x7fa2241414c0 0x7fa224141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa22b267640 1 --2- 172.21.15.43:0/1647483378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa224070d30 0x7fa224072c30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa22b267640 1 -- 172.21.15.43:0/1647483378 >> 172.21.15.43:0/1647483378 conn(0x7fa22406c300 msgr2=0x7fa22406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:09.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa22b267640 1 -- 172.21.15.43:0/1647483378 shutdown_connections 2024-04-24T23:00:09.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.660+0000 7fa22b267640 1 -- 172.21.15.43:0/1647483378 wait complete. 2024-04-24T23:00:09.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa22b267640 1 Processor -- start 2024-04-24T23:00:09.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa22b267640 1 -- start start 2024-04-24T23:00:09.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa22b267640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa224070d30 0x7fa2241e3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa22b267640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2240b6090 0x7fa224134980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa22b267640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2241414c0 0x7fa22413db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa22b267640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa2240736c0 con 0x7fa2241414c0 2024-04-24T23:00:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa22b267640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa224073540 con 0x7fa224070d30 2024-04-24T23:00:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa22b267640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa22406ba00 con 0x7fa2240b6090 2024-04-24T23:00:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa229804640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2241414c0 0x7fa22413db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa229804640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2241414c0 0x7fa22413db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58752/0 (socket says 172.21.15.43:58752) 2024-04-24T23:00:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa229804640 1 -- 172.21.15.43:0/2385896829 learned_addr learned my addr 172.21.15.43:0/2385896829 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa229003640 1 --2- 172.21.15.43:0/2385896829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa224070d30 0x7fa2241e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa228802640 1 --2- 172.21.15.43:0/2385896829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2240b6090 0x7fa224134980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa229804640 1 -- 172.21.15.43:0/2385896829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2240b6090 msgr2=0x7fa224134980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa229804640 1 --2- 172.21.15.43:0/2385896829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2240b6090 0x7fa224134980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa229804640 1 -- 172.21.15.43:0/2385896829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa224070d30 msgr2=0x7fa2241e3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa229804640 1 --2- 172.21.15.43:0/2385896829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa224070d30 0x7fa2241e3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa229804640 1 -- 172.21.15.43:0/2385896829 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa224142820 con 0x7fa2241414c0 2024-04-24T23:00:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa229804640 1 --2- 172.21.15.43:0/2385896829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2241414c0 0x7fa22413db70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00cc60 tx=0x7fa21c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa219ffb640 1 -- 172.21.15.43:0/2385896829 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c0039a0 con 0x7fa2241414c0 2024-04-24T23:00:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa219ffb640 1 -- 172.21.15.43:0/2385896829 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21c003b40 con 0x7fa2241414c0 2024-04-24T23:00:09.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa22b267640 1 -- 172.21.15.43:0/2385896829 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa224142540 con 0x7fa2241414c0 2024-04-24T23:00:09.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa219ffb640 1 -- 172.21.15.43:0/2385896829 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c004020 con 0x7fa2241414c0 2024-04-24T23:00:09.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa22b267640 1 -- 172.21.15.43:0/2385896829 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa224133ea0 con 0x7fa2241414c0 2024-04-24T23:00:09.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa22b267640 1 -- 172.21.15.43:0/2385896829 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa22404f580 con 0x7fa2241414c0 2024-04-24T23:00:09.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.664+0000 7fa219ffb640 1 -- 172.21.15.43:0/2385896829 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa21c0041c0 con 0x7fa2241414c0 2024-04-24T23:00:09.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.668+0000 7fa219ffb640 1 --2- 172.21.15.43:0/2385896829 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa2080678c0 0x7fa208069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.668+0000 7fa219ffb640 1 -- 172.21.15.43:0/2385896829 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa21c085c90 con 0x7fa2241414c0 2024-04-24T23:00:09.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.668+0000 7fa229003640 1 --2- 172.21.15.43:0/2385896829 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa2080678c0 0x7fa208069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.668+0000 7fa229003640 1 --2- 172.21.15.43:0/2385896829 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa2080678c0 0x7fa208069d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa2200ae000 tx=0x7fa220008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.672+0000 7fa219ffb640 1 -- 172.21.15.43:0/2385896829 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa224142820 con 0x7fa2241414c0 2024-04-24T23:00:09.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.832+0000 7fa22b267640 1 -- 172.21.15.43:0/2385896829 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa22413b7b0 con 0x7fa2241414c0 2024-04-24T23:00:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.832+0000 7fa219ffb640 1 -- 172.21.15.43:0/2385896829 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12884 (secure 0 0 0) 0x7fa21c014030 con 0x7fa2241414c0 2024-04-24T23:00:09.837 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:09.837 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:04.336463+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.836+0000 7fa22b267640 1 -- 172.21.15.43:0/2385896829 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa2080678c0 msgr2=0x7fa208069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.836+0000 7fa22b267640 1 --2- 172.21.15.43:0/2385896829 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa2080678c0 0x7fa208069d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa2200ae000 tx=0x7fa220008040 comp rx=0 tx=0).stop 2024-04-24T23:00:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.836+0000 7fa22b267640 1 -- 172.21.15.43:0/2385896829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2241414c0 msgr2=0x7fa22413db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.836+0000 7fa22b267640 1 --2- 172.21.15.43:0/2385896829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2241414c0 0x7fa22413db70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00cc60 tx=0x7fa21c00a5c0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.836+0000 7fa22b267640 1 -- 172.21.15.43:0/2385896829 shutdown_connections 2024-04-24T23:00:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.836+0000 7fa22b267640 1 --2- 172.21.15.43:0/2385896829 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa2080678c0 0x7fa208069d80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.836+0000 7fa22b267640 1 --2- 172.21.15.43:0/2385896829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2241414c0 0x7fa22413db70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.836+0000 7fa22b267640 1 --2- 172.21.15.43:0/2385896829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2240b6090 0x7fa224134980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.836+0000 7fa22b267640 1 --2- 172.21.15.43:0/2385896829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa224070d30 0x7fa2241e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.836+0000 7fa22b267640 1 -- 172.21.15.43:0/2385896829 >> 172.21.15.43:0/2385896829 conn(0x7fa22406c300 msgr2=0x7fa2240b9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.836+0000 7fa22b267640 1 -- 172.21.15.43:0/2385896829 shutdown_connections 2024-04-24T23:00:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.836+0000 7fa22b267640 1 -- 172.21.15.43:0/2385896829 wait complete. 2024-04-24T23:00:09.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:00:02.322280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:00:09.859 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:00:09.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.976+0000 7f1ffe3ea640 1 Processor -- start 2024-04-24T23:00:09.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.976+0000 7f1ffe3ea640 1 -- start start 2024-04-24T23:00:09.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.976+0000 7f1ffe3ea640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1ff813f1f0 0x7f1ff813f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.976+0000 7f1ffe3ea640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ff8070060 con 0x7f1ff80b2500 2024-04-24T23:00:09.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.976+0000 7f1ffe3ea640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ff813fbc0 con 0x7f1ff814dce0 2024-04-24T23:00:09.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.976+0000 7f1ffe3ea640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f1ff80b28e0 con 0x7f1ff813f1f0 2024-04-24T23:00:09.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.976+0000 7f1ff7fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1ff80b2500 0x7f1ff8145450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37888/0 (socket says 172.21.15.43:37888) 2024-04-24T23:00:09.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.976+0000 7f1ff7fff640 1 -- 172.21.15.43:0/4118686162 learned_addr learned my addr 172.21.15.43:0/4118686162 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:09.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.976+0000 7f1ff77fe640 1 --2- 172.21.15.43:0/4118686162 >> v2:172.21.15.43:3300/0 conn(0x7f1ff813f1f0 0x7f1ff813f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.976+0000 7f1ff77fe640 1 -- 172.21.15.43:0/4118686162 >> v1:172.21.15.162:6789/0 conn(0x7f1ff814dce0 legacy=0x7f1ff81500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:09.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.976+0000 7f1ff77fe640 1 -- 172.21.15.43:0/4118686162 >> v1:172.21.15.43:6789/0 conn(0x7f1ff80b2500 legacy=0x7f1ff8145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.976+0000 7f1ff77fe640 1 -- 172.21.15.43:0/4118686162 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff80af8f0 con 0x7f1ff813f1f0 2024-04-24T23:00:09.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.976+0000 7f1ff6ffd640 1 -- 172.21.15.43:0/4118686162 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3486842717 0 0) 0x7f1ff8070060 con 0x7f1ff80b2500 2024-04-24T23:00:09.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff77fe640 1 --2- 172.21.15.43:0/4118686162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff813f1f0 0x7f1ff813f680 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0097c0 tx=0x7f1fec01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e3c4db6f96a0b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff6ffd640 1 -- 172.21.15.43:0/4118686162 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec0b0070 con 0x7f1ff813f1f0 2024-04-24T23:00:09.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff6ffd640 1 -- 172.21.15.43:0/4118686162 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fec0ab600 con 0x7f1ff813f1f0 2024-04-24T23:00:09.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff6ffd640 1 -- 172.21.15.43:0/4118686162 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec0ab9d0 con 0x7f1ff813f1f0 2024-04-24T23:00:09.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 -- 172.21.15.43:0/4118686162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff813f1f0 msgr2=0x7f1ff813f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 --2- 172.21.15.43:0/4118686162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff813f1f0 0x7f1ff813f680 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0097c0 tx=0x7f1fec01c460 comp rx=0 tx=0).stop 2024-04-24T23:00:09.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 -- 172.21.15.43:0/4118686162 shutdown_connections 2024-04-24T23:00:09.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 --2- 172.21.15.43:0/4118686162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff813f1f0 0x7f1ff813f680 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 -- 172.21.15.43:0/4118686162 >> 172.21.15.43:0/4118686162 conn(0x7f1ff80b5690 msgr2=0x7f1ff80b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:09.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 -- 172.21.15.43:0/4118686162 shutdown_connections 2024-04-24T23:00:09.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 -- 172.21.15.43:0/4118686162 wait complete. 2024-04-24T23:00:09.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 Processor -- start 2024-04-24T23:00:09.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 -- start start 2024-04-24T23:00:09.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ff80b2500 0x7f1ff813be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff813f1f0 0x7f1ff8071a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ff814dce0 0x7f1ff81e3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff80b5410 con 0x7f1ff813f1f0 2024-04-24T23:00:09.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff80b5290 con 0x7f1ff814dce0 2024-04-24T23:00:09.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff80b4af0 con 0x7f1ff80b2500 2024-04-24T23:00:09.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff813f1f0 0x7f1ff8071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff813f1f0 0x7f1ff8071a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58770/0 (socket says 172.21.15.43:58770) 2024-04-24T23:00:09.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff77fe640 1 -- 172.21.15.43:0/2987087380 learned_addr learned my addr 172.21.15.43:0/2987087380 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:09.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff7fff640 1 --2- 172.21.15.43:0/2987087380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ff80b2500 0x7f1ff813be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffc987640 1 --2- 172.21.15.43:0/2987087380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ff814dce0 0x7f1ff81e3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff77fe640 1 -- 172.21.15.43:0/2987087380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ff80b2500 msgr2=0x7f1ff813be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff77fe640 1 --2- 172.21.15.43:0/2987087380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ff80b2500 0x7f1ff813be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff77fe640 1 -- 172.21.15.43:0/2987087380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ff814dce0 msgr2=0x7f1ff81e3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:09.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff77fe640 1 --2- 172.21.15.43:0/2987087380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ff814dce0 0x7f1ff81e3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:09.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff77fe640 1 -- 172.21.15.43:0/2987087380 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff8135a60 con 0x7f1ff813f1f0 2024-04-24T23:00:09.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff77fe640 1 --2- 172.21.15.43:0/2987087380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff813f1f0 0x7f1ff8071a40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1fec019070 tx=0x7f1fec01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff4ff9640 1 -- 172.21.15.43:0/2987087380 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec0b0050 con 0x7f1ff813f1f0 2024-04-24T23:00:09.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff4ff9640 1 -- 172.21.15.43:0/2987087380 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fec0bc070 con 0x7f1ff813f1f0 2024-04-24T23:00:09.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ffe3ea640 1 -- 172.21.15.43:0/2987087380 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff8135d40 con 0x7f1ff813f1f0 2024-04-24T23:00:09.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.980+0000 7f1ff4ff9640 1 -- 172.21.15.43:0/2987087380 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec0b5a70 con 0x7f1ff813f1f0 2024-04-24T23:00:09.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.984+0000 7f1ffe3ea640 1 -- 172.21.15.43:0/2987087380 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff8136300 con 0x7f1ff813f1f0 2024-04-24T23:00:09.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.984+0000 7f1ffe3ea640 1 -- 172.21.15.43:0/2987087380 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff804f580 con 0x7f1ff813f1f0 2024-04-24T23:00:09.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.984+0000 7f1ff4ff9640 1 -- 172.21.15.43:0/2987087380 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1fec0ab4c0 con 0x7f1ff813f1f0 2024-04-24T23:00:09.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.984+0000 7f1ff4ff9640 1 --2- 172.21.15.43:0/2987087380 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1fe40678c0 0x7f1fe4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:09.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.984+0000 7f1ff4ff9640 1 -- 172.21.15.43:0/2987087380 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f1fec120ba0 con 0x7f1ff813f1f0 2024-04-24T23:00:09.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.984+0000 7f1ff7fff640 1 --2- 172.21.15.43:0/2987087380 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1fe40678c0 0x7f1fe4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:09.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.984+0000 7f1ff7fff640 1 --2- 172.21.15.43:0/2987087380 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1fe40678c0 0x7f1fe4069d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8000f70 tx=0x7f1fe8007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:09.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:09.988+0000 7f1ff4ff9640 1 -- 172.21.15.43:0/2987087380 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f1fec120e20 con 0x7f1ff813f1f0 2024-04-24T23:00:10.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.144+0000 7f1ffe3ea640 1 -- 172.21.15.43:0/2987087380 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1ff81511f0 con 0x7f1ff813f1f0 2024-04-24T23:00:10.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.144+0000 7f1ff4ff9640 1 -- 172.21.15.43:0/2987087380 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f1fec016050 con 0x7f1ff813f1f0 2024-04-24T23:00:10.150 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-24T23:00:10.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.148+0000 7f1ffe3ea640 1 -- 172.21.15.43:0/2987087380 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1fe40678c0 msgr2=0x7f1fe4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.148+0000 7f1ffe3ea640 1 --2- 172.21.15.43:0/2987087380 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1fe40678c0 0x7f1fe4069d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8000f70 tx=0x7f1fe8007c10 comp rx=0 tx=0).stop 2024-04-24T23:00:10.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.148+0000 7f1ffe3ea640 1 -- 172.21.15.43:0/2987087380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff813f1f0 msgr2=0x7f1ff8071a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.148+0000 7f1ffe3ea640 1 --2- 172.21.15.43:0/2987087380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff813f1f0 0x7f1ff8071a40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1fec019070 tx=0x7f1fec01aca0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.148+0000 7f1ffe3ea640 1 -- 172.21.15.43:0/2987087380 shutdown_connections 2024-04-24T23:00:10.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.148+0000 7f1ffe3ea640 1 --2- 172.21.15.43:0/2987087380 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1fe40678c0 0x7f1fe4069d80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.148+0000 7f1ffe3ea640 1 --2- 172.21.15.43:0/2987087380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ff814dce0 0x7f1ff81e3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.148+0000 7f1ffe3ea640 1 --2- 172.21.15.43:0/2987087380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff813f1f0 0x7f1ff8071a40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.148+0000 7f1ffe3ea640 1 --2- 172.21.15.43:0/2987087380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ff80b2500 0x7f1ff813be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.148+0000 7f1ffe3ea640 1 -- 172.21.15.43:0/2987087380 >> 172.21.15.43:0/2987087380 conn(0x7f1ff80b5690 msgr2=0x7f1ff813e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:10.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.148+0000 7f1ffe3ea640 1 -- 172.21.15.43:0/2987087380 shutdown_connections 2024-04-24T23:00:10.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.148+0000 7f1ffe3ea640 1 -- 172.21.15.43:0/2987087380 wait complete. 2024-04-24T23:00:10.168 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:00:10.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.280+0000 7f3aa0849640 1 Processor -- start 2024-04-24T23:00:10.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.280+0000 7f3aa0849640 1 -- start start 2024-04-24T23:00:10.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3aa0849640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3a9c061e90 0x7f3a9c0b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3aa0849640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a9c062270 con 0x7f3a9c1446d0 2024-04-24T23:00:10.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3aa0849640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a9c0b5b50 con 0x7f3a9c147610 2024-04-24T23:00:10.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3aa0849640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f3a9c0aecc0 con 0x7f3a9c061e90 2024-04-24T23:00:10.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3a9a59c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3a9c061e90 0x7f3a9c0b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3a9a59c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3a9c061e90 0x7f3a9c0b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45152/0 (socket says 172.21.15.43:45152) 2024-04-24T23:00:10.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3a9a59c640 1 -- 172.21.15.43:0/1253814618 learned_addr learned my addr 172.21.15.43:0/1253814618 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:10.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3a9a59c640 1 -- 172.21.15.43:0/1253814618 >> v1:172.21.15.162:6789/0 conn(0x7f3a9c147610 legacy=0x7f3a9c147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:10.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3a9a59c640 1 -- 172.21.15.43:0/1253814618 >> v1:172.21.15.43:6789/0 conn(0x7f3a9c1446d0 legacy=0x7f3a9c144b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3a9a59c640 1 -- 172.21.15.43:0/1253814618 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9c0ae2f0 con 0x7f3a9c061e90 2024-04-24T23:00:10.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3a9959a640 1 -- 172.21.15.43:0/1253814618 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201211306 0 0) 0x7f3a9c062270 con 0x7f3a9c1446d0 2024-04-24T23:00:10.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3a9a59c640 1 --2- 172.21.15.43:0/1253814618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a9c061e90 0x7f3a9c0b5610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009e50 tx=0x7f3a9401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb5c483a41c2460 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:10.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3a9959a640 1 -- 172.21.15.43:0/1253814618 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a940a5620 con 0x7f3a9c061e90 2024-04-24T23:00:10.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3a9959a640 1 -- 172.21.15.43:0/1253814618 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a940a57c0 con 0x7f3a9c061e90 2024-04-24T23:00:10.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3a9959a640 1 -- 172.21.15.43:0/1253814618 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a940a5b90 con 0x7f3a9c061e90 2024-04-24T23:00:10.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3aa0849640 1 -- 172.21.15.43:0/1253814618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a9c061e90 msgr2=0x7f3a9c0b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.284+0000 7f3aa0849640 1 --2- 172.21.15.43:0/1253814618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a9c061e90 0x7f3a9c0b5610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009e50 tx=0x7f3a9401c960 comp rx=0 tx=0).stop 2024-04-24T23:00:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 -- 172.21.15.43:0/1253814618 shutdown_connections 2024-04-24T23:00:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 --2- 172.21.15.43:0/1253814618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a9c061e90 0x7f3a9c0b5610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 -- 172.21.15.43:0/1253814618 >> 172.21.15.43:0/1253814618 conn(0x7f3a9c0b93e0 msgr2=0x7f3a9c0b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 -- 172.21.15.43:0/1253814618 shutdown_connections 2024-04-24T23:00:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 -- 172.21.15.43:0/1253814618 wait complete. 2024-04-24T23:00:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 Processor -- start 2024-04-24T23:00:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 -- start start 2024-04-24T23:00:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a9c061e90 0x7f3a9c0b8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a9c1446d0 0x7f3a9c1e32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a9c147610 0x7f3a9c136320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c155a70 con 0x7f3a9c1446d0 2024-04-24T23:00:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c1558f0 con 0x7f3a9c147610 2024-04-24T23:00:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3a9c155bf0 con 0x7f3a9c061e90 2024-04-24T23:00:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3a99d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a9c1446d0 0x7f3a9c1e32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3a99d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a9c1446d0 0x7f3a9c1e32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45166/0 (socket says 172.21.15.43:45166) 2024-04-24T23:00:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3a99d9b640 1 -- 172.21.15.43:0/1826819856 learned_addr learned my addr 172.21.15.43:0/1826819856 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3a9ad9d640 1 --2- 172.21.15.43:0/1826819856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a9c147610 0x7f3a9c136320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3a9a59c640 1 --2- 172.21.15.43:0/1826819856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a9c061e90 0x7f3a9c0b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3a99d9b640 1 -- 172.21.15.43:0/1826819856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a9c061e90 msgr2=0x7f3a9c0b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3a99d9b640 1 --2- 172.21.15.43:0/1826819856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a9c061e90 0x7f3a9c0b8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3a99d9b640 1 -- 172.21.15.43:0/1826819856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a9c147610 msgr2=0x7f3a9c136320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3a99d9b640 1 --2- 172.21.15.43:0/1826819856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a9c147610 0x7f3a9c136320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3a99d9b640 1 -- 172.21.15.43:0/1826819856 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9c0b1c80 con 0x7f3a9c1446d0 2024-04-24T23:00:10.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3a9ad9d640 1 --2- 172.21.15.43:0/1826819856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a9c147610 0x7f3a9c136320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:10.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3a99d9b640 1 --2- 172.21.15.43:0/1826819856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a9c1446d0 0x7f3a9c1e32f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000c480 tx=0x7f3a9000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:10.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3a8affd640 1 -- 172.21.15.43:0/1826819856 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a90017070 con 0x7f3a9c1446d0 2024-04-24T23:00:10.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3a8affd640 1 -- 172.21.15.43:0/1826819856 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a90005480 con 0x7f3a9c1446d0 2024-04-24T23:00:10.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 -- 172.21.15.43:0/1826819856 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9c137ac0 con 0x7f3a9c1446d0 2024-04-24T23:00:10.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3a8affd640 1 -- 172.21.15.43:0/1826819856 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a90003840 con 0x7f3a9c1446d0 2024-04-24T23:00:10.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 -- 172.21.15.43:0/1826819856 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a9c138c70 con 0x7f3a9c1446d0 2024-04-24T23:00:10.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.288+0000 7f3aa0849640 1 -- 172.21.15.43:0/1826819856 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a9c04f580 con 0x7f3a9c1446d0 2024-04-24T23:00:10.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.292+0000 7f3a8affd640 1 -- 172.21.15.43:0/1826819856 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3a9001a070 con 0x7f3a9c1446d0 2024-04-24T23:00:10.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.292+0000 7f3a8affd640 1 --2- 172.21.15.43:0/1826819856 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3a7c0678c0 0x7f3a7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:10.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.292+0000 7f3a8affd640 1 -- 172.21.15.43:0/1826819856 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f3a90084d00 con 0x7f3a9c1446d0 2024-04-24T23:00:10.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.292+0000 7f3a9a59c640 1 --2- 172.21.15.43:0/1826819856 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3a7c0678c0 0x7f3a7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:10.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.292+0000 7f3a9a59c640 1 --2- 172.21.15.43:0/1826819856 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3a7c0678c0 0x7f3a7c069d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3a940ae000 tx=0x7f3a940a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.296+0000 7f3a8affd640 1 -- 172.21.15.43:0/1826819856 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3a90055c20 con 0x7f3a9c1446d0 2024-04-24T23:00:10.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.492+0000 7f3aa0849640 1 -- 172.21.15.43:0/1826819856 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a9c13d3d0 con 0x7f3a9c1446d0 2024-04-24T23:00:10.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.492+0000 7f3a8affd640 1 -- 172.21.15.43:0/1826819856 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1389 (secure 0 0 0) 0x7f3a90055520 con 0x7f3a9c1446d0 2024-04-24T23:00:10.495 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:10.495 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/152091432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":152091432},{"type":"v1","addr":"172.21.15.43:6835","nonce":152091432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-24T23:00:10.496 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 2 2024-04-24T23:00:10.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.492+0000 7f3aa0849640 1 -- 172.21.15.43:0/1826819856 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3a7c0678c0 msgr2=0x7f3a7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.492+0000 7f3aa0849640 1 --2- 172.21.15.43:0/1826819856 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3a7c0678c0 0x7f3a7c069d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3a940ae000 tx=0x7f3a940a7070 comp rx=0 tx=0).stop 2024-04-24T23:00:10.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.492+0000 7f3aa0849640 1 -- 172.21.15.43:0/1826819856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a9c1446d0 msgr2=0x7f3a9c1e32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:10.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.492+0000 7f3aa0849640 1 --2- 172.21.15.43:0/1826819856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a9c1446d0 0x7f3a9c1e32f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000c480 tx=0x7f3a9000c940 comp rx=0 tx=0).stop 2024-04-24T23:00:10.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.492+0000 7f3aa0849640 1 -- 172.21.15.43:0/1826819856 shutdown_connections 2024-04-24T23:00:10.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.492+0000 7f3aa0849640 1 --2- 172.21.15.43:0/1826819856 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3a7c0678c0 0x7f3a7c069d80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.492+0000 7f3aa0849640 1 --2- 172.21.15.43:0/1826819856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a9c147610 0x7f3a9c136320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.492+0000 7f3aa0849640 1 --2- 172.21.15.43:0/1826819856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a9c1446d0 0x7f3a9c1e32f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.492+0000 7f3aa0849640 1 --2- 172.21.15.43:0/1826819856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a9c061e90 0x7f3a9c0b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:10.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.492+0000 7f3aa0849640 1 -- 172.21.15.43:0/1826819856 >> 172.21.15.43:0/1826819856 conn(0x7f3a9c0b93e0 msgr2=0x7f3a9c142950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:10.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.492+0000 7f3aa0849640 1 -- 172.21.15.43:0/1826819856 shutdown_connections 2024-04-24T23:00:10.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:10.492+0000 7f3aa0849640 1 -- 172.21.15.43:0/1826819856 wait complete. 2024-04-24T23:00:12.513 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:00:12.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f7975d28640 1 Processor -- start 2024-04-24T23:00:12.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f7975d28640 1 -- start start 2024-04-24T23:00:12.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f7975d28640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f79700b37f0 0x7f7970072820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f7975d28640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79700b3bd0 con 0x7f79700733a0 2024-04-24T23:00:12.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f7975d28640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79700b2980 con 0x7f7970072d60 2024-04-24T23:00:12.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f7975d28640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f79700b24f0 con 0x7f79700b37f0 2024-04-24T23:00:12.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796effd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f79700733a0 0x7f7970144260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37136/0 (socket says 172.21.15.43:37136) 2024-04-24T23:00:12.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796effd640 1 -- 172.21.15.43:0/3673073477 learned_addr learned my addr 172.21.15.43:0/3673073477 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:12.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796f7fe640 1 --2- 172.21.15.43:0/3673073477 >> v2:172.21.15.162:3300/0 conn(0x7f79700b37f0 0x7f7970072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796e7fc640 1 -- 172.21.15.43:0/3673073477 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1523282826 0 0) 0x7f79700b3bd0 con 0x7f79700733a0 2024-04-24T23:00:12.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796e7fc640 1 -- 172.21.15.43:0/3673073477 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f795c003530 con 0x7f79700733a0 2024-04-24T23:00:12.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796e7fc640 1 -- 172.21.15.43:0/3673073477 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4029586468 0 0) 0x7f795c003530 con 0x7f79700733a0 2024-04-24T23:00:12.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796e7fc640 1 -- 172.21.15.43:0/3673073477 >> v2:172.21.15.162:3300/0 conn(0x7f79700b37f0 msgr2=0x7f7970072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:12.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796e7fc640 1 --2- 172.21.15.43:0/3673073477 >> v2:172.21.15.162:3300/0 conn(0x7f79700b37f0 0x7f7970072820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796e7fc640 1 -- 172.21.15.43:0/3673073477 >> v1:172.21.15.162:6789/0 conn(0x7f7970072d60 legacy=0x7f797014eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796e7fc640 1 -- 172.21.15.43:0/3673073477 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797006fdd0 con 0x7f79700733a0 2024-04-24T23:00:12.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796e7fc640 1 -- 172.21.15.43:0/3673073477 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f7960001680 con 0x7f79700733a0 2024-04-24T23:00:12.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796e7fc640 1 -- 172.21.15.43:0/3673073477 >> v1:172.21.15.43:6789/0 conn(0x7f79700733a0 legacy=0x7f7970144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796e7fc640 1 --2- 172.21.15.43:0/3673073477 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0039c0 0x7f795c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796e7fc640 1 --2- 172.21.15.43:0/3673073477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f795c004810 0x7f795c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796e7fc640 1 --2- 172.21.15.43:0/3673073477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795c0051d0 0x7f795c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796e7fc640 1 -- 172.21.15.43:0/3673073477 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f79700b24f0 con 0x7f795c004810 2024-04-24T23:00:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796e7fc640 1 -- 172.21.15.43:0/3673073477 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f795c00c170 con 0x7f795c0051d0 2024-04-24T23:00:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796e7fc640 1 -- 172.21.15.43:0/3673073477 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f795c00c370 con 0x7f795c0039c0 2024-04-24T23:00:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796effd640 1 --2- 172.21.15.43:0/3673073477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f795c004810 0x7f795c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796f7fe640 1 --2- 172.21.15.43:0/3673073477 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0039c0 0x7f795c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796ffff640 1 --2- 172.21.15.43:0/3673073477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795c0051d0 0x7f795c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796effd640 1 -- 172.21.15.43:0/3673073477 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0039c0 msgr2=0x7f795c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796effd640 1 --2- 172.21.15.43:0/3673073477 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0039c0 0x7f795c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796effd640 1 -- 172.21.15.43:0/3673073477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795c0051d0 msgr2=0x7f795c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796effd640 1 --2- 172.21.15.43:0/3673073477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795c0051d0 0x7f795c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796effd640 1 -- 172.21.15.43:0/3673073477 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795c003530 con 0x7f795c004810 2024-04-24T23:00:12.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.644+0000 7f796ffff640 1 -- 172.21.15.43:0/3673073477 reap_dead start 2024-04-24T23:00:12.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f796effd640 1 --2- 172.21.15.43:0/3673073477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f795c004810 0x7f795c004c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f796000c210 tx=0x7f796001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1839957d7824c947 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:12.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f796e7fc640 1 -- 172.21.15.43:0/3673073477 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960007d40 con 0x7f795c004810 2024-04-24T23:00:12.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f796e7fc640 1 -- 172.21.15.43:0/3673073477 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79600a9070 con 0x7f795c004810 2024-04-24T23:00:12.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f796e7fc640 1 -- 172.21.15.43:0/3673073477 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960005d80 con 0x7f795c004810 2024-04-24T23:00:12.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f7975d28640 1 -- 172.21.15.43:0/3673073477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f795c004810 msgr2=0x7f795c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f7975d28640 1 --2- 172.21.15.43:0/3673073477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f795c004810 0x7f795c004c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f796000c210 tx=0x7f796001cca0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f7975d28640 1 -- 172.21.15.43:0/3673073477 shutdown_connections 2024-04-24T23:00:12.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f7975d28640 1 --2- 172.21.15.43:0/3673073477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f795c004810 0x7f795c004c90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f7975d28640 1 -- 172.21.15.43:0/3673073477 >> 172.21.15.43:0/3673073477 conn(0x7f79700b5690 msgr2=0x7f79700b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:12.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f7975d28640 1 -- 172.21.15.43:0/3673073477 shutdown_connections 2024-04-24T23:00:12.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f7975d28640 1 -- 172.21.15.43:0/3673073477 wait complete. 2024-04-24T23:00:12.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f7975d28640 1 Processor -- start 2024-04-24T23:00:12.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f7975d28640 1 -- start start 2024-04-24T23:00:12.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f7975d28640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795c004810 0x7f79701d2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f7975d28640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f797013ed60 0x7f7970141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f7975d28640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7970146d70 0x7f797013de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f7975d28640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7970147950 con 0x7f797013ed60 2024-04-24T23:00:12.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f7975d28640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79701477d0 con 0x7f795c004810 2024-04-24T23:00:12.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f7975d28640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7970147ad0 con 0x7f7970146d70 2024-04-24T23:00:12.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f796effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f797013ed60 0x7f7970141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f796effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f797013ed60 0x7f7970141790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45196/0 (socket says 172.21.15.43:45196) 2024-04-24T23:00:12.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f796effd640 1 -- 172.21.15.43:0/628700042 learned_addr learned my addr 172.21.15.43:0/628700042 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:12.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f796f7fe640 1 --2- 172.21.15.43:0/628700042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795c004810 0x7f79701d2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f796ffff640 1 --2- 172.21.15.43:0/628700042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7970146d70 0x7f797013de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f796effd640 1 -- 172.21.15.43:0/628700042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7970146d70 msgr2=0x7f797013de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f796effd640 1 --2- 172.21.15.43:0/628700042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7970146d70 0x7f797013de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f796effd640 1 -- 172.21.15.43:0/628700042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795c004810 msgr2=0x7f79701d2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f796effd640 1 --2- 172.21.15.43:0/628700042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795c004810 0x7f79701d2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.648+0000 7f796effd640 1 -- 172.21.15.43:0/628700042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797013fb70 con 0x7f797013ed60 2024-04-24T23:00:12.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.652+0000 7f796effd640 1 --2- 172.21.15.43:0/628700042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f797013ed60 0x7f7970141790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f796001cad0 tx=0x7f795c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:12.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.652+0000 7f7967fff640 1 -- 172.21.15.43:0/628700042 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960007240 con 0x7f797013ed60 2024-04-24T23:00:12.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.652+0000 7f7967fff640 1 -- 172.21.15.43:0/628700042 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79600073e0 con 0x7f797013ed60 2024-04-24T23:00:12.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.652+0000 7f7975d28640 1 -- 172.21.15.43:0/628700042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797013fe50 con 0x7f797013ed60 2024-04-24T23:00:12.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.652+0000 7f7967fff640 1 -- 172.21.15.43:0/628700042 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79600a5870 con 0x7f797013ed60 2024-04-24T23:00:12.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.652+0000 7f7975d28640 1 -- 172.21.15.43:0/628700042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79701d3710 con 0x7f797013ed60 2024-04-24T23:00:12.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.652+0000 7f7975d28640 1 -- 172.21.15.43:0/628700042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7970140020 con 0x7f797013ed60 2024-04-24T23:00:12.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.652+0000 7f7967fff640 1 -- 172.21.15.43:0/628700042 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f79600a5a10 con 0x7f797013ed60 2024-04-24T23:00:12.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.652+0000 7f7967fff640 1 --2- 172.21.15.43:0/628700042 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f79500678f0 0x7f7950069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.652+0000 7f796f7fe640 1 --2- 172.21.15.43:0/628700042 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f79500678f0 0x7f7950069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.652+0000 7f7967fff640 1 -- 172.21.15.43:0/628700042 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f796011f3d0 con 0x7f797013ed60 2024-04-24T23:00:12.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.652+0000 7f796f7fe640 1 --2- 172.21.15.43:0/628700042 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f79500678f0 0x7f7950069db0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7958009ab0 tx=0x7f7958008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:12.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.656+0000 7f7967fff640 1 -- 172.21.15.43:0/628700042 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f79600169b0 con 0x7f797013ed60 2024-04-24T23:00:12.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.852+0000 7f7975d28640 1 -- 172.21.15.43:0/628700042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f797004f580 con 0x7f797013ed60 2024-04-24T23:00:12.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.852+0000 7f7967fff640 1 -- 172.21.15.43:0/628700042 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2216 (secure 0 0 0) 0x7f79600b6320 con 0x7f797013ed60 2024-04-24T23:00:12.856 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:12.856 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/2236776475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2236776475},{"type":"v1","addr":"172.21.15.162:6833","nonce":2236776475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/152091432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":152091432},{"type":"v1","addr":"172.21.15.43:6835","nonce":152091432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-24T23:00:12.856 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 3 2024-04-24T23:00:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.852+0000 7f7975d28640 1 -- 172.21.15.43:0/628700042 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f79500678f0 msgr2=0x7f7950069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.852+0000 7f7975d28640 1 --2- 172.21.15.43:0/628700042 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f79500678f0 0x7f7950069db0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7958009ab0 tx=0x7f7958008040 comp rx=0 tx=0).stop 2024-04-24T23:00:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.852+0000 7f7975d28640 1 -- 172.21.15.43:0/628700042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f797013ed60 msgr2=0x7f7970141790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.852+0000 7f7975d28640 1 --2- 172.21.15.43:0/628700042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f797013ed60 0x7f7970141790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f796001cad0 tx=0x7f795c005840 comp rx=0 tx=0).stop 2024-04-24T23:00:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.852+0000 7f7975d28640 1 -- 172.21.15.43:0/628700042 shutdown_connections 2024-04-24T23:00:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.852+0000 7f7975d28640 1 --2- 172.21.15.43:0/628700042 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f79500678f0 0x7f7950069db0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.852+0000 7f7975d28640 1 --2- 172.21.15.43:0/628700042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7970146d70 0x7f797013de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.852+0000 7f7975d28640 1 --2- 172.21.15.43:0/628700042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f797013ed60 0x7f7970141790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.852+0000 7f7975d28640 1 --2- 172.21.15.43:0/628700042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795c004810 0x7f79701d2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.852+0000 7f7975d28640 1 -- 172.21.15.43:0/628700042 >> 172.21.15.43:0/628700042 conn(0x7f79700b5690 msgr2=0x7f7970148110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.852+0000 7f7975d28640 1 -- 172.21.15.43:0/628700042 shutdown_connections 2024-04-24T23:00:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.852+0000 7f7975d28640 1 -- 172.21.15.43:0/628700042 wait complete. 2024-04-24T23:00:12.873 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:12.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.976+0000 7fe227dd1640 1 Processor -- start 2024-04-24T23:00:12.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.976+0000 7fe227dd1640 1 -- start start 2024-04-24T23:00:12.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe227dd1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22013f1f0 0x7fe22013f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe227dd1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe22014dce0 0x7fe2201500d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe227dd1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe220070060 con 0x7fe2200b2500 2024-04-24T23:00:12.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe227dd1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe2200b28e0 con 0x7fe22014dce0 2024-04-24T23:00:12.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe227dd1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe22013fb90 con 0x7fe22013f1f0 2024-04-24T23:00:12.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe22636e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe22014dce0 0x7fe2201500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe22536c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22013f1f0 0x7fe22013f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe225b6d640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe2200b2500 0x7fe220145450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.43:55636/0 (socket says 172.21.15.43:55636) 2024-04-24T23:00:12.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe225b6d640 1 -- 172.21.15.43:0/4048843075 learned_addr learned my addr 172.21.15.43:0/4048843075 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:12.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe22536c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22013f1f0 0x7fe22013f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.43:40586/0 (socket says 172.21.15.43:40586) 2024-04-24T23:00:12.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe22536c640 1 -- 172.21.15.43:0/4048843075 >> v2:172.21.15.162:3300/0 conn(0x7fe22014dce0 msgr2=0x7fe2201500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:12.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe22536c640 1 --2- 172.21.15.43:0/4048843075 >> v2:172.21.15.162:3300/0 conn(0x7fe22014dce0 0x7fe2201500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe22536c640 1 -- 172.21.15.43:0/4048843075 >> v1:172.21.15.162:6789/0 conn(0x7fe2200b2500 legacy=0x7fe220145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe22536c640 1 -- 172.21.15.43:0/4048843075 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2200af8f0 con 0x7fe22013f1f0 2024-04-24T23:00:12.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe22636e640 1 --2- 172.21.15.43:0/4048843075 >> v2:172.21.15.162:3300/0 conn(0x7fe22014dce0 0x7fe2201500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:00:12.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.980+0000 7fe22536c640 1 --2- 172.21.15.43:0/4048843075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22013f1f0 0x7fe22013f650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe2100097c0 tx=0x7fe21001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6392128d07b93223 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:12.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe224b6b640 1 -- 172.21.15.43:0/4048843075 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2100b0070 con 0x7fe22013f1f0 2024-04-24T23:00:12.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe224b6b640 1 -- 172.21.15.43:0/4048843075 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2100ab600 con 0x7fe22013f1f0 2024-04-24T23:00:12.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe224b6b640 1 -- 172.21.15.43:0/4048843075 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2100ab9d0 con 0x7fe22013f1f0 2024-04-24T23:00:12.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 -- 172.21.15.43:0/4048843075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22013f1f0 msgr2=0x7fe22013f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 --2- 172.21.15.43:0/4048843075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22013f1f0 0x7fe22013f650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe2100097c0 tx=0x7fe21001c4a0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 -- 172.21.15.43:0/4048843075 shutdown_connections 2024-04-24T23:00:12.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 --2- 172.21.15.43:0/4048843075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22013f1f0 0x7fe22013f650 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 --2- 172.21.15.43:0/4048843075 >> v2:172.21.15.162:3300/0 conn(0x7fe22014dce0 0x7fe2201500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 -- 172.21.15.43:0/4048843075 >> 172.21.15.43:0/4048843075 conn(0x7fe2200b5690 msgr2=0x7fe2200b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:12.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 -- 172.21.15.43:0/4048843075 shutdown_connections 2024-04-24T23:00:12.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 -- 172.21.15.43:0/4048843075 wait complete. 2024-04-24T23:00:12.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 Processor -- start 2024-04-24T23:00:12.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 -- start start 2024-04-24T23:00:12.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2200b2500 0x7fe2200b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22013f1f0 0x7fe2201e1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe22014dce0 0x7fe2201e17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe2200b5410 con 0x7fe22014dce0 2024-04-24T23:00:12.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2200b5290 con 0x7fe2200b2500 2024-04-24T23:00:12.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe227dd1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe2200b4af0 con 0x7fe22013f1f0 2024-04-24T23:00:12.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe22636e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe22014dce0 0x7fe2201e17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe22636e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe22014dce0 0x7fe2201e17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45200/0 (socket says 172.21.15.43:45200) 2024-04-24T23:00:12.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe22636e640 1 -- 172.21.15.43:0/242276806 learned_addr learned my addr 172.21.15.43:0/242276806 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:12.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe225b6d640 1 --2- 172.21.15.43:0/242276806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2200b2500 0x7fe2200b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe22536c640 1 --2- 172.21.15.43:0/242276806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22013f1f0 0x7fe2201e1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe22636e640 1 -- 172.21.15.43:0/242276806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22013f1f0 msgr2=0x7fe2201e1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe22636e640 1 --2- 172.21.15.43:0/242276806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22013f1f0 0x7fe2201e1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe22636e640 1 -- 172.21.15.43:0/242276806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2200b2500 msgr2=0x7fe2200b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:12.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe22636e640 1 --2- 172.21.15.43:0/242276806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2200b2500 0x7fe2200b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:12.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe22636e640 1 -- 172.21.15.43:0/242276806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22013aec0 con 0x7fe22014dce0 2024-04-24T23:00:12.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.984+0000 7fe22536c640 1 --2- 172.21.15.43:0/242276806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22013f1f0 0x7fe2201e1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:12.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.988+0000 7fe22636e640 1 --2- 172.21.15.43:0/242276806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe22014dce0 0x7fe2201e17c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe21800efc0 tx=0x7fe218009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:12.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.988+0000 7fe2167fc640 1 -- 172.21.15.43:0/242276806 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe218018030 con 0x7fe22014dce0 2024-04-24T23:00:12.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.988+0000 7fe2167fc640 1 -- 172.21.15.43:0/242276806 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21800cde0 con 0x7fe22014dce0 2024-04-24T23:00:12.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.988+0000 7fe227dd1640 1 -- 172.21.15.43:0/242276806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2200b7bf0 con 0x7fe22014dce0 2024-04-24T23:00:12.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.988+0000 7fe2167fc640 1 -- 172.21.15.43:0/242276806 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe218003bc0 con 0x7fe22014dce0 2024-04-24T23:00:12.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.988+0000 7fe227dd1640 1 -- 172.21.15.43:0/242276806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2200b81b0 con 0x7fe22014dce0 2024-04-24T23:00:12.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.988+0000 7fe227dd1640 1 -- 172.21.15.43:0/242276806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe22004f580 con 0x7fe22014dce0 2024-04-24T23:00:12.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.988+0000 7fe2167fc640 1 -- 172.21.15.43:0/242276806 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe21801b070 con 0x7fe22014dce0 2024-04-24T23:00:12.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.988+0000 7fe2167fc640 1 --2- 172.21.15.43:0/242276806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe2040678c0 0x7fe204069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:12.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.988+0000 7fe2167fc640 1 -- 172.21.15.43:0/242276806 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fe218086300 con 0x7fe22014dce0 2024-04-24T23:00:12.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.988+0000 7fe225b6d640 1 --2- 172.21.15.43:0/242276806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe2040678c0 0x7fe204069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:12.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.988+0000 7fe225b6d640 1 --2- 172.21.15.43:0/242276806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe2040678c0 0x7fe204069d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe21c005890 tx=0x7fe21c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:12.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:12.992+0000 7fe2167fc640 1 -- 172.21.15.43:0/242276806 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe218022070 con 0x7fe22014dce0 2024-04-24T23:00:13.013 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:00:13.015 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:00:13.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.152+0000 7fe227dd1640 1 -- 172.21.15.43:0/242276806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe220145fd0 con 0x7fe22014dce0 2024-04-24T23:00:13.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.156+0000 7fe2167fc640 1 -- 172.21.15.43:0/242276806 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12884 (secure 0 0 0) 0x7fe218010040 con 0x7fe22014dce0 2024-04-24T23:00:13.159 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:13.160 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:04.336463+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:13.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.156+0000 7fe227dd1640 1 -- 172.21.15.43:0/242276806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe2040678c0 msgr2=0x7fe204069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.156+0000 7fe227dd1640 1 --2- 172.21.15.43:0/242276806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe2040678c0 0x7fe204069d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe21c005890 tx=0x7fe21c009040 comp rx=0 tx=0).stop 2024-04-24T23:00:13.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.156+0000 7fe227dd1640 1 -- 172.21.15.43:0/242276806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe22014dce0 msgr2=0x7fe2201e17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.156+0000 7fe227dd1640 1 --2- 172.21.15.43:0/242276806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe22014dce0 0x7fe2201e17c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe21800efc0 tx=0x7fe218009f90 comp rx=0 tx=0).stop 2024-04-24T23:00:13.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.156+0000 7fe227dd1640 1 -- 172.21.15.43:0/242276806 shutdown_connections 2024-04-24T23:00:13.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.156+0000 7fe227dd1640 1 --2- 172.21.15.43:0/242276806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe2040678c0 0x7fe204069d80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.156+0000 7fe227dd1640 1 --2- 172.21.15.43:0/242276806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe22014dce0 0x7fe2201e17c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.156+0000 7fe227dd1640 1 --2- 172.21.15.43:0/242276806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe22013f1f0 0x7fe2201e1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.156+0000 7fe227dd1640 1 --2- 172.21.15.43:0/242276806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2200b2500 0x7fe2200b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.156+0000 7fe227dd1640 1 -- 172.21.15.43:0/242276806 >> 172.21.15.43:0/242276806 conn(0x7fe2200b5690 msgr2=0x7fe22006d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:13.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.156+0000 7fe227dd1640 1 -- 172.21.15.43:0/242276806 shutdown_connections 2024-04-24T23:00:13.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.156+0000 7fe227dd1640 1 -- 172.21.15.43:0/242276806 wait complete. 2024-04-24T23:00:13.178 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:00:02.322280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-24T23:00:13.178 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:00:13.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.296+0000 7f5deb555640 1 Processor -- start 2024-04-24T23:00:13.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.296+0000 7f5deb555640 1 -- start start 2024-04-24T23:00:13.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.296+0000 7f5deb555640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5de40af4e0 0x7f5de4144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.296+0000 7f5deb555640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5de40b0060 0x7f5de4071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.296+0000 7f5deb555640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de40af8c0 con 0x7f5de4141600 2024-04-24T23:00:13.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.296+0000 7f5deb555640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f5de40717d0 con 0x7f5de40af4e0 2024-04-24T23:00:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.296+0000 7f5deb555640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5de41443f0 con 0x7f5de40b0060 2024-04-24T23:00:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.296+0000 7f5de92f1640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5de40af4e0 0x7f5de4144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.296+0000 7f5de92f1640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5de40af4e0 0x7f5de4144ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45212/0 (socket says 172.21.15.43:45212) 2024-04-24T23:00:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.296+0000 7f5de92f1640 1 -- 172.21.15.43:0/3532018289 learned_addr learned my addr 172.21.15.43:0/3532018289 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.296+0000 7f5de8af0640 1 --2- 172.21.15.43:0/3532018289 >> v2:172.21.15.162:3300/0 conn(0x7f5de40b0060 0x7f5de4071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.296+0000 7f5de92f1640 1 -- 172.21.15.43:0/3532018289 >> v2:172.21.15.162:3300/0 conn(0x7f5de40b0060 msgr2=0x7f5de4071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.296+0000 7f5de92f1640 1 --2- 172.21.15.43:0/3532018289 >> v2:172.21.15.162:3300/0 conn(0x7f5de40b0060 0x7f5de4071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.296+0000 7f5de92f1640 1 -- 172.21.15.43:0/3532018289 >> v1:172.21.15.162:6789/0 conn(0x7f5de4141600 legacy=0x7f5de4147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.296+0000 7f5de92f1640 1 -- 172.21.15.43:0/3532018289 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de41446d0 con 0x7f5de40af4e0 2024-04-24T23:00:13.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5de92f1640 1 --2- 172.21.15.43:0/3532018289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de40af4e0 0x7f5de4144ed0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5de4074010 tx=0x7f5dd801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ffe312152b8e2d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:13.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5de3fff640 1 -- 172.21.15.43:0/3532018289 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd80aa5f0 con 0x7f5de40af4e0 2024-04-24T23:00:13.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5de3fff640 1 -- 172.21.15.43:0/3532018289 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd80af070 con 0x7f5de40af4e0 2024-04-24T23:00:13.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5de3fff640 1 -- 172.21.15.43:0/3532018289 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd80aa9b0 con 0x7f5de40af4e0 2024-04-24T23:00:13.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 -- 172.21.15.43:0/3532018289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de40af4e0 msgr2=0x7f5de4144ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 --2- 172.21.15.43:0/3532018289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de40af4e0 0x7f5de4144ed0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5de4074010 tx=0x7f5dd801c4b0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 -- 172.21.15.43:0/3532018289 shutdown_connections 2024-04-24T23:00:13.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 --2- 172.21.15.43:0/3532018289 >> v2:172.21.15.162:3300/0 conn(0x7f5de40b0060 0x7f5de4071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 --2- 172.21.15.43:0/3532018289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de40af4e0 0x7f5de4144ed0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 -- 172.21.15.43:0/3532018289 >> 172.21.15.43:0/3532018289 conn(0x7f5de406e7e0 msgr2=0x7f5de406b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:13.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 -- 172.21.15.43:0/3532018289 shutdown_connections 2024-04-24T23:00:13.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 -- 172.21.15.43:0/3532018289 wait complete. 2024-04-24T23:00:13.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 Processor -- start 2024-04-24T23:00:13.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 -- start start 2024-04-24T23:00:13.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5de40af4e0 0x7f5de413be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de40b0060 0x7f5de40b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de4141600 0x7f5de40b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5de414fb90 con 0x7f5de4141600 2024-04-24T23:00:13.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5de409fe70 con 0x7f5de40b0060 2024-04-24T23:00:13.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5deb555640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5de414fd10 con 0x7f5de40af4e0 2024-04-24T23:00:13.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5de9af2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de4141600 0x7f5de40b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5de9af2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de4141600 0x7f5de40b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45220/0 (socket says 172.21.15.43:45220) 2024-04-24T23:00:13.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5de9af2640 1 -- 172.21.15.43:0/2081679880 learned_addr learned my addr 172.21.15.43:0/2081679880 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:13.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5de8af0640 1 --2- 172.21.15.43:0/2081679880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de40b0060 0x7f5de40b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5de9af2640 1 -- 172.21.15.43:0/2081679880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5de40af4e0 msgr2=0x7f5de413be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5de9af2640 1 --2- 172.21.15.43:0/2081679880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5de40af4e0 0x7f5de413be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5de9af2640 1 -- 172.21.15.43:0/2081679880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de40b0060 msgr2=0x7f5de40b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5de9af2640 1 --2- 172.21.15.43:0/2081679880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de40b0060 0x7f5de40b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.300+0000 7f5de9af2640 1 -- 172.21.15.43:0/2081679880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de413e910 con 0x7f5de4141600 2024-04-24T23:00:13.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.304+0000 7f5de9af2640 1 --2- 172.21.15.43:0/2081679880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de4141600 0x7f5de40b5260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00b410 tx=0x7f5ddc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:13.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.304+0000 7f5de1ffb640 1 -- 172.21.15.43:0/2081679880 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc015020 con 0x7f5de4141600 2024-04-24T23:00:13.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.304+0000 7f5de1ffb640 1 -- 172.21.15.43:0/2081679880 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ddc011870 con 0x7f5de4141600 2024-04-24T23:00:13.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.304+0000 7f5de1ffb640 1 -- 172.21.15.43:0/2081679880 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc011c60 con 0x7f5de4141600 2024-04-24T23:00:13.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.304+0000 7f5deb555640 1 -- 172.21.15.43:0/2081679880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de413d060 con 0x7f5de4141600 2024-04-24T23:00:13.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.304+0000 7f5deb555640 1 -- 172.21.15.43:0/2081679880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de413d620 con 0x7f5de4141600 2024-04-24T23:00:13.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.304+0000 7f5deb555640 1 -- 172.21.15.43:0/2081679880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de406cba0 con 0x7f5de4141600 2024-04-24T23:00:13.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.304+0000 7f5de1ffb640 1 -- 172.21.15.43:0/2081679880 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ddc018020 con 0x7f5de4141600 2024-04-24T23:00:13.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.304+0000 7f5de1ffb640 1 --2- 172.21.15.43:0/2081679880 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5dd00678c0 0x7f5dd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.304+0000 7f5de1ffb640 1 -- 172.21.15.43:0/2081679880 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f5ddc0857d0 con 0x7f5de4141600 2024-04-24T23:00:13.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.304+0000 7f5de92f1640 1 --2- 172.21.15.43:0/2081679880 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5dd00678c0 0x7f5dd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.304+0000 7f5de92f1640 1 --2- 172.21.15.43:0/2081679880 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5dd00678c0 0x7f5dd0069d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80ae000 tx=0x7f5dd8004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:13.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.308+0000 7f5de1ffb640 1 -- 172.21.15.43:0/2081679880 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5ddc01f020 con 0x7f5de4141600 2024-04-24T23:00:13.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.464+0000 7f5deb555640 1 -- 172.21.15.43:0/2081679880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5de41368a0 con 0x7f5de4141600 2024-04-24T23:00:13.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.464+0000 7f5de1ffb640 1 -- 172.21.15.43:0/2081679880 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f5ddc0172c0 con 0x7f5de4141600 2024-04-24T23:00:13.470 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-24T23:00:13.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.468+0000 7f5deb555640 1 -- 172.21.15.43:0/2081679880 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5dd00678c0 msgr2=0x7f5dd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.468+0000 7f5deb555640 1 --2- 172.21.15.43:0/2081679880 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5dd00678c0 0x7f5dd0069d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80ae000 tx=0x7f5dd8004740 comp rx=0 tx=0).stop 2024-04-24T23:00:13.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.468+0000 7f5deb555640 1 -- 172.21.15.43:0/2081679880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de4141600 msgr2=0x7f5de40b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.468+0000 7f5deb555640 1 --2- 172.21.15.43:0/2081679880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de4141600 0x7f5de40b5260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00b410 tx=0x7f5ddc00b8d0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.468+0000 7f5deb555640 1 -- 172.21.15.43:0/2081679880 shutdown_connections 2024-04-24T23:00:13.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.468+0000 7f5deb555640 1 --2- 172.21.15.43:0/2081679880 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5dd00678c0 0x7f5dd0069d80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.468+0000 7f5deb555640 1 --2- 172.21.15.43:0/2081679880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de4141600 0x7f5de40b5260 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.468+0000 7f5deb555640 1 --2- 172.21.15.43:0/2081679880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de40b0060 0x7f5de40b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.468+0000 7f5deb555640 1 --2- 172.21.15.43:0/2081679880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5de40af4e0 0x7f5de413be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.468+0000 7f5deb555640 1 -- 172.21.15.43:0/2081679880 >> 172.21.15.43:0/2081679880 conn(0x7f5de406e7e0 msgr2=0x7f5de406bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:13.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.468+0000 7f5deb555640 1 -- 172.21.15.43:0/2081679880 shutdown_connections 2024-04-24T23:00:13.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.468+0000 7f5deb555640 1 -- 172.21.15.43:0/2081679880 wait complete. 2024-04-24T23:00:13.488 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-24T23:00:13.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc425f68640 1 Processor -- start 2024-04-24T23:00:13.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc425f68640 1 -- start start 2024-04-24T23:00:13.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc425f68640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc420070ca0 0x7fc420072670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc425f68640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4200b6f30 0x7fc420141320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc425f68640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc420141860 0x7fc42014ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc425f68640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc420072bb0 con 0x7fc420070ca0 2024-04-24T23:00:13.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc425f68640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc420071080 con 0x7fc420141860 2024-04-24T23:00:13.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc425f68640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4200721e0 con 0x7fc4200b6f30 2024-04-24T23:00:13.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc41f7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc420070ca0 0x7fc420072670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc41f7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc420070ca0 0x7fc420072670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45230/0 (socket says 172.21.15.43:45230) 2024-04-24T23:00:13.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc41f7fe640 1 -- 172.21.15.43:0/1286792859 learned_addr learned my addr 172.21.15.43:0/1286792859 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:13.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc41ffff640 1 --2- 172.21.15.43:0/1286792859 >> v2:172.21.15.162:3300/0 conn(0x7fc420141860 0x7fc42014ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc41effd640 1 --2- 172.21.15.43:0/1286792859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4200b6f30 0x7fc420141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc41f7fe640 1 -- 172.21.15.43:0/1286792859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4200b6f30 msgr2=0x7fc420141320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:13.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc41f7fe640 1 --2- 172.21.15.43:0/1286792859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4200b6f30 0x7fc420141320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc41f7fe640 1 -- 172.21.15.43:0/1286792859 >> v2:172.21.15.162:3300/0 conn(0x7fc420141860 msgr2=0x7fc42014ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:13.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc41f7fe640 1 --2- 172.21.15.43:0/1286792859 >> v2:172.21.15.162:3300/0 conn(0x7fc420141860 0x7fc42014ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc41f7fe640 1 -- 172.21.15.43:0/1286792859 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc420072dd0 con 0x7fc420070ca0 2024-04-24T23:00:13.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc41ffff640 1 --2- 172.21.15.43:0/1286792859 >> v2:172.21.15.162:3300/0 conn(0x7fc420141860 0x7fc42014ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:13.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.596+0000 7fc41f7fe640 1 --2- 172.21.15.43:0/1286792859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc420070ca0 0x7fc420072670 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc4200b4c20 tx=0x7fc41001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05a8e53d104e25e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:13.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc41e7fc640 1 -- 172.21.15.43:0/1286792859 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4100b1070 con 0x7fc420070ca0 2024-04-24T23:00:13.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc41e7fc640 1 -- 172.21.15.43:0/1286792859 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4100ac630 con 0x7fc420070ca0 2024-04-24T23:00:13.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc41e7fc640 1 -- 172.21.15.43:0/1286792859 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4100a8050 con 0x7fc420070ca0 2024-04-24T23:00:13.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 -- 172.21.15.43:0/1286792859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc420070ca0 msgr2=0x7fc420072670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 --2- 172.21.15.43:0/1286792859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc420070ca0 0x7fc420072670 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc4200b4c20 tx=0x7fc41001c520 comp rx=0 tx=0).stop 2024-04-24T23:00:13.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 -- 172.21.15.43:0/1286792859 shutdown_connections 2024-04-24T23:00:13.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 --2- 172.21.15.43:0/1286792859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4200b6f30 0x7fc420141320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 --2- 172.21.15.43:0/1286792859 >> v2:172.21.15.162:3300/0 conn(0x7fc420141860 0x7fc42014ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 --2- 172.21.15.43:0/1286792859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc420070ca0 0x7fc420072670 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 -- 172.21.15.43:0/1286792859 >> 172.21.15.43:0/1286792859 conn(0x7fc42006c4d0 msgr2=0x7fc42006c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:13.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 -- 172.21.15.43:0/1286792859 shutdown_connections 2024-04-24T23:00:13.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 -- 172.21.15.43:0/1286792859 wait complete. 2024-04-24T23:00:13.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 Processor -- start 2024-04-24T23:00:13.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 -- start start 2024-04-24T23:00:13.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc420070ca0 0x7fc42013fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4200b6f30 0x7fc4200b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc420141860 0x7fc4201e0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc42006bb80 con 0x7fc420070ca0 2024-04-24T23:00:13.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc42006ba00 con 0x7fc420141860 2024-04-24T23:00:13.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc42006bd00 con 0x7fc4200b6f30 2024-04-24T23:00:13.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc41f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc420070ca0 0x7fc42013fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc41f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc420070ca0 0x7fc42013fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45240/0 (socket says 172.21.15.43:45240) 2024-04-24T23:00:13.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc41f7fe640 1 -- 172.21.15.43:0/2243983728 learned_addr learned my addr 172.21.15.43:0/2243983728 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:13.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc41ffff640 1 --2- 172.21.15.43:0/2243983728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc420141860 0x7fc4201e0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc41effd640 1 --2- 172.21.15.43:0/2243983728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4200b6f30 0x7fc4200b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc41f7fe640 1 -- 172.21.15.43:0/2243983728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4200b6f30 msgr2=0x7fc4200b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc41f7fe640 1 --2- 172.21.15.43:0/2243983728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4200b6f30 0x7fc4200b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc41f7fe640 1 -- 172.21.15.43:0/2243983728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc420141860 msgr2=0x7fc4201e0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc41f7fe640 1 --2- 172.21.15.43:0/2243983728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc420141860 0x7fc4201e0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc41f7fe640 1 -- 172.21.15.43:0/2243983728 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc420139a90 con 0x7fc420070ca0 2024-04-24T23:00:13.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc41ffff640 1 --2- 172.21.15.43:0/2243983728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc420141860 0x7fc4201e0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:13.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc41f7fe640 1 --2- 172.21.15.43:0/2243983728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc420070ca0 0x7fc42013fc60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc4100af040 tx=0x7fc4100192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:13.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc407fff640 1 -- 172.21.15.43:0/2243983728 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4100bc070 con 0x7fc420070ca0 2024-04-24T23:00:13.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc407fff640 1 -- 172.21.15.43:0/2243983728 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4100b7650 con 0x7fc420070ca0 2024-04-24T23:00:13.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 -- 172.21.15.43:0/2243983728 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4200b22e0 con 0x7fc420070ca0 2024-04-24T23:00:13.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc407fff640 1 -- 172.21.15.43:0/2243983728 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4100b1040 con 0x7fc420070ca0 2024-04-24T23:00:13.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.600+0000 7fc425f68640 1 -- 172.21.15.43:0/2243983728 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4200b15c0 con 0x7fc420070ca0 2024-04-24T23:00:13.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.604+0000 7fc425f68640 1 -- 172.21.15.43:0/2243983728 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc42004f580 con 0x7fc420070ca0 2024-04-24T23:00:13.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.604+0000 7fc407fff640 1 -- 172.21.15.43:0/2243983728 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc4100bf070 con 0x7fc420070ca0 2024-04-24T23:00:13.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.604+0000 7fc407fff640 1 --2- 172.21.15.43:0/2243983728 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc40c0678c0 0x7fc40c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.604+0000 7fc407fff640 1 -- 172.21.15.43:0/2243983728 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fc41011f230 con 0x7fc420070ca0 2024-04-24T23:00:13.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.604+0000 7fc41effd640 1 --2- 172.21.15.43:0/2243983728 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc40c0678c0 0x7fc40c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.604+0000 7fc41effd640 1 --2- 172.21.15.43:0/2243983728 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc40c0678c0 0x7fc40c069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc4200b2e20 tx=0x7fc414008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:13.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.608+0000 7fc407fff640 1 -- 172.21.15.43:0/2243983728 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc410016110 con 0x7fc420070ca0 2024-04-24T23:00:13.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.768+0000 7fc425f68640 1 -- 172.21.15.43:0/2243983728 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc4200b6510 con 0x7fc420070ca0 2024-04-24T23:00:13.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.768+0000 7fc407fff640 1 -- 172.21.15.43:0/2243983728 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fc4100f0150 con 0x7fc420070ca0 2024-04-24T23:00:13.772 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:13.772 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2024-04-24T23:00:13.772 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:00:13.772 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2024-04-24T23:00:13.772 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2024-04-24T23:00:13.772 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:00:13.772 INFO:teuthology.orchestra.run.smithi043.stdout:] 2024-04-24T23:00:13.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.768+0000 7fc425f68640 1 -- 172.21.15.43:0/2243983728 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc40c0678c0 msgr2=0x7fc40c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.768+0000 7fc425f68640 1 --2- 172.21.15.43:0/2243983728 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc40c0678c0 0x7fc40c069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc4200b2e20 tx=0x7fc414008040 comp rx=0 tx=0).stop 2024-04-24T23:00:13.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.768+0000 7fc425f68640 1 -- 172.21.15.43:0/2243983728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc420070ca0 msgr2=0x7fc42013fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.768+0000 7fc425f68640 1 --2- 172.21.15.43:0/2243983728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc420070ca0 0x7fc42013fc60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc4100af040 tx=0x7fc4100192c0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.768+0000 7fc425f68640 1 -- 172.21.15.43:0/2243983728 shutdown_connections 2024-04-24T23:00:13.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.768+0000 7fc425f68640 1 --2- 172.21.15.43:0/2243983728 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc40c0678c0 0x7fc40c069d80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.768+0000 7fc425f68640 1 --2- 172.21.15.43:0/2243983728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc420141860 0x7fc4201e0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.768+0000 7fc425f68640 1 --2- 172.21.15.43:0/2243983728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4200b6f30 0x7fc4200b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.768+0000 7fc425f68640 1 --2- 172.21.15.43:0/2243983728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc420070ca0 0x7fc42013fc60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.768+0000 7fc425f68640 1 -- 172.21.15.43:0/2243983728 >> 172.21.15.43:0/2243983728 conn(0x7fc42006c4d0 msgr2=0x7fc4200b5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:13.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.768+0000 7fc425f68640 1 -- 172.21.15.43:0/2243983728 shutdown_connections 2024-04-24T23:00:13.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.768+0000 7fc425f68640 1 -- 172.21.15.43:0/2243983728 wait complete. 2024-04-24T23:00:13.790 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-24T23:00:13.790 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-24T23:00:13.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed2c246640 1 Processor -- start 2024-04-24T23:00:13.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed2c246640 1 -- start start 2024-04-24T23:00:13.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed2c246640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fed2406f430 0x7fed240b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed2c246640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fed24073080 0x7fed24145540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed2c246640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed240b1d10 0x7fed24145a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed2c246640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fed240b68b0 con 0x7fed24073080 2024-04-24T23:00:13.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed2c246640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fed240705f0 con 0x7fed2406f430 2024-04-24T23:00:13.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed2c246640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fed240b6b00 con 0x7fed240b1d10 2024-04-24T23:00:13.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed297e1640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fed24073080 0x7fed24145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed297e1640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fed24073080 0x7fed24145540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45250/0 (socket says 172.21.15.43:45250) 2024-04-24T23:00:13.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed297e1640 1 -- 172.21.15.43:0/3911050153 learned_addr learned my addr 172.21.15.43:0/3911050153 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:13.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed29fe2640 1 --2- 172.21.15.43:0/3911050153 >> v2:172.21.15.162:3300/0 conn(0x7fed2406f430 0x7fed240b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed2a7e3640 1 --2- 172.21.15.43:0/3911050153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed240b1d10 0x7fed24145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed297e1640 1 -- 172.21.15.43:0/3911050153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed240b1d10 msgr2=0x7fed24145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:13.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed297e1640 1 --2- 172.21.15.43:0/3911050153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed240b1d10 0x7fed24145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed297e1640 1 -- 172.21.15.43:0/3911050153 >> v2:172.21.15.162:3300/0 conn(0x7fed2406f430 msgr2=0x7fed240b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:13.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed297e1640 1 --2- 172.21.15.43:0/3911050153 >> v2:172.21.15.162:3300/0 conn(0x7fed2406f430 0x7fed240b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.916+0000 7fed297e1640 1 -- 172.21.15.43:0/3911050153 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed240b6de0 con 0x7fed24073080 2024-04-24T23:00:13.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed297e1640 1 --2- 172.21.15.43:0/3911050153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed24073080 0x7fed24145540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fed24074090 tx=0x7fed1801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd98cba87e9939 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:13.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed28fe0640 1 -- 172.21.15.43:0/3911050153 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed180b1070 con 0x7fed24073080 2024-04-24T23:00:13.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed28fe0640 1 -- 172.21.15.43:0/3911050153 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed180a8050 con 0x7fed24073080 2024-04-24T23:00:13.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed28fe0640 1 -- 172.21.15.43:0/3911050153 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed180ac860 con 0x7fed24073080 2024-04-24T23:00:13.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 -- 172.21.15.43:0/3911050153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed24073080 msgr2=0x7fed24145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 --2- 172.21.15.43:0/3911050153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed24073080 0x7fed24145540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fed24074090 tx=0x7fed1801c400 comp rx=0 tx=0).stop 2024-04-24T23:00:13.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 -- 172.21.15.43:0/3911050153 shutdown_connections 2024-04-24T23:00:13.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 --2- 172.21.15.43:0/3911050153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed240b1d10 0x7fed24145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 --2- 172.21.15.43:0/3911050153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed24073080 0x7fed24145540 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 --2- 172.21.15.43:0/3911050153 >> v2:172.21.15.162:3300/0 conn(0x7fed2406f430 0x7fed240b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 -- 172.21.15.43:0/3911050153 >> 172.21.15.43:0/3911050153 conn(0x7fed240b7880 msgr2=0x7fed240b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:13.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 -- 172.21.15.43:0/3911050153 shutdown_connections 2024-04-24T23:00:13.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 -- 172.21.15.43:0/3911050153 wait complete. 2024-04-24T23:00:13.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 Processor -- start 2024-04-24T23:00:13.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 -- start start 2024-04-24T23:00:13.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2406f430 0x7fed2409f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed24073080 0x7fed2406c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed240b1d10 0x7fed2406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fed240b5f90 con 0x7fed2406f430 2024-04-24T23:00:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fed240703d0 con 0x7fed24073080 2024-04-24T23:00:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed2c246640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fed240b6110 con 0x7fed240b1d10 2024-04-24T23:00:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed29fe2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2406f430 0x7fed2409f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed29fe2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2406f430 0x7fed2409f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45266/0 (socket says 172.21.15.43:45266) 2024-04-24T23:00:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.920+0000 7fed29fe2640 1 -- 172.21.15.43:0/4152495555 learned_addr learned my addr 172.21.15.43:0/4152495555 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed297e1640 1 --2- 172.21.15.43:0/4152495555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed24073080 0x7fed2406c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed2a7e3640 1 --2- 172.21.15.43:0/4152495555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed240b1d10 0x7fed2406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed29fe2640 1 -- 172.21.15.43:0/4152495555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed240b1d10 msgr2=0x7fed2406cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed29fe2640 1 --2- 172.21.15.43:0/4152495555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed240b1d10 0x7fed2406cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed29fe2640 1 -- 172.21.15.43:0/4152495555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed24073080 msgr2=0x7fed2406c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:13.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed29fe2640 1 --2- 172.21.15.43:0/4152495555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed24073080 0x7fed2406c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:13.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed29fe2640 1 -- 172.21.15.43:0/4152495555 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2413bfb0 con 0x7fed2406f430 2024-04-24T23:00:13.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed2a7e3640 1 --2- 172.21.15.43:0/4152495555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed240b1d10 0x7fed2406cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:13.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed29fe2640 1 --2- 172.21.15.43:0/4152495555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2406f430 0x7fed2409f0d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed20007e60 tx=0x7fed2000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:13.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed167fc640 1 -- 172.21.15.43:0/4152495555 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20014620 con 0x7fed2406f430 2024-04-24T23:00:13.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed167fc640 1 -- 172.21.15.43:0/4152495555 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed20019070 con 0x7fed2406f430 2024-04-24T23:00:13.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed167fc640 1 -- 172.21.15.43:0/4152495555 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20014a00 con 0x7fed2406f430 2024-04-24T23:00:13.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed2c246640 1 -- 172.21.15.43:0/4152495555 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2406d7d0 con 0x7fed2406f430 2024-04-24T23:00:13.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed2c246640 1 -- 172.21.15.43:0/4152495555 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed2413b9a0 con 0x7fed2406f430 2024-04-24T23:00:13.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed2c246640 1 -- 172.21.15.43:0/4152495555 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2404f580 con 0x7fed2406f430 2024-04-24T23:00:13.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed167fc640 1 -- 172.21.15.43:0/4152495555 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed20014ba0 con 0x7fed2406f430 2024-04-24T23:00:13.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed167fc640 1 --2- 172.21.15.43:0/4152495555 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fed080678c0 0x7fed08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:13.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed167fc640 1 -- 172.21.15.43:0/4152495555 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fed20086080 con 0x7fed2406f430 2024-04-24T23:00:13.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed297e1640 1 --2- 172.21.15.43:0/4152495555 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fed080678c0 0x7fed08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:13.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.924+0000 7fed297e1640 1 --2- 172.21.15.43:0/4152495555 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fed080678c0 0x7fed08069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fed180ae000 tx=0x7fed18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:13.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:13.928+0000 7fed167fc640 1 -- 172.21.15.43:0/4152495555 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fed20056fa0 con 0x7fed2406f430 2024-04-24T23:00:14.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.092+0000 7fed2c246640 1 -- 172.21.15.43:0/4152495555 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fed240b6570 con 0x7fed2406f430 2024-04-24T23:00:14.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.372+0000 7fed167fc640 1 -- 172.21.15.43:0/4152495555 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fed200568a0 con 0x7fed2406f430 2024-04-24T23:00:14.377 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2024-04-24T23:00:14.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.376+0000 7fed2c246640 1 -- 172.21.15.43:0/4152495555 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fed080678c0 msgr2=0x7fed08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:14.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.376+0000 7fed2c246640 1 --2- 172.21.15.43:0/4152495555 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fed080678c0 0x7fed08069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fed180ae000 tx=0x7fed18008040 comp rx=0 tx=0).stop 2024-04-24T23:00:14.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.376+0000 7fed2c246640 1 -- 172.21.15.43:0/4152495555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2406f430 msgr2=0x7fed2409f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:14.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.376+0000 7fed2c246640 1 --2- 172.21.15.43:0/4152495555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2406f430 0x7fed2409f0d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed20007e60 tx=0x7fed2000e4b0 comp rx=0 tx=0).stop 2024-04-24T23:00:14.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.376+0000 7fed2c246640 1 -- 172.21.15.43:0/4152495555 shutdown_connections 2024-04-24T23:00:14.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.376+0000 7fed2c246640 1 --2- 172.21.15.43:0/4152495555 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fed080678c0 0x7fed08069d80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:14.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.376+0000 7fed2c246640 1 --2- 172.21.15.43:0/4152495555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed240b1d10 0x7fed2406cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:14.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.376+0000 7fed2c246640 1 --2- 172.21.15.43:0/4152495555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed24073080 0x7fed2406c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:14.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.376+0000 7fed2c246640 1 --2- 172.21.15.43:0/4152495555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed2406f430 0x7fed2409f0d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:14.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.376+0000 7fed2c246640 1 -- 172.21.15.43:0/4152495555 >> 172.21.15.43:0/4152495555 conn(0x7fed240b7880 msgr2=0x7fed2413cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:14.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.376+0000 7fed2c246640 1 -- 172.21.15.43:0/4152495555 shutdown_connections 2024-04-24T23:00:14.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.376+0000 7fed2c246640 1 -- 172.21.15.43:0/4152495555 wait complete. 2024-04-24T23:00:14.408 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-24T23:00:14.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.540+0000 7fc37518a640 1 Processor -- start 2024-04-24T23:00:14.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.540+0000 7fc37518a640 1 -- start start 2024-04-24T23:00:14.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.540+0000 7fc37518a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37014add0 0x7fc3700b7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:14.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.540+0000 7fc37518a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc3701419a0 0x7fc370151f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:14.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.540+0000 7fc37518a640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3700b5670 con 0x7fc37014b820 2024-04-24T23:00:14.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.540+0000 7fc37518a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc3700b5a90 con 0x7fc3701419a0 2024-04-24T23:00:14.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.540+0000 7fc37518a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc3700b5d70 con 0x7fc37014add0 2024-04-24T23:00:14.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.540+0000 7fc36e59c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc37014b820 0x7fc370141290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37146/0 (socket says 172.21.15.43:37146) 2024-04-24T23:00:14.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.540+0000 7fc36e59c640 1 -- 172.21.15.43:0/3018085694 learned_addr learned my addr 172.21.15.43:0/3018085694 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:14.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.540+0000 7fc36ed9d640 1 --2- 172.21.15.43:0/3018085694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37014add0 0x7fc3700b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:14.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.540+0000 7fc36f59e640 1 --2- 172.21.15.43:0/3018085694 >> v2:172.21.15.162:3300/0 conn(0x7fc3701419a0 0x7fc370151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:14.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.540+0000 7fc36dd9b640 1 -- 172.21.15.43:0/3018085694 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 432297548 0 0) 0x7fc3700b5670 con 0x7fc37014b820 2024-04-24T23:00:14.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.540+0000 7fc36dd9b640 1 -- 172.21.15.43:0/3018085694 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc35c003530 con 0x7fc37014b820 2024-04-24T23:00:14.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 -- 172.21.15.43:0/3018085694 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3475905052 0 0) 0x7fc35c003530 con 0x7fc37014b820 2024-04-24T23:00:14.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 -- 172.21.15.43:0/3018085694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37014add0 msgr2=0x7fc3700b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:14.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 --2- 172.21.15.43:0/3018085694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37014add0 0x7fc3700b7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:14.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 -- 172.21.15.43:0/3018085694 >> v2:172.21.15.162:3300/0 conn(0x7fc3701419a0 msgr2=0x7fc370151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:14.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 --2- 172.21.15.43:0/3018085694 >> v2:172.21.15.162:3300/0 conn(0x7fc3701419a0 0x7fc370151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:14.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 -- 172.21.15.43:0/3018085694 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3700b7dd0 con 0x7fc37014b820 2024-04-24T23:00:14.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 -- 172.21.15.43:0/3018085694 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7fc360001680 con 0x7fc37014b820 2024-04-24T23:00:14.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 -- 172.21.15.43:0/3018085694 >> v1:172.21.15.43:6789/0 conn(0x7fc37014b820 legacy=0x7fc370141290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:14.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 --2- 172.21.15.43:0/3018085694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc35c0039c0 0x7fc35c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:14.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 --2- 172.21.15.43:0/3018085694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37014add0 0x7fc35c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:14.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 --2- 172.21.15.43:0/3018085694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35c004d50 0x7fc35c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:14.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 -- 172.21.15.43:0/3018085694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3700b5a90 con 0x7fc35c0039c0 2024-04-24T23:00:14.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 -- 172.21.15.43:0/3018085694 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3700b5d70 con 0x7fc35c004d50 2024-04-24T23:00:14.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 -- 172.21.15.43:0/3018085694 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc35c00b9d0 con 0x7fc37014add0 2024-04-24T23:00:14.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36ed9d640 1 --2- 172.21.15.43:0/3018085694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc35c0039c0 0x7fc35c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:14.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36e59c640 1 --2- 172.21.15.43:0/3018085694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37014add0 0x7fc35c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:14.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36ed9d640 1 -- 172.21.15.43:0/3018085694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37014add0 msgr2=0x7fc35c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:14.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36ed9d640 1 --2- 172.21.15.43:0/3018085694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37014add0 0x7fc35c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:14.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36ed9d640 1 -- 172.21.15.43:0/3018085694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35c004d50 msgr2=0x7fc35c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:14.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36ed9d640 1 --2- 172.21.15.43:0/3018085694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35c004d50 0x7fc35c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:14.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36ed9d640 1 -- 172.21.15.43:0/3018085694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35c003530 con 0x7fc35c0039c0 2024-04-24T23:00:14.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36ed9d640 1 --2- 172.21.15.43:0/3018085694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc35c0039c0 0x7fc35c003de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc358009ae0 tx=0x7fc35801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57919442cef484ca server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:14.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 -- 172.21.15.43:0/3018085694 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3580096b0 con 0x7fc35c0039c0 2024-04-24T23:00:14.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 -- 172.21.15.43:0/3018085694 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3580a6450 con 0x7fc35c0039c0 2024-04-24T23:00:14.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36dd9b640 1 -- 172.21.15.43:0/3018085694 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3580a6840 con 0x7fc35c0039c0 2024-04-24T23:00:14.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc37518a640 1 -- 172.21.15.43:0/3018085694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc35c0039c0 msgr2=0x7fc35c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:14.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc37518a640 1 --2- 172.21.15.43:0/3018085694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc35c0039c0 0x7fc35c003de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc358009ae0 tx=0x7fc35801ca70 comp rx=0 tx=0).stop 2024-04-24T23:00:14.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc36f59e640 1 -- 172.21.15.43:0/3018085694 reap_dead start 2024-04-24T23:00:14.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc37518a640 1 -- 172.21.15.43:0/3018085694 shutdown_connections 2024-04-24T23:00:14.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc37518a640 1 -- 172.21.15.43:0/3018085694 >> 172.21.15.43:0/3018085694 conn(0x7fc3700b9990 msgr2=0x7fc3700b9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:14.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc37518a640 1 -- 172.21.15.43:0/3018085694 shutdown_connections 2024-04-24T23:00:14.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.544+0000 7fc37518a640 1 -- 172.21.15.43:0/3018085694 wait complete. 2024-04-24T23:00:14.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc37518a640 1 Processor -- start 2024-04-24T23:00:14.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc37518a640 1 -- start start 2024-04-24T23:00:14.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc37518a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35c0039c0 0x7fc370146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:14.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc37518a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37013db40 0x7fc37013dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:14.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc37518a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3701e2ff0 0x7fc3701e3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:14.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc37518a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc37014b330 con 0x7fc3701e2ff0 2024-04-24T23:00:14.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc37518a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc37014b1b0 con 0x7fc35c0039c0 2024-04-24T23:00:14.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc37518a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc370152c50 con 0x7fc37013db40 2024-04-24T23:00:14.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc36f59e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3701e2ff0 0x7fc3701e3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:14.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc36f59e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3701e2ff0 0x7fc3701e3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45278/0 (socket says 172.21.15.43:45278) 2024-04-24T23:00:14.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc36f59e640 1 -- 172.21.15.43:0/4113358730 learned_addr learned my addr 172.21.15.43:0/4113358730 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:14.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc36ed9d640 1 --2- 172.21.15.43:0/4113358730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35c0039c0 0x7fc370146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:14.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc36e59c640 1 --2- 172.21.15.43:0/4113358730 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37013db40 0x7fc37013dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:14.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc36f59e640 1 -- 172.21.15.43:0/4113358730 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37013db40 msgr2=0x7fc37013dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:14.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc36f59e640 1 --2- 172.21.15.43:0/4113358730 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37013db40 0x7fc37013dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:14.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc36f59e640 1 -- 172.21.15.43:0/4113358730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35c0039c0 msgr2=0x7fc370146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:14.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc36f59e640 1 --2- 172.21.15.43:0/4113358730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35c0039c0 0x7fc370146fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:14.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc36f59e640 1 -- 172.21.15.43:0/4113358730 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc370142010 con 0x7fc3701e2ff0 2024-04-24T23:00:14.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc36f59e640 1 --2- 172.21.15.43:0/4113358730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3701e2ff0 0x7fc3701e3470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc3700b5360 tx=0x7fc36800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:14.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc3677fe640 1 -- 172.21.15.43:0/4113358730 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368018020 con 0x7fc3701e2ff0 2024-04-24T23:00:14.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc3677fe640 1 -- 172.21.15.43:0/4113358730 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36800bd10 con 0x7fc3701e2ff0 2024-04-24T23:00:14.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc37518a640 1 -- 172.21.15.43:0/4113358730 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37013e4e0 con 0x7fc3701e2ff0 2024-04-24T23:00:14.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc3677fe640 1 -- 172.21.15.43:0/4113358730 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368014640 con 0x7fc3701e2ff0 2024-04-24T23:00:14.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.548+0000 7fc37518a640 1 -- 172.21.15.43:0/4113358730 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc370147740 con 0x7fc3701e2ff0 2024-04-24T23:00:14.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.552+0000 7fc37518a640 1 -- 172.21.15.43:0/4113358730 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3700689d0 con 0x7fc3701e2ff0 2024-04-24T23:00:14.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.552+0000 7fc3677fe640 1 -- 172.21.15.43:0/4113358730 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc36801b020 con 0x7fc3701e2ff0 2024-04-24T23:00:14.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.552+0000 7fc3677fe640 1 --2- 172.21.15.43:0/4113358730 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc3500678c0 0x7fc350069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:14.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.552+0000 7fc3677fe640 1 -- 172.21.15.43:0/4113358730 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7fc368085ef0 con 0x7fc3701e2ff0 2024-04-24T23:00:14.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.552+0000 7fc36ed9d640 1 --2- 172.21.15.43:0/4113358730 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc3500678c0 0x7fc350069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:14.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.552+0000 7fc36ed9d640 1 --2- 172.21.15.43:0/4113358730 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc3500678c0 0x7fc350069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc3580ad000 tx=0x7fc3580b2040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:14.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.556+0000 7fc3677fe640 1 -- 172.21.15.43:0/4113358730 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc368022030 con 0x7fc3701e2ff0 2024-04-24T23:00:14.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:14.720+0000 7fc37518a640 1 -- 172.21.15.43:0/4113358730 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fc370142280 con 0x7fc3701e2ff0 2024-04-24T23:00:15.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.376+0000 7fc3677fe640 1 -- 172.21.15.43:0/4113358730 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7fc368056650 con 0x7fc3701e2ff0 2024-04-24T23:00:15.382 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2024-04-24T23:00:15.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.380+0000 7fc37518a640 1 -- 172.21.15.43:0/4113358730 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc3500678c0 msgr2=0x7fc350069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:15.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.380+0000 7fc37518a640 1 --2- 172.21.15.43:0/4113358730 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc3500678c0 0x7fc350069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc3580ad000 tx=0x7fc3580b2040 comp rx=0 tx=0).stop 2024-04-24T23:00:15.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.380+0000 7fc37518a640 1 -- 172.21.15.43:0/4113358730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3701e2ff0 msgr2=0x7fc3701e3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:15.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.380+0000 7fc37518a640 1 --2- 172.21.15.43:0/4113358730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3701e2ff0 0x7fc3701e3470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc3700b5360 tx=0x7fc36800b480 comp rx=0 tx=0).stop 2024-04-24T23:00:15.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.380+0000 7fc37518a640 1 -- 172.21.15.43:0/4113358730 shutdown_connections 2024-04-24T23:00:15.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.380+0000 7fc37518a640 1 --2- 172.21.15.43:0/4113358730 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc3500678c0 0x7fc350069d80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:15.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.380+0000 7fc37518a640 1 --2- 172.21.15.43:0/4113358730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3701e2ff0 0x7fc3701e3470 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:15.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.380+0000 7fc37518a640 1 --2- 172.21.15.43:0/4113358730 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37013db40 0x7fc37013dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:15.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.380+0000 7fc37518a640 1 --2- 172.21.15.43:0/4113358730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35c0039c0 0x7fc370146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:15.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.380+0000 7fc37518a640 1 -- 172.21.15.43:0/4113358730 >> 172.21.15.43:0/4113358730 conn(0x7fc3700b9990 msgr2=0x7fc3700badb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:15.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.380+0000 7fc37518a640 1 -- 172.21.15.43:0/4113358730 shutdown_connections 2024-04-24T23:00:15.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.380+0000 7fc37518a640 1 -- 172.21.15.43:0/4113358730 wait complete. 2024-04-24T23:00:15.419 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-24T23:00:15.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.548+0000 7f63bfe2a640 1 Processor -- start 2024-04-24T23:00:15.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.548+0000 7f63bfe2a640 1 -- start start 2024-04-24T23:00:15.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.548+0000 7f63bfe2a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f63b814ecf0 0x7f63b81510e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:15.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.548+0000 7f63bfe2a640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b8070060 con 0x7f63b813f1f0 2024-04-24T23:00:15.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.548+0000 7f63bfe2a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b80b28e0 con 0x7f63b80b2500 2024-04-24T23:00:15.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.548+0000 7f63bfe2a640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f63b80af8f0 con 0x7f63b814ecf0 2024-04-24T23:00:15.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.548+0000 7f63be3c7640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f63b814ecf0 0x7f63b81510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:15.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.548+0000 7f63be3c7640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f63b814ecf0 0x7f63b81510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45290/0 (socket says 172.21.15.43:45290) 2024-04-24T23:00:15.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.548+0000 7f63be3c7640 1 -- 172.21.15.43:0/3147202386 learned_addr learned my addr 172.21.15.43:0/3147202386 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:15.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.548+0000 7f63bd3c5640 1 --1- 172.21.15.43:0/3147202386 >> v1:172.21.15.43:6789/0 conn(0x7f63b813f1f0 0x7f63b813f680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37154/0 (socket says 172.21.15.43:37154) 2024-04-24T23:00:15.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.548+0000 7f63be3c7640 1 -- 172.21.15.43:0/3147202386 >> v1:172.21.15.162:6789/0 conn(0x7f63b80b2500 legacy=0x7f63b8145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:15.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.548+0000 7f63be3c7640 1 -- 172.21.15.43:0/3147202386 >> v1:172.21.15.43:6789/0 conn(0x7f63b813f1f0 legacy=0x7f63b813f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:15.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.548+0000 7f63be3c7640 1 -- 172.21.15.43:0/3147202386 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b806fb40 con 0x7f63b814ecf0 2024-04-24T23:00:15.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63be3c7640 1 --2- 172.21.15.43:0/3147202386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b814ecf0 0x7f63b81510e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009e50 tx=0x7f63b001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc50564b8b95e0e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:15.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bcbc4640 1 -- 172.21.15.43:0/3147202386 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b80b63c0 con 0x7f63b814ecf0 2024-04-24T23:00:15.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bcbc4640 1 -- 172.21.15.43:0/3147202386 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63b00a57d0 con 0x7f63b814ecf0 2024-04-24T23:00:15.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bcbc4640 1 -- 172.21.15.43:0/3147202386 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b00a5ba0 con 0x7f63b814ecf0 2024-04-24T23:00:15.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bfe2a640 1 -- 172.21.15.43:0/3147202386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b814ecf0 msgr2=0x7f63b81510e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:15.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bfe2a640 1 --2- 172.21.15.43:0/3147202386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b814ecf0 0x7f63b81510e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009e50 tx=0x7f63b001c9f0 comp rx=0 tx=0).stop 2024-04-24T23:00:15.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bfe2a640 1 -- 172.21.15.43:0/3147202386 shutdown_connections 2024-04-24T23:00:15.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bfe2a640 1 --2- 172.21.15.43:0/3147202386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b814ecf0 0x7f63b81510e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:15.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bfe2a640 1 -- 172.21.15.43:0/3147202386 >> 172.21.15.43:0/3147202386 conn(0x7f63b80b5690 msgr2=0x7f63b80b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:15.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bfe2a640 1 -- 172.21.15.43:0/3147202386 shutdown_connections 2024-04-24T23:00:15.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bfe2a640 1 -- 172.21.15.43:0/3147202386 wait complete. 2024-04-24T23:00:15.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bfe2a640 1 Processor -- start 2024-04-24T23:00:15.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bfe2a640 1 -- start start 2024-04-24T23:00:15.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bfe2a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b80b2500 0x7f63b813cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:15.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bfe2a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b813f1f0 0x7f63b80b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:15.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bfe2a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b814ecf0 0x7f63b80b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:15.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bfe2a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f63b80b4c70 con 0x7f63b813f1f0 2024-04-24T23:00:15.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bfe2a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f63b80b4af0 con 0x7f63b80b2500 2024-04-24T23:00:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bfe2a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f63b8153e40 con 0x7f63b814ecf0 2024-04-24T23:00:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bd3c5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b813f1f0 0x7f63b80b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bd3c5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b813f1f0 0x7f63b80b7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45306/0 (socket says 172.21.15.43:45306) 2024-04-24T23:00:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bd3c5640 1 -- 172.21.15.43:0/757794157 learned_addr learned my addr 172.21.15.43:0/757794157 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63bdbc6640 1 --2- 172.21.15.43:0/757794157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b80b2500 0x7f63b813cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.552+0000 7f63be3c7640 1 --2- 172.21.15.43:0/757794157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b814ecf0 0x7f63b80b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63bd3c5640 1 -- 172.21.15.43:0/757794157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b814ecf0 msgr2=0x7f63b80b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63bd3c5640 1 --2- 172.21.15.43:0/757794157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b814ecf0 0x7f63b80b79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63bd3c5640 1 -- 172.21.15.43:0/757794157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b80b2500 msgr2=0x7f63b813cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63bd3c5640 1 --2- 172.21.15.43:0/757794157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b80b2500 0x7f63b813cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63bd3c5640 1 -- 172.21.15.43:0/757794157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b813ea10 con 0x7f63b813f1f0 2024-04-24T23:00:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63be3c7640 1 --2- 172.21.15.43:0/757794157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b814ecf0 0x7f63b80b79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63bd3c5640 1 --2- 172.21.15.43:0/757794157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b813f1f0 0x7f63b80b7470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f63a800c430 tx=0x7f63a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63ae7fc640 1 -- 172.21.15.43:0/757794157 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a80074e0 con 0x7f63b813f1f0 2024-04-24T23:00:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63ae7fc640 1 -- 172.21.15.43:0/757794157 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a8007680 con 0x7f63b813f1f0 2024-04-24T23:00:15.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63bfe2a640 1 -- 172.21.15.43:0/757794157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b80b6990 con 0x7f63b813f1f0 2024-04-24T23:00:15.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63ae7fc640 1 -- 172.21.15.43:0/757794157 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8004a10 con 0x7f63b813f1f0 2024-04-24T23:00:15.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63bfe2a640 1 -- 172.21.15.43:0/757794157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b80b6f50 con 0x7f63b813f1f0 2024-04-24T23:00:15.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63bfe2a640 1 -- 172.21.15.43:0/757794157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b804f580 con 0x7f63b813f1f0 2024-04-24T23:00:15.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63ae7fc640 1 -- 172.21.15.43:0/757794157 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f63a801a020 con 0x7f63b813f1f0 2024-04-24T23:00:15.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63ae7fc640 1 --2- 172.21.15.43:0/757794157 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f639c0678c0 0x7f639c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:15.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63ae7fc640 1 -- 172.21.15.43:0/757794157 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f63a8085a90 con 0x7f63b813f1f0 2024-04-24T23:00:15.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63bdbc6640 1 --2- 172.21.15.43:0/757794157 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f639c0678c0 0x7f639c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:15.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.556+0000 7f63bdbc6640 1 --2- 172.21.15.43:0/757794157 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f639c0678c0 0x7f639c069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f63b8068480 tx=0x7f63b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:15.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.560+0000 7f63ae7fc640 1 -- 172.21.15.43:0/757794157 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f63a8021070 con 0x7f63b813f1f0 2024-04-24T23:00:15.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:15.756+0000 7f63bfe2a640 1 -- 172.21.15.43:0/757794157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f63b806c200 con 0x7f63b813f1f0 2024-04-24T23:00:16.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.416+0000 7f63ae7fc640 1 -- 172.21.15.43:0/757794157 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f63a80567a0 con 0x7f63b813f1f0 2024-04-24T23:00:16.423 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 2 and data pool 3 2024-04-24T23:00:16.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.424+0000 7f63bfe2a640 1 -- 172.21.15.43:0/757794157 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f639c0678c0 msgr2=0x7f639c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:16.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.424+0000 7f63bfe2a640 1 --2- 172.21.15.43:0/757794157 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f639c0678c0 0x7f639c069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f63b8068480 tx=0x7f63b4008040 comp rx=0 tx=0).stop 2024-04-24T23:00:16.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.424+0000 7f63bfe2a640 1 -- 172.21.15.43:0/757794157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b813f1f0 msgr2=0x7f63b80b7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:16.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.424+0000 7f63bfe2a640 1 --2- 172.21.15.43:0/757794157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b813f1f0 0x7f63b80b7470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f63a800c430 tx=0x7f63a800c8f0 comp rx=0 tx=0).stop 2024-04-24T23:00:16.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.424+0000 7f63bfe2a640 1 -- 172.21.15.43:0/757794157 shutdown_connections 2024-04-24T23:00:16.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.424+0000 7f63bfe2a640 1 --2- 172.21.15.43:0/757794157 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f639c0678c0 0x7f639c069d80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:16.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.424+0000 7f63bfe2a640 1 --2- 172.21.15.43:0/757794157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b814ecf0 0x7f63b80b79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:16.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.424+0000 7f63bfe2a640 1 --2- 172.21.15.43:0/757794157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b813f1f0 0x7f63b80b7470 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:16.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.424+0000 7f63bfe2a640 1 --2- 172.21.15.43:0/757794157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b80b2500 0x7f63b813cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:16.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.424+0000 7f63bfe2a640 1 -- 172.21.15.43:0/757794157 >> 172.21.15.43:0/757794157 conn(0x7f63b80b5690 msgr2=0x7f63b806d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:16.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.424+0000 7f63bfe2a640 1 -- 172.21.15.43:0/757794157 shutdown_connections 2024-04-24T23:00:16.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.424+0000 7f63bfe2a640 1 -- 172.21.15.43:0/757794157 wait complete. 2024-04-24T23:00:16.477 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-24T23:00:16.477 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-24T23:00:16.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.600+0000 7fbe3c812640 1 Processor -- start 2024-04-24T23:00:16.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.600+0000 7fbe3c812640 1 -- start start 2024-04-24T23:00:16.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3c812640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbe380b37f0 0x7fbe38072820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:16.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3c812640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe380733a0 0x7fbe38144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:16.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3c812640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe380b3bd0 con 0x7fbe38072d60 2024-04-24T23:00:16.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3c812640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fbe380b24f0 con 0x7fbe380b37f0 2024-04-24T23:00:16.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3c812640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbe380b2980 con 0x7fbe380733a0 2024-04-24T23:00:16.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3659c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbe380b37f0 0x7fbe38072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:16.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe36d9d640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fbe38072d60 0x7fbe381477d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37170/0 (socket says 172.21.15.43:37170) 2024-04-24T23:00:16.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe36d9d640 1 -- 172.21.15.43:0/2025332463 learned_addr learned my addr 172.21.15.43:0/2025332463 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:16.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3659c640 1 -- 172.21.15.43:0/2025332463 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe380733a0 msgr2=0x7fbe38144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:16.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3659c640 1 --2- 172.21.15.43:0/2025332463 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe380733a0 0x7fbe38144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:16.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3659c640 1 -- 172.21.15.43:0/2025332463 >> v1:172.21.15.43:6789/0 conn(0x7fbe38072d60 legacy=0x7fbe381477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:16.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3659c640 1 -- 172.21.15.43:0/2025332463 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3806fdd0 con 0x7fbe380b37f0 2024-04-24T23:00:16.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3659c640 1 --2- 172.21.15.43:0/2025332463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe380b37f0 0x7fbe38072820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbe280097c0 tx=0x7fbe2801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5347d1b9d33f319 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:16.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe35d9b640 1 -- 172.21.15.43:0/2025332463 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe280b0070 con 0x7fbe380b37f0 2024-04-24T23:00:16.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe35d9b640 1 -- 172.21.15.43:0/2025332463 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe280ab600 con 0x7fbe380b37f0 2024-04-24T23:00:16.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe35d9b640 1 -- 172.21.15.43:0/2025332463 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe280ab9d0 con 0x7fbe380b37f0 2024-04-24T23:00:16.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3c812640 1 -- 172.21.15.43:0/2025332463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe380b37f0 msgr2=0x7fbe38072820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:16.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3c812640 1 --2- 172.21.15.43:0/2025332463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe380b37f0 0x7fbe38072820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbe280097c0 tx=0x7fbe2801c410 comp rx=0 tx=0).stop 2024-04-24T23:00:16.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3c812640 1 -- 172.21.15.43:0/2025332463 shutdown_connections 2024-04-24T23:00:16.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3c812640 1 --2- 172.21.15.43:0/2025332463 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe380733a0 0x7fbe38144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:16.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3c812640 1 --2- 172.21.15.43:0/2025332463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe380b37f0 0x7fbe38072820 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:16.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3c812640 1 -- 172.21.15.43:0/2025332463 >> 172.21.15.43:0/2025332463 conn(0x7fbe380b5690 msgr2=0x7fbe380b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:16.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3c812640 1 -- 172.21.15.43:0/2025332463 shutdown_connections 2024-04-24T23:00:16.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.604+0000 7fbe3c812640 1 -- 172.21.15.43:0/2025332463 wait complete. 2024-04-24T23:00:16.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe3c812640 1 Processor -- start 2024-04-24T23:00:16.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe3c812640 1 -- start start 2024-04-24T23:00:16.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe3c812640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe38072d60 0x7fbe38137660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:16.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe3c812640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe380733a0 0x7fbe38146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:16.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe3c812640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe380b37f0 0x7fbe38132d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:16.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe3c812640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbe38151eb0 con 0x7fbe380733a0 2024-04-24T23:00:16.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe3c812640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbe38151d30 con 0x7fbe38072d60 2024-04-24T23:00:16.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe3c812640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbe38152030 con 0x7fbe380b37f0 2024-04-24T23:00:16.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe2dd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe380733a0 0x7fbe38146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:16.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe2dd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe380733a0 0x7fbe38146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45320/0 (socket says 172.21.15.43:45320) 2024-04-24T23:00:16.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe2dd9b640 1 -- 172.21.15.43:0/189322079 learned_addr learned my addr 172.21.15.43:0/189322079 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:16.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe3659c640 1 --2- 172.21.15.43:0/189322079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe38072d60 0x7fbe38137660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:16.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe2dd9b640 1 -- 172.21.15.43:0/189322079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe380b37f0 msgr2=0x7fbe38132d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:16.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe2dd9b640 1 --2- 172.21.15.43:0/189322079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe380b37f0 0x7fbe38132d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:16.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe2dd9b640 1 -- 172.21.15.43:0/189322079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe38072d60 msgr2=0x7fbe38137660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:16.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe2dd9b640 1 --2- 172.21.15.43:0/189322079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe38072d60 0x7fbe38137660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:16.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe2dd9b640 1 -- 172.21.15.43:0/189322079 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe38139a00 con 0x7fbe380733a0 2024-04-24T23:00:16.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe2dd9b640 1 --2- 172.21.15.43:0/189322079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe380733a0 0x7fbe38146630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000b550 tx=0x7fbe2000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:16.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe2f7fe640 1 -- 172.21.15.43:0/189322079 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20014070 con 0x7fbe380733a0 2024-04-24T23:00:16.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe2f7fe640 1 -- 172.21.15.43:0/189322079 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe20010890 con 0x7fbe380733a0 2024-04-24T23:00:16.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe2f7fe640 1 -- 172.21.15.43:0/189322079 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20010c80 con 0x7fbe380733a0 2024-04-24T23:00:16.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe3c812640 1 -- 172.21.15.43:0/189322079 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe38139ce0 con 0x7fbe380733a0 2024-04-24T23:00:16.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe3c812640 1 -- 172.21.15.43:0/189322079 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe381396d0 con 0x7fbe380733a0 2024-04-24T23:00:16.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe3c812640 1 -- 172.21.15.43:0/189322079 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe3804f580 con 0x7fbe380733a0 2024-04-24T23:00:16.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.608+0000 7fbe2f7fe640 1 -- 172.21.15.43:0/189322079 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbe20017070 con 0x7fbe380733a0 2024-04-24T23:00:16.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.612+0000 7fbe2f7fe640 1 --2- 172.21.15.43:0/189322079 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbe180678c0 0x7fbe18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:16.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.612+0000 7fbe2f7fe640 1 -- 172.21.15.43:0/189322079 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbe200859d0 con 0x7fbe380733a0 2024-04-24T23:00:16.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.612+0000 7fbe3659c640 1 --2- 172.21.15.43:0/189322079 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbe180678c0 0x7fbe18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:16.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.612+0000 7fbe3659c640 1 --2- 172.21.15.43:0/189322079 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbe180678c0 0x7fbe18069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbe280ad000 tx=0x7fbe28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:16.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.616+0000 7fbe2f7fe640 1 -- 172.21.15.43:0/189322079 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fbe200565a0 con 0x7fbe380733a0 2024-04-24T23:00:16.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:16.776+0000 7fbe3c812640 1 -- 172.21.15.43:0/189322079 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fbe38142b00 con 0x7fbe380733a0 2024-04-24T23:00:17.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.440+0000 7fbe2f7fe640 1 -- 172.21.15.43:0/189322079 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7fbe20010e20 con 0x7fbe380733a0 2024-04-24T23:00:17.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.444+0000 7fbe3c812640 1 -- 172.21.15.43:0/189322079 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbe180678c0 msgr2=0x7fbe18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:17.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.444+0000 7fbe3c812640 1 --2- 172.21.15.43:0/189322079 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbe180678c0 0x7fbe18069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbe280ad000 tx=0x7fbe28008040 comp rx=0 tx=0).stop 2024-04-24T23:00:17.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.444+0000 7fbe3c812640 1 -- 172.21.15.43:0/189322079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe380733a0 msgr2=0x7fbe38146630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:17.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.444+0000 7fbe3c812640 1 --2- 172.21.15.43:0/189322079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe380733a0 0x7fbe38146630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000b550 tx=0x7fbe2000ba10 comp rx=0 tx=0).stop 2024-04-24T23:00:17.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.444+0000 7fbe3c812640 1 -- 172.21.15.43:0/189322079 shutdown_connections 2024-04-24T23:00:17.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.444+0000 7fbe3c812640 1 --2- 172.21.15.43:0/189322079 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbe180678c0 0x7fbe18069d80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:17.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.444+0000 7fbe3c812640 1 --2- 172.21.15.43:0/189322079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe380b37f0 0x7fbe38132d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:17.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.444+0000 7fbe3c812640 1 --2- 172.21.15.43:0/189322079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe380733a0 0x7fbe38146630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:17.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.444+0000 7fbe3c812640 1 --2- 172.21.15.43:0/189322079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe38072d60 0x7fbe38137660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:17.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.444+0000 7fbe3c812640 1 -- 172.21.15.43:0/189322079 >> 172.21.15.43:0/189322079 conn(0x7fbe380b5690 msgr2=0x7fbe380aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:17.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.444+0000 7fbe3c812640 1 -- 172.21.15.43:0/189322079 shutdown_connections 2024-04-24T23:00:17.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.444+0000 7fbe3c812640 1 -- 172.21.15.43:0/189322079 wait complete. 2024-04-24T23:00:17.470 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-24T23:00:17.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.596+0000 7fcbe2abf640 1 Processor -- start 2024-04-24T23:00:17.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.596+0000 7fcbe2abf640 1 -- start start 2024-04-24T23:00:17.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.596+0000 7fcbe2abf640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcbdc0b6100 0x7fcbdc0b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.596+0000 7fcbe2abf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbdc0b2340 0x7fcbdc13e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.596+0000 7fcbe2abf640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbdc0b64e0 con 0x7fcbdc144ad0 2024-04-24T23:00:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.596+0000 7fcbe2abf640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fcbdc144640 con 0x7fcbdc0b6100 2024-04-24T23:00:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.596+0000 7fcbe2abf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcbdc0b0190 con 0x7fcbdc0b2340 2024-04-24T23:00:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.596+0000 7fcbe085b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcbdc0b6100 0x7fcbdc0b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.596+0000 7fcbe085b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcbdc0b6100 0x7fcbdc0b1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45332/0 (socket says 172.21.15.43:45332) 2024-04-24T23:00:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.596+0000 7fcbe085b640 1 -- 172.21.15.43:0/2162398619 learned_addr learned my addr 172.21.15.43:0/2162398619 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.596+0000 7fcbdbfff640 1 --2- 172.21.15.43:0/2162398619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbdc0b2340 0x7fcbdc13e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.596+0000 7fcbe085b640 1 -- 172.21.15.43:0/2162398619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbdc0b2340 msgr2=0x7fcbdc13e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.596+0000 7fcbe085b640 1 --2- 172.21.15.43:0/2162398619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbdc0b2340 0x7fcbdc13e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.596+0000 7fcbe085b640 1 -- 172.21.15.43:0/2162398619 >> v1:172.21.15.162:6789/0 conn(0x7fcbdc144ad0 legacy=0x7fcbdc147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:17.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.596+0000 7fcbe085b640 1 -- 172.21.15.43:0/2162398619 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbdc1442f0 con 0x7fcbdc0b6100 2024-04-24T23:00:17.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe085b640 1 --2- 172.21.15.43:0/2162398619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbdc0b6100 0x7fcbdc0b1d00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009870 tx=0x7fcbcc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285f38ec65a96ee server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:17.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbdb7fe640 1 -- 172.21.15.43:0/2162398619 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc0b0070 con 0x7fcbdc0b6100 2024-04-24T23:00:17.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbdb7fe640 1 -- 172.21.15.43:0/2162398619 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbcc0ab600 con 0x7fcbdc0b6100 2024-04-24T23:00:17.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbdb7fe640 1 -- 172.21.15.43:0/2162398619 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc0ab9d0 con 0x7fcbdc0b6100 2024-04-24T23:00:17.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 -- 172.21.15.43:0/2162398619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbdc0b6100 msgr2=0x7fcbdc0b1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:17.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 --2- 172.21.15.43:0/2162398619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbdc0b6100 0x7fcbdc0b1d00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009870 tx=0x7fcbcc01c400 comp rx=0 tx=0).stop 2024-04-24T23:00:17.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 -- 172.21.15.43:0/2162398619 shutdown_connections 2024-04-24T23:00:17.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 --2- 172.21.15.43:0/2162398619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbdc0b2340 0x7fcbdc13e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:17.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 --2- 172.21.15.43:0/2162398619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbdc0b6100 0x7fcbdc0b1d00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:17.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 -- 172.21.15.43:0/2162398619 >> 172.21.15.43:0/2162398619 conn(0x7fcbdc0b9290 msgr2=0x7fcbdc0b5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:17.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 -- 172.21.15.43:0/2162398619 shutdown_connections 2024-04-24T23:00:17.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 -- 172.21.15.43:0/2162398619 wait complete. 2024-04-24T23:00:17.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 Processor -- start 2024-04-24T23:00:17.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 -- start start 2024-04-24T23:00:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbdc0b6100 0x7fcbdc072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbdc144ad0 0x7fcbdc13ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbdc0721c0 0x7fcbdc1e1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc151d50 con 0x7fcbdc144ad0 2024-04-24T23:00:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc151bd0 con 0x7fcbdc0b6100 2024-04-24T23:00:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbe2abf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcbdc151ed0 con 0x7fcbdc0721c0 2024-04-24T23:00:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbdbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbdc144ad0 0x7fcbdc13ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbdbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbdc144ad0 0x7fcbdc13ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45348/0 (socket says 172.21.15.43:45348) 2024-04-24T23:00:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.600+0000 7fcbdbfff640 1 -- 172.21.15.43:0/1385374762 learned_addr learned my addr 172.21.15.43:0/1385374762 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbe085b640 1 --2- 172.21.15.43:0/1385374762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbdc0b6100 0x7fcbdc072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbe105c640 1 --2- 172.21.15.43:0/1385374762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbdc0721c0 0x7fcbdc1e1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbdbfff640 1 -- 172.21.15.43:0/1385374762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbdc0721c0 msgr2=0x7fcbdc1e1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbdbfff640 1 --2- 172.21.15.43:0/1385374762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbdc0721c0 0x7fcbdc1e1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbdbfff640 1 -- 172.21.15.43:0/1385374762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbdc0b6100 msgr2=0x7fcbdc072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbdbfff640 1 --2- 172.21.15.43:0/1385374762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbdc0b6100 0x7fcbdc072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbdbfff640 1 -- 172.21.15.43:0/1385374762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbdc0a9670 con 0x7fcbdc144ad0 2024-04-24T23:00:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbdbfff640 1 --2- 172.21.15.43:0/1385374762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbdc144ad0 0x7fcbdc13ac20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000d620 tx=0x7fcbd000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbd97fa640 1 -- 172.21.15.43:0/1385374762 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000b620 con 0x7fcbdc144ad0 2024-04-24T23:00:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbd97fa640 1 -- 172.21.15.43:0/1385374762 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd0019070 con 0x7fcbdc144ad0 2024-04-24T23:00:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbd97fa640 1 -- 172.21.15.43:0/1385374762 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000b9e0 con 0x7fcbdc144ad0 2024-04-24T23:00:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbe2abf640 1 -- 172.21.15.43:0/1385374762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbdc0b4210 con 0x7fcbdc144ad0 2024-04-24T23:00:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbe2abf640 1 -- 172.21.15.43:0/1385374762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbdc0b44f0 con 0x7fcbdc144ad0 2024-04-24T23:00:17.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbe2abf640 1 -- 172.21.15.43:0/1385374762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbdc0682c0 con 0x7fcbdc144ad0 2024-04-24T23:00:17.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbd97fa640 1 -- 172.21.15.43:0/1385374762 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcbd000bb80 con 0x7fcbdc144ad0 2024-04-24T23:00:17.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbd97fa640 1 --2- 172.21.15.43:0/1385374762 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcbc80678c0 0x7fcbc8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:17.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbd97fa640 1 -- 172.21.15.43:0/1385374762 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7fcbd0086150 con 0x7fcbdc144ad0 2024-04-24T23:00:17.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbe085b640 1 --2- 172.21.15.43:0/1385374762 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcbc80678c0 0x7fcbc8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:17.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.604+0000 7fcbe085b640 1 --2- 172.21.15.43:0/1385374762 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcbc80678c0 0x7fcbc8069d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0ad000 tx=0x7fcbcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:17.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.608+0000 7fcbd97fa640 1 -- 172.21.15.43:0/1385374762 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fcbd0056bd0 con 0x7fcbdc144ad0 2024-04-24T23:00:17.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:17.776+0000 7fcbe2abf640 1 -- 172.21.15.43:0/1385374762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcbdc142400 con 0x7fcbdc144ad0 2024-04-24T23:00:19.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.456+0000 7fcbd97fa640 1 -- 172.21.15.43:0/1385374762 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7fcbd00564d0 con 0x7fcbdc144ad0 2024-04-24T23:00:19.460 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data_ec' created 2024-04-24T23:00:19.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.460+0000 7fcbe2abf640 1 -- 172.21.15.43:0/1385374762 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcbc80678c0 msgr2=0x7fcbc8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:19.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.460+0000 7fcbe2abf640 1 --2- 172.21.15.43:0/1385374762 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcbc80678c0 0x7fcbc8069d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0ad000 tx=0x7fcbcc008040 comp rx=0 tx=0).stop 2024-04-24T23:00:19.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.460+0000 7fcbe2abf640 1 -- 172.21.15.43:0/1385374762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbdc144ad0 msgr2=0x7fcbdc13ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:19.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.460+0000 7fcbe2abf640 1 --2- 172.21.15.43:0/1385374762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbdc144ad0 0x7fcbdc13ac20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000d620 tx=0x7fcbd000dae0 comp rx=0 tx=0).stop 2024-04-24T23:00:19.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.460+0000 7fcbe2abf640 1 -- 172.21.15.43:0/1385374762 shutdown_connections 2024-04-24T23:00:19.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.460+0000 7fcbe2abf640 1 --2- 172.21.15.43:0/1385374762 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcbc80678c0 0x7fcbc8069d80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:19.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.460+0000 7fcbe2abf640 1 --2- 172.21.15.43:0/1385374762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbdc0721c0 0x7fcbdc1e1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:19.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.460+0000 7fcbe2abf640 1 --2- 172.21.15.43:0/1385374762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbdc144ad0 0x7fcbdc13ac20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:19.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.460+0000 7fcbe2abf640 1 --2- 172.21.15.43:0/1385374762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbdc0b6100 0x7fcbdc072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:19.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.460+0000 7fcbe2abf640 1 -- 172.21.15.43:0/1385374762 >> 172.21.15.43:0/1385374762 conn(0x7fcbdc0b9290 msgr2=0x7fcbdc143ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:19.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.460+0000 7fcbe2abf640 1 -- 172.21.15.43:0/1385374762 shutdown_connections 2024-04-24T23:00:19.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.460+0000 7fcbe2abf640 1 -- 172.21.15.43:0/1385374762 wait complete. 2024-04-24T23:00:19.492 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-24T23:00:19.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc245767640 1 Processor -- start 2024-04-24T23:00:19.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc245767640 1 -- start start 2024-04-24T23:00:19.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc245767640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc2400b2500 0x7fc240145450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:19.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc245767640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc24013f900 0x7fc24014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:19.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc245767640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc240070060 con 0x7fc240145990 2024-04-24T23:00:19.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc245767640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc2400b28e0 con 0x7fc2400b2500 2024-04-24T23:00:19.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc245767640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc2400af8f0 con 0x7fc24013f900 2024-04-24T23:00:19.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc23effd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc2400b2500 0x7fc240145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:19.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc23e7fc640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc240145990 0x7fc24013f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37172/0 (socket says 172.21.15.43:37172) 2024-04-24T23:00:19.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc23e7fc640 1 -- 172.21.15.43:0/4145213048 learned_addr learned my addr 172.21.15.43:0/4145213048 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:19.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc23f7fe640 1 --2- 172.21.15.43:0/4145213048 >> v2:172.21.15.162:3300/0 conn(0x7fc24013f900 0x7fc24014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:19.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc23effd640 1 -- 172.21.15.43:0/4145213048 >> v2:172.21.15.162:3300/0 conn(0x7fc24013f900 msgr2=0x7fc24014fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:19.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc23effd640 1 --2- 172.21.15.43:0/4145213048 >> v2:172.21.15.162:3300/0 conn(0x7fc24013f900 0x7fc24014fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:19.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc23effd640 1 -- 172.21.15.43:0/4145213048 >> v1:172.21.15.43:6789/0 conn(0x7fc240145990 legacy=0x7fc24013f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:19.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc23dffb640 1 -- 172.21.15.43:0/4145213048 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529800411 0 0) 0x7fc240070060 con 0x7fc240145990 2024-04-24T23:00:19.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.616+0000 7fc23effd640 1 -- 172.21.15.43:0/4145213048 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24006fb40 con 0x7fc2400b2500 2024-04-24T23:00:19.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc23effd640 1 --2- 172.21.15.43:0/4145213048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2400b2500 0x7fc240145450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc2400b4a80 tx=0x7fc23801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00e7c2dadc1348 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:19.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc23dffb640 1 -- 172.21.15.43:0/4145213048 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2380b0070 con 0x7fc2400b2500 2024-04-24T23:00:19.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc23dffb640 1 -- 172.21.15.43:0/4145213048 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2380ab600 con 0x7fc2400b2500 2024-04-24T23:00:19.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc23dffb640 1 -- 172.21.15.43:0/4145213048 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2380ab9d0 con 0x7fc2400b2500 2024-04-24T23:00:19.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 -- 172.21.15.43:0/4145213048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2400b2500 msgr2=0x7fc240145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:19.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 --2- 172.21.15.43:0/4145213048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2400b2500 0x7fc240145450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc2400b4a80 tx=0x7fc23801c480 comp rx=0 tx=0).stop 2024-04-24T23:00:19.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 -- 172.21.15.43:0/4145213048 shutdown_connections 2024-04-24T23:00:19.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 --2- 172.21.15.43:0/4145213048 >> v2:172.21.15.162:3300/0 conn(0x7fc24013f900 0x7fc24014fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:19.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 --2- 172.21.15.43:0/4145213048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2400b2500 0x7fc240145450 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:19.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 -- 172.21.15.43:0/4145213048 >> 172.21.15.43:0/4145213048 conn(0x7fc2400b5690 msgr2=0x7fc2400b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:19.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 -- 172.21.15.43:0/4145213048 shutdown_connections 2024-04-24T23:00:19.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 -- 172.21.15.43:0/4145213048 wait complete. 2024-04-24T23:00:19.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 Processor -- start 2024-04-24T23:00:19.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 -- start start 2024-04-24T23:00:19.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2400b2500 0x7fc240138a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:19.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc24013f900 0x7fc2401e33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:19.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc240145990 0x7fc2401e38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:19.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc2400b54a0 con 0x7fc2400b2500 2024-04-24T23:00:19.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc2400b4d00 con 0x7fc240145990 2024-04-24T23:00:19.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc245767640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc240152a50 con 0x7fc24013f900 2024-04-24T23:00:19.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.620+0000 7fc23effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2400b2500 0x7fc240138a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:19.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc23effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2400b2500 0x7fc240138a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45374/0 (socket says 172.21.15.43:45374) 2024-04-24T23:00:19.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc23effd640 1 -- 172.21.15.43:0/884459358 learned_addr learned my addr 172.21.15.43:0/884459358 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:19.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc23f7fe640 1 --2- 172.21.15.43:0/884459358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc240145990 0x7fc2401e38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:19.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc23e7fc640 1 --2- 172.21.15.43:0/884459358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc24013f900 0x7fc2401e33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:19.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc23effd640 1 -- 172.21.15.43:0/884459358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc24013f900 msgr2=0x7fc2401e33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:19.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc23effd640 1 --2- 172.21.15.43:0/884459358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc24013f900 0x7fc2401e33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:19.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc23effd640 1 -- 172.21.15.43:0/884459358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc240145990 msgr2=0x7fc2401e38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:19.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc23effd640 1 --2- 172.21.15.43:0/884459358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc240145990 0x7fc2401e38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:19.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc23effd640 1 -- 172.21.15.43:0/884459358 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24013dd60 con 0x7fc2400b2500 2024-04-24T23:00:19.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc23effd640 1 --2- 172.21.15.43:0/884459358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2400b2500 0x7fc240138a20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc23801a0b0 tx=0x7fc238019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:19.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc2277fe640 1 -- 172.21.15.43:0/884459358 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2380b8020 con 0x7fc2400b2500 2024-04-24T23:00:19.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc2277fe640 1 -- 172.21.15.43:0/884459358 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2380b4630 con 0x7fc2400b2500 2024-04-24T23:00:19.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc245767640 1 -- 172.21.15.43:0/884459358 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc24013e040 con 0x7fc2400b2500 2024-04-24T23:00:19.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc2277fe640 1 -- 172.21.15.43:0/884459358 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2380b0040 con 0x7fc2400b2500 2024-04-24T23:00:19.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc245767640 1 -- 172.21.15.43:0/884459358 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2400b7340 con 0x7fc2400b2500 2024-04-24T23:00:19.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc245767640 1 -- 172.21.15.43:0/884459358 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc24004f580 con 0x7fc2400b2500 2024-04-24T23:00:19.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc2277fe640 1 -- 172.21.15.43:0/884459358 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc2380bb020 con 0x7fc2400b2500 2024-04-24T23:00:19.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc2277fe640 1 --2- 172.21.15.43:0/884459358 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc22c0678c0 0x7fc22c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:19.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc23e7fc640 1 --2- 172.21.15.43:0/884459358 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc22c0678c0 0x7fc22c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:19.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc2277fe640 1 -- 172.21.15.43:0/884459358 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fc23811fb50 con 0x7fc2400b2500 2024-04-24T23:00:19.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.624+0000 7fc23e7fc640 1 --2- 172.21.15.43:0/884459358 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc22c0678c0 0x7fc22c069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc24013ed80 tx=0x7fc234001690 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:19.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.628+0000 7fc2277fe640 1 -- 172.21.15.43:0/884459358 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc2380c2030 con 0x7fc2400b2500 2024-04-24T23:00:19.649 INFO:tasks.ceph.mds.a.smithi043.stderr:2024-04-24T23:00:19.644+0000 7f1d090bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-24T23:00:19.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:19.792+0000 7fc245767640 1 -- 172.21.15.43:0/884459358 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fc24013e560 con 0x7fc2400b2500 2024-04-24T23:00:20.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.460+0000 7fc2277fe640 1 -- 172.21.15.43:0/884459358 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7fc24013e560 con 0x7fc2400b2500 2024-04-24T23:00:20.463 INFO:teuthology.orchestra.run.smithi043.stderr:set pool 4 allow_ec_overwrites to true 2024-04-24T23:00:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.468+0000 7fc245767640 1 -- 172.21.15.43:0/884459358 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc22c0678c0 msgr2=0x7fc22c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.468+0000 7fc245767640 1 --2- 172.21.15.43:0/884459358 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc22c0678c0 0x7fc22c069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc24013ed80 tx=0x7fc234001690 comp rx=0 tx=0).stop 2024-04-24T23:00:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.468+0000 7fc245767640 1 -- 172.21.15.43:0/884459358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2400b2500 msgr2=0x7fc240138a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.468+0000 7fc245767640 1 --2- 172.21.15.43:0/884459358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2400b2500 0x7fc240138a20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc23801a0b0 tx=0x7fc238019220 comp rx=0 tx=0).stop 2024-04-24T23:00:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.468+0000 7fc245767640 1 -- 172.21.15.43:0/884459358 shutdown_connections 2024-04-24T23:00:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.468+0000 7fc245767640 1 --2- 172.21.15.43:0/884459358 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc22c0678c0 0x7fc22c069d80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.468+0000 7fc245767640 1 --2- 172.21.15.43:0/884459358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc240145990 0x7fc2401e38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.468+0000 7fc245767640 1 --2- 172.21.15.43:0/884459358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc24013f900 0x7fc2401e33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.468+0000 7fc245767640 1 --2- 172.21.15.43:0/884459358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2400b2500 0x7fc240138a20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.468+0000 7fc245767640 1 -- 172.21.15.43:0/884459358 >> 172.21.15.43:0/884459358 conn(0x7fc2400b5690 msgr2=0x7fc2400727e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:20.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.472+0000 7fc245767640 1 -- 172.21.15.43:0/884459358 shutdown_connections 2024-04-24T23:00:20.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.472+0000 7fc245767640 1 -- 172.21.15.43:0/884459358 wait complete. 2024-04-24T23:00:20.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-24T23:00:20.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.640+0000 7f4859b6a640 1 Processor -- start 2024-04-24T23:00:20.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.640+0000 7f4859b6a640 1 -- start start 2024-04-24T23:00:20.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f4859b6a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f48540b4080 0x7f4854143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f4859b6a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f48540afa00 0x7f48541441e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f4859b6a640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48540b2ed0 con 0x7f4854142de0 2024-04-24T23:00:20.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f4859b6a640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f48540b1a10 con 0x7f48540b4080 2024-04-24T23:00:20.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f4859b6a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f48540b4460 con 0x7f48540afa00 2024-04-24T23:00:20.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f4853fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4854142de0 0x7f4854143230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46268/0 (socket says 172.21.15.43:46268) 2024-04-24T23:00:20.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f4853fff640 1 -- 172.21.15.43:0/130941444 learned_addr learned my addr 172.21.15.43:0/130941444 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:20.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f48537fe640 1 --2- 172.21.15.43:0/130941444 >> v2:172.21.15.43:3300/0 conn(0x7f48540b4080 0x7f4854143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f484bfff640 1 --2- 172.21.15.43:0/130941444 >> v2:172.21.15.162:3300/0 conn(0x7f48540afa00 0x7f48541441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f4852ffd640 1 -- 172.21.15.43:0/130941444 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2825923644 0 0) 0x7f48540b2ed0 con 0x7f4854142de0 2024-04-24T23:00:20.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f4852ffd640 1 -- 172.21.15.43:0/130941444 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4840003530 con 0x7f4854142de0 2024-04-24T23:00:20.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f48537fe640 1 -- 172.21.15.43:0/130941444 >> v2:172.21.15.162:3300/0 conn(0x7f48540afa00 msgr2=0x7f48541441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:20.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f48537fe640 1 --2- 172.21.15.43:0/130941444 >> v2:172.21.15.162:3300/0 conn(0x7f48540afa00 0x7f48541441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f48537fe640 1 -- 172.21.15.43:0/130941444 >> v1:172.21.15.43:6789/0 conn(0x7f4854142de0 legacy=0x7f4854143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f48537fe640 1 -- 172.21.15.43:0/130941444 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48540b1c60 con 0x7f48540b4080 2024-04-24T23:00:20.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f48537fe640 1 --2- 172.21.15.43:0/130941444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48540b4080 0x7f4854143ca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4854075020 tx=0x7f484401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16872c862edc0b24 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:20.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f4852ffd640 1 -- 172.21.15.43:0/130941444 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48440b0070 con 0x7f48540b4080 2024-04-24T23:00:20.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f4852ffd640 1 -- 172.21.15.43:0/130941444 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48440ab400 con 0x7f48540b4080 2024-04-24T23:00:20.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.644+0000 7f4852ffd640 1 -- 172.21.15.43:0/130941444 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48440ab7d0 con 0x7f48540b4080 2024-04-24T23:00:20.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 -- 172.21.15.43:0/130941444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48540b4080 msgr2=0x7f4854143ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 --2- 172.21.15.43:0/130941444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48540b4080 0x7f4854143ca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4854075020 tx=0x7f484401c3f0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 -- 172.21.15.43:0/130941444 shutdown_connections 2024-04-24T23:00:20.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 --2- 172.21.15.43:0/130941444 >> v2:172.21.15.162:3300/0 conn(0x7f48540afa00 0x7f48541441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 --2- 172.21.15.43:0/130941444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48540b4080 0x7f4854143ca0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 -- 172.21.15.43:0/130941444 >> 172.21.15.43:0/130941444 conn(0x7f48540b5690 msgr2=0x7f48540b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:20.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 -- 172.21.15.43:0/130941444 shutdown_connections 2024-04-24T23:00:20.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 -- 172.21.15.43:0/130941444 wait complete. 2024-04-24T23:00:20.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 Processor -- start 2024-04-24T23:00:20.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 -- start start 2024-04-24T23:00:20.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48540afa00 0x7f4854139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48540b4080 0x7f4854151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4854142de0 0x7f48541e0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4854152760 con 0x7f4854142de0 2024-04-24T23:00:20.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f48541525e0 con 0x7f48540afa00 2024-04-24T23:00:20.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f48541528e0 con 0x7f48540b4080 2024-04-24T23:00:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4853fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4854142de0 0x7f48541e0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4853fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4854142de0 0x7f48541e0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57098/0 (socket says 172.21.15.43:57098) 2024-04-24T23:00:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4853fff640 1 -- 172.21.15.43:0/963513575 learned_addr learned my addr 172.21.15.43:0/963513575 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f484bfff640 1 --2- 172.21.15.43:0/963513575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48540b4080 0x7f4854151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f48537fe640 1 --2- 172.21.15.43:0/963513575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48540afa00 0x7f4854139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4853fff640 1 -- 172.21.15.43:0/963513575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48540b4080 msgr2=0x7f4854151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4853fff640 1 --2- 172.21.15.43:0/963513575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48540b4080 0x7f4854151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4853fff640 1 -- 172.21.15.43:0/963513575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48540afa00 msgr2=0x7f4854139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4853fff640 1 --2- 172.21.15.43:0/963513575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48540afa00 0x7f4854139fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4853fff640 1 -- 172.21.15.43:0/963513575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485413c600 con 0x7f4854142de0 2024-04-24T23:00:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f48537fe640 1 --2- 172.21.15.43:0/963513575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48540afa00 0x7f4854139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4853fff640 1 --2- 172.21.15.43:0/963513575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4854142de0 0x7f48541e0630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f484c00cb40 tx=0x7f484c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4850ff9640 1 -- 172.21.15.43:0/963513575 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c017070 con 0x7f4854142de0 2024-04-24T23:00:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4850ff9640 1 -- 172.21.15.43:0/963513575 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f484c00aca0 con 0x7f4854142de0 2024-04-24T23:00:20.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4850ff9640 1 -- 172.21.15.43:0/963513575 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c012620 con 0x7f4854142de0 2024-04-24T23:00:20.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 -- 172.21.15.43:0/963513575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4854151c50 con 0x7f4854142de0 2024-04-24T23:00:20.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 -- 172.21.15.43:0/963513575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48541503d0 con 0x7f4854142de0 2024-04-24T23:00:20.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.648+0000 7f4859b6a640 1 -- 172.21.15.43:0/963513575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f485404f580 con 0x7f4854142de0 2024-04-24T23:00:20.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.652+0000 7f4850ff9640 1 -- 172.21.15.43:0/963513575 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f484c01a070 con 0x7f4854142de0 2024-04-24T23:00:20.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.652+0000 7f4850ff9640 1 --2- 172.21.15.43:0/963513575 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f48340678c0 0x7f4834069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:20.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.652+0000 7f4850ff9640 1 -- 172.21.15.43:0/963513575 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f484c085d30 con 0x7f4854142de0 2024-04-24T23:00:20.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.652+0000 7f48537fe640 1 --2- 172.21.15.43:0/963513575 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f48340678c0 0x7f4834069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:20.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.652+0000 7f48537fe640 1 --2- 172.21.15.43:0/963513575 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f48340678c0 0x7f4834069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f48440ad000 tx=0x7f4844008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:20.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.656+0000 7f4850ff9640 1 -- 172.21.15.43:0/963513575 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f484c0565e0 con 0x7f4854142de0 2024-04-24T23:00:20.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:20.860+0000 7f4859b6a640 1 -- 172.21.15.43:0/963513575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f485414de10 con 0x7f4854142de0 2024-04-24T23:00:21.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.508+0000 7f4850ff9640 1 -- 172.21.15.43:0/963513575 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f484c055ee0 con 0x7f4854142de0 2024-04-24T23:00:21.512 INFO:teuthology.orchestra.run.smithi043.stderr:added data pool 4 to fsmap 2024-04-24T23:00:21.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.512+0000 7f4859b6a640 1 -- 172.21.15.43:0/963513575 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f48340678c0 msgr2=0x7f4834069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:21.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.512+0000 7f4859b6a640 1 --2- 172.21.15.43:0/963513575 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f48340678c0 0x7f4834069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f48440ad000 tx=0x7f4844008040 comp rx=0 tx=0).stop 2024-04-24T23:00:21.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.512+0000 7f4859b6a640 1 -- 172.21.15.43:0/963513575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4854142de0 msgr2=0x7f48541e0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:21.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.512+0000 7f4859b6a640 1 --2- 172.21.15.43:0/963513575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4854142de0 0x7f48541e0630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f484c00cb40 tx=0x7f484c00a060 comp rx=0 tx=0).stop 2024-04-24T23:00:21.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.512+0000 7f4859b6a640 1 -- 172.21.15.43:0/963513575 shutdown_connections 2024-04-24T23:00:21.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.512+0000 7f4859b6a640 1 --2- 172.21.15.43:0/963513575 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f48340678c0 0x7f4834069d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.512+0000 7f4859b6a640 1 --2- 172.21.15.43:0/963513575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4854142de0 0x7f48541e0630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.512+0000 7f4859b6a640 1 --2- 172.21.15.43:0/963513575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48540b4080 0x7f4854151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.512+0000 7f4859b6a640 1 --2- 172.21.15.43:0/963513575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48540afa00 0x7f4854139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.512+0000 7f4859b6a640 1 -- 172.21.15.43:0/963513575 >> 172.21.15.43:0/963513575 conn(0x7f48540b5690 msgr2=0x7f48540b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:21.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.512+0000 7f4859b6a640 1 -- 172.21.15.43:0/963513575 shutdown_connections 2024-04-24T23:00:21.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.512+0000 7f4859b6a640 1 -- 172.21.15.43:0/963513575 wait complete. 2024-04-24T23:00:21.534 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:00:21.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca1c98f640 1 Processor -- start 2024-04-24T23:00:21.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca1c98f640 1 -- start start 2024-04-24T23:00:21.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca1c98f640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fca1806b450 0x7fca18147e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:21.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca1c98f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca180b54f0 0x7fca18148380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:21.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca1c98f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1809f600 con 0x7fca180af420 2024-04-24T23:00:21.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca1c98f640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fca180aef90 con 0x7fca1806b450 2024-04-24T23:00:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca1c98f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fca1809f8a0 con 0x7fca180b54f0 2024-04-24T23:00:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca1659c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fca1806b450 0x7fca18147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca1659c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fca1806b450 0x7fca18147e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57100/0 (socket says 172.21.15.43:57100) 2024-04-24T23:00:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca1659c640 1 -- 172.21.15.43:0/1424324381 learned_addr learned my addr 172.21.15.43:0/1424324381 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca15d9b640 1 --2- 172.21.15.43:0/1424324381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca180b54f0 0x7fca18148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca1659c640 1 -- 172.21.15.43:0/1424324381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca180b54f0 msgr2=0x7fca18148380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca1659c640 1 --2- 172.21.15.43:0/1424324381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca180b54f0 0x7fca18148380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca1659c640 1 -- 172.21.15.43:0/1424324381 >> v1:172.21.15.162:6789/0 conn(0x7fca180af420 legacy=0x7fca180af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca1659c640 1 -- 172.21.15.43:0/1424324381 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1809fb80 con 0x7fca1806b450 2024-04-24T23:00:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.656+0000 7fca15d9b640 1 --2- 172.21.15.43:0/1424324381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca180b54f0 0x7fca18148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.660+0000 7fca1659c640 1 --2- 172.21.15.43:0/1424324381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca1806b450 0x7fca18147e40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fca08009870 tx=0x7fca0801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9df9f7829418e2f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.660+0000 7fca1559a640 1 -- 172.21.15.43:0/1424324381 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca080b0070 con 0x7fca1806b450 2024-04-24T23:00:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.660+0000 7fca1559a640 1 -- 172.21.15.43:0/1424324381 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca08004230 con 0x7fca1806b450 2024-04-24T23:00:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.660+0000 7fca1559a640 1 -- 172.21.15.43:0/1424324381 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08003620 con 0x7fca1806b450 2024-04-24T23:00:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.660+0000 7fca1c98f640 1 -- 172.21.15.43:0/1424324381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca1806b450 msgr2=0x7fca18147e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.660+0000 7fca1c98f640 1 --2- 172.21.15.43:0/1424324381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca1806b450 0x7fca18147e40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fca08009870 tx=0x7fca0801c4d0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.660+0000 7fca1c98f640 1 -- 172.21.15.43:0/1424324381 shutdown_connections 2024-04-24T23:00:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.660+0000 7fca1c98f640 1 --2- 172.21.15.43:0/1424324381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca180b54f0 0x7fca18148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.660+0000 7fca1c98f640 1 --2- 172.21.15.43:0/1424324381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca1806b450 0x7fca18147e40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.660+0000 7fca1c98f640 1 -- 172.21.15.43:0/1424324381 >> 172.21.15.43:0/1424324381 conn(0x7fca180b9b50 msgr2=0x7fca180b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.660+0000 7fca1c98f640 1 -- 172.21.15.43:0/1424324381 shutdown_connections 2024-04-24T23:00:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.660+0000 7fca1c98f640 1 -- 172.21.15.43:0/1424324381 wait complete. 2024-04-24T23:00:21.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1c98f640 1 Processor -- start 2024-04-24T23:00:21.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1c98f640 1 -- start start 2024-04-24T23:00:21.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1c98f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca1806b450 0x7fca180b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:21.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1c98f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca180af420 0x7fca1813cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:21.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1c98f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca181e0400 0x7fca180b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:21.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1c98f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fca18154970 con 0x7fca1806b450 2024-04-24T23:00:21.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1c98f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca181547f0 con 0x7fca181e0400 2024-04-24T23:00:21.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1c98f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fca18154af0 con 0x7fca180af420 2024-04-24T23:00:21.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca1806b450 0x7fca180b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:21.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca1806b450 0x7fca180b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57112/0 (socket says 172.21.15.43:57112) 2024-04-24T23:00:21.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1659c640 1 -- 172.21.15.43:0/1542309624 learned_addr learned my addr 172.21.15.43:0/1542309624 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:21.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca15d9b640 1 --2- 172.21.15.43:0/1542309624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca180af420 0x7fca1813cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:21.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca16d9d640 1 --2- 172.21.15.43:0/1542309624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca181e0400 0x7fca180b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:21.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1659c640 1 -- 172.21.15.43:0/1542309624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca180af420 msgr2=0x7fca1813cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:21.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1659c640 1 --2- 172.21.15.43:0/1542309624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca180af420 0x7fca1813cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1659c640 1 -- 172.21.15.43:0/1542309624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca181e0400 msgr2=0x7fca180b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:21.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1659c640 1 --2- 172.21.15.43:0/1542309624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca181e0400 0x7fca180b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1659c640 1 -- 172.21.15.43:0/1542309624 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca18137d80 con 0x7fca1806b450 2024-04-24T23:00:21.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1659c640 1 --2- 172.21.15.43:0/1542309624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca1806b450 0x7fca180b0e30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fca080ae040 tx=0x7fca08019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:21.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca06ffd640 1 -- 172.21.15.43:0/1542309624 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca080b0040 con 0x7fca1806b450 2024-04-24T23:00:21.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca06ffd640 1 -- 172.21.15.43:0/1542309624 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca080043e0 con 0x7fca1806b450 2024-04-24T23:00:21.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1c98f640 1 -- 172.21.15.43:0/1542309624 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca180b2360 con 0x7fca1806b450 2024-04-24T23:00:21.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca06ffd640 1 -- 172.21.15.43:0/1542309624 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca080ab680 con 0x7fca1806b450 2024-04-24T23:00:21.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1c98f640 1 -- 172.21.15.43:0/1542309624 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca181e08e0 con 0x7fca1806b450 2024-04-24T23:00:21.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca1c98f640 1 -- 172.21.15.43:0/1542309624 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca1804f580 con 0x7fca1806b450 2024-04-24T23:00:21.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.664+0000 7fca06ffd640 1 -- 172.21.15.43:0/1542309624 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fca080040f0 con 0x7fca1806b450 2024-04-24T23:00:21.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.668+0000 7fca06ffd640 1 --2- 172.21.15.43:0/1542309624 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc9f80678c0 0x7fc9f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:21.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.668+0000 7fca15d9b640 1 --2- 172.21.15.43:0/1542309624 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc9f80678c0 0x7fc9f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:21.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.668+0000 7fca06ffd640 1 -- 172.21.15.43:0/1542309624 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fca08120270 con 0x7fca1806b450 2024-04-24T23:00:21.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.668+0000 7fca15d9b640 1 --2- 172.21.15.43:0/1542309624 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc9f80678c0 0x7fc9f8069d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fca1813a740 tx=0x7fca0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:21.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.672+0000 7fca06ffd640 1 -- 172.21.15.43:0/1542309624 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fca08016150 con 0x7fca1806b450 2024-04-24T23:00:21.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.868+0000 7fca1c98f640 1 -- 172.21.15.43:0/1542309624 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca180b44d0 con 0x7fca1806b450 2024-04-24T23:00:21.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.868+0000 7fca06ffd640 1 -- 172.21.15.43:0/1542309624 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3529 (secure 0 0 0) 0x7fca080f0b50 con 0x7fca1806b450 2024-04-24T23:00:21.874 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:21.874 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/2236776475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2236776475},{"type":"v1","addr":"172.21.15.162:6833","nonce":2236776475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:00:15.762941+0000","modified":"2024-04-24T23:00:20.864265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6835/152091432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":152091432},{"type":"v1","addr":"172.21.15.43:6835","nonce":152091432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-04-24T23:00:21.875 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 7 2024-04-24T23:00:21.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.872+0000 7fca1c98f640 1 -- 172.21.15.43:0/1542309624 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc9f80678c0 msgr2=0x7fc9f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:21.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.872+0000 7fca1c98f640 1 --2- 172.21.15.43:0/1542309624 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc9f80678c0 0x7fc9f8069d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fca1813a740 tx=0x7fca0c008040 comp rx=0 tx=0).stop 2024-04-24T23:00:21.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.872+0000 7fca1c98f640 1 -- 172.21.15.43:0/1542309624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca1806b450 msgr2=0x7fca180b0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:21.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.872+0000 7fca1c98f640 1 --2- 172.21.15.43:0/1542309624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca1806b450 0x7fca180b0e30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fca080ae040 tx=0x7fca08019270 comp rx=0 tx=0).stop 2024-04-24T23:00:21.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.872+0000 7fca1c98f640 1 -- 172.21.15.43:0/1542309624 shutdown_connections 2024-04-24T23:00:21.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.872+0000 7fca1c98f640 1 --2- 172.21.15.43:0/1542309624 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc9f80678c0 0x7fc9f8069d80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.872+0000 7fca1c98f640 1 --2- 172.21.15.43:0/1542309624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca181e0400 0x7fca180b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.872+0000 7fca1c98f640 1 --2- 172.21.15.43:0/1542309624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca180af420 0x7fca1813cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.872+0000 7fca1c98f640 1 --2- 172.21.15.43:0/1542309624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca1806b450 0x7fca180b0e30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:21.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.872+0000 7fca1c98f640 1 -- 172.21.15.43:0/1542309624 >> 172.21.15.43:0/1542309624 conn(0x7fca180b9b50 msgr2=0x7fca180b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:21.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.872+0000 7fca1c98f640 1 -- 172.21.15.43:0/1542309624 shutdown_connections 2024-04-24T23:00:21.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:21.872+0000 7fca1c98f640 1 -- 172.21.15.43:0/1542309624 wait complete. 2024-04-24T23:00:21.894 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:22.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.004+0000 7fdb6b78b640 1 Processor -- start 2024-04-24T23:00:22.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.004+0000 7fdb6b78b640 1 -- start start 2024-04-24T23:00:22.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb6b78b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdb6414ecf0 0x7fdb641510e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb6b78b640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb64070060 con 0x7fdb6413f1f0 2024-04-24T23:00:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb6b78b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb640b28e0 con 0x7fdb640b2500 2024-04-24T23:00:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb6b78b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdb640af8f0 con 0x7fdb6414ecf0 2024-04-24T23:00:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb68d26640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fdb6413f1f0 0x7fdb6413f680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46278/0 (socket says 172.21.15.43:46278) 2024-04-24T23:00:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb68d26640 1 -- 172.21.15.43:0/124121424 learned_addr learned my addr 172.21.15.43:0/124121424 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb69d28640 1 --2- 172.21.15.43:0/124121424 >> v2:172.21.15.162:3300/0 conn(0x7fdb6414ecf0 0x7fdb641510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb57fff640 1 -- 172.21.15.43:0/124121424 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020128559 0 0) 0x7fdb64070060 con 0x7fdb6413f1f0 2024-04-24T23:00:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb57fff640 1 -- 172.21.15.43:0/124121424 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb50003530 con 0x7fdb6413f1f0 2024-04-24T23:00:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb57fff640 1 -- 172.21.15.43:0/124121424 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3221914855 0 0) 0x7fdb50003530 con 0x7fdb6413f1f0 2024-04-24T23:00:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb57fff640 1 -- 172.21.15.43:0/124121424 >> v2:172.21.15.162:3300/0 conn(0x7fdb6414ecf0 msgr2=0x7fdb641510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb57fff640 1 --2- 172.21.15.43:0/124121424 >> v2:172.21.15.162:3300/0 conn(0x7fdb6414ecf0 0x7fdb641510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb57fff640 1 -- 172.21.15.43:0/124121424 >> v1:172.21.15.162:6789/0 conn(0x7fdb640b2500 legacy=0x7fdb64145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb57fff640 1 -- 172.21.15.43:0/124121424 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6406fb40 con 0x7fdb6413f1f0 2024-04-24T23:00:22.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb57fff640 1 -- 172.21.15.43:0/124121424 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7fdb60001680 con 0x7fdb6413f1f0 2024-04-24T23:00:22.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb57fff640 1 -- 172.21.15.43:0/124121424 >> v1:172.21.15.43:6789/0 conn(0x7fdb6413f1f0 legacy=0x7fdb6413f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb57fff640 1 --2- 172.21.15.43:0/124121424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb500039c0 0x7fdb50003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb57fff640 1 --2- 172.21.15.43:0/124121424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb50004810 0x7fdb50004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb57fff640 1 --2- 172.21.15.43:0/124121424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb500051d0 0x7fdb5000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb57fff640 1 -- 172.21.15.43:0/124121424 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdb640af8f0 con 0x7fdb500051d0 2024-04-24T23:00:22.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb57fff640 1 -- 172.21.15.43:0/124121424 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5000c070 con 0x7fdb500039c0 2024-04-24T23:00:22.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb57fff640 1 -- 172.21.15.43:0/124121424 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5000c270 con 0x7fdb50004810 2024-04-24T23:00:22.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb69d28640 1 --2- 172.21.15.43:0/124121424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb500051d0 0x7fdb5000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb69527640 1 --2- 172.21.15.43:0/124121424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb500039c0 0x7fdb50003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb68d26640 1 --2- 172.21.15.43:0/124121424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb50004810 0x7fdb50004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb69d28640 1 -- 172.21.15.43:0/124121424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb50004810 msgr2=0x7fdb50004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:22.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb69d28640 1 --2- 172.21.15.43:0/124121424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb50004810 0x7fdb50004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb69d28640 1 -- 172.21.15.43:0/124121424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb500039c0 msgr2=0x7fdb50003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:22.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb69d28640 1 --2- 172.21.15.43:0/124121424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb500039c0 0x7fdb50003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.008+0000 7fdb69d28640 1 -- 172.21.15.43:0/124121424 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb50003530 con 0x7fdb500051d0 2024-04-24T23:00:22.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb69d28640 1 -- 172.21.15.43:0/124121424 reap_dead start 2024-04-24T23:00:22.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb69d28640 1 --2- 172.21.15.43:0/124121424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb500051d0 0x7fdb5000b9d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009fc0 tx=0x7fdb5c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb5186615d852f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:22.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb57fff640 1 -- 172.21.15.43:0/124121424 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c009c10 con 0x7fdb500051d0 2024-04-24T23:00:22.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb57fff640 1 -- 172.21.15.43:0/124121424 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5c0a5cd0 con 0x7fdb500051d0 2024-04-24T23:00:22.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb57fff640 1 -- 172.21.15.43:0/124121424 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c003be0 con 0x7fdb500051d0 2024-04-24T23:00:22.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 -- 172.21.15.43:0/124121424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb500051d0 msgr2=0x7fdb5000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 --2- 172.21.15.43:0/124121424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb500051d0 0x7fdb5000b9d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009fc0 tx=0x7fdb5c01ccc0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 -- 172.21.15.43:0/124121424 shutdown_connections 2024-04-24T23:00:22.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 --2- 172.21.15.43:0/124121424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb500051d0 0x7fdb5000b9d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 -- 172.21.15.43:0/124121424 >> 172.21.15.43:0/124121424 conn(0x7fdb640b5690 msgr2=0x7fdb640b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:22.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 -- 172.21.15.43:0/124121424 shutdown_connections 2024-04-24T23:00:22.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 -- 172.21.15.43:0/124121424 wait complete. 2024-04-24T23:00:22.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 Processor -- start 2024-04-24T23:00:22.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 -- start start 2024-04-24T23:00:22.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb500051d0 0x7fdb640b83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb64138420 0x7fdb641388a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb641de200 0x7fdb641de680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdb640b5290 con 0x7fdb64138420 2024-04-24T23:00:22.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb640b63c0 con 0x7fdb500051d0 2024-04-24T23:00:22.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdb640b5410 con 0x7fdb641de200 2024-04-24T23:00:22.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb68d26640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb64138420 0x7fdb641388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb68d26640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb64138420 0x7fdb641388a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57132/0 (socket says 172.21.15.43:57132) 2024-04-24T23:00:22.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb68d26640 1 -- 172.21.15.43:0/1610520711 learned_addr learned my addr 172.21.15.43:0/1610520711 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:22.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb69527640 1 --2- 172.21.15.43:0/1610520711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb500051d0 0x7fdb640b83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb69d28640 1 --2- 172.21.15.43:0/1610520711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb641de200 0x7fdb641de680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb68d26640 1 -- 172.21.15.43:0/1610520711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb641de200 msgr2=0x7fdb641de680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb68d26640 1 --2- 172.21.15.43:0/1610520711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb641de200 0x7fdb641de680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb68d26640 1 -- 172.21.15.43:0/1610520711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb500051d0 msgr2=0x7fdb640b83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb68d26640 1 --2- 172.21.15.43:0/1610520711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb500051d0 0x7fdb640b83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb68d26640 1 -- 172.21.15.43:0/1610520711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb640b7950 con 0x7fdb64138420 2024-04-24T23:00:22.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb69d28640 1 --2- 172.21.15.43:0/1610520711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb641de200 0x7fdb641de680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:22.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb68d26640 1 --2- 172.21.15.43:0/1610520711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb64138420 0x7fdb641388a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdb60007fd0 tx=0x7fdb6000db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:22.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb55ffb640 1 -- 172.21.15.43:0/1610520711 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60019070 con 0x7fdb64138420 2024-04-24T23:00:22.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb55ffb640 1 -- 172.21.15.43:0/1610520711 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb600072d0 con 0x7fdb64138420 2024-04-24T23:00:22.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 -- 172.21.15.43:0/1610520711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb64139e60 con 0x7fdb64138420 2024-04-24T23:00:22.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb55ffb640 1 -- 172.21.15.43:0/1610520711 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60007680 con 0x7fdb64138420 2024-04-24T23:00:22.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.012+0000 7fdb6b78b640 1 -- 172.21.15.43:0/1610520711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb641369c0 con 0x7fdb64138420 2024-04-24T23:00:22.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.016+0000 7fdb6b78b640 1 -- 172.21.15.43:0/1610520711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb64135640 con 0x7fdb64138420 2024-04-24T23:00:22.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.016+0000 7fdb55ffb640 1 -- 172.21.15.43:0/1610520711 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdb6001c070 con 0x7fdb64138420 2024-04-24T23:00:22.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.016+0000 7fdb55ffb640 1 --2- 172.21.15.43:0/1610520711 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fdb480678f0 0x7fdb48069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.016+0000 7fdb55ffb640 1 -- 172.21.15.43:0/1610520711 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdb60085850 con 0x7fdb64138420 2024-04-24T23:00:22.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.016+0000 7fdb69527640 1 --2- 172.21.15.43:0/1610520711 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fdb480678f0 0x7fdb48069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.016+0000 7fdb69527640 1 --2- 172.21.15.43:0/1610520711 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fdb480678f0 0x7fdb48069db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdb58000c10 tx=0x7fdb58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:22.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.020+0000 7fdb55ffb640 1 -- 172.21.15.43:0/1610520711 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fdb64135640 con 0x7fdb64138420 2024-04-24T23:00:22.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.176+0000 7fdb6b78b640 1 -- 172.21.15.43:0/1610520711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb64136bc0 con 0x7fdb64138420 2024-04-24T23:00:22.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.176+0000 7fdb55ffb640 1 -- 172.21.15.43:0/1610520711 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18518 (secure 0 0 0) 0x7fdb64136bc0 con 0x7fdb64138420 2024-04-24T23:00:22.183 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:22.183 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:20.863941+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:22.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.180+0000 7fdb6b78b640 1 -- 172.21.15.43:0/1610520711 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fdb480678f0 msgr2=0x7fdb48069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.180+0000 7fdb6b78b640 1 --2- 172.21.15.43:0/1610520711 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fdb480678f0 0x7fdb48069db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdb58000c10 tx=0x7fdb58009040 comp rx=0 tx=0).stop 2024-04-24T23:00:22.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.180+0000 7fdb6b78b640 1 -- 172.21.15.43:0/1610520711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb64138420 msgr2=0x7fdb641388a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.180+0000 7fdb6b78b640 1 --2- 172.21.15.43:0/1610520711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb64138420 0x7fdb641388a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdb60007fd0 tx=0x7fdb6000db80 comp rx=0 tx=0).stop 2024-04-24T23:00:22.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.180+0000 7fdb6b78b640 1 -- 172.21.15.43:0/1610520711 shutdown_connections 2024-04-24T23:00:22.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.180+0000 7fdb6b78b640 1 --2- 172.21.15.43:0/1610520711 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fdb480678f0 0x7fdb48069db0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.180+0000 7fdb6b78b640 1 --2- 172.21.15.43:0/1610520711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb641de200 0x7fdb641de680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.180+0000 7fdb6b78b640 1 --2- 172.21.15.43:0/1610520711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb64138420 0x7fdb641388a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.180+0000 7fdb6b78b640 1 --2- 172.21.15.43:0/1610520711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb500051d0 0x7fdb640b83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.180+0000 7fdb6b78b640 1 -- 172.21.15.43:0/1610520711 >> 172.21.15.43:0/1610520711 conn(0x7fdb640b5690 msgr2=0x7fdb64072930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:22.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.180+0000 7fdb6b78b640 1 -- 172.21.15.43:0/1610520711 shutdown_connections 2024-04-24T23:00:22.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.180+0000 7fdb6b78b640 1 -- 172.21.15.43:0/1610520711 wait complete. 2024-04-24T23:00:22.201 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:22.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.308+0000 7f6662de9640 1 Processor -- start 2024-04-24T23:00:22.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.308+0000 7f6662de9640 1 -- start start 2024-04-24T23:00:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.312+0000 7f6662de9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f665c070d30 0x7f665c144770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.312+0000 7f6662de9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c0b6ba0 0x7f665c144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.312+0000 7f6662de9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f665c071110 con 0x7f665c0715c0 2024-04-24T23:00:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.312+0000 7f6662de9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f665c072130 con 0x7f665c070d30 2024-04-24T23:00:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.312+0000 7f6662de9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f665c071ae0 con 0x7f665c0b6ba0 2024-04-24T23:00:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.312+0000 7f6660b85640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f665c070d30 0x7f665c144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.312+0000 7f665bfff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c0b6ba0 0x7f665c144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.312+0000 7f6660b85640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f665c070d30 0x7f665c144770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.43:46218/0 (socket says 172.21.15.43:46218) 2024-04-24T23:00:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.312+0000 7f6660b85640 1 -- 172.21.15.43:0/3409461020 learned_addr learned my addr 172.21.15.43:0/3409461020 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.312+0000 7f6661386640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f665c0715c0 0x7f665c13e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.43:48990/0 (socket says 172.21.15.43:48990) 2024-04-24T23:00:22.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.312+0000 7f6660b85640 1 -- 172.21.15.43:0/3409461020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c0b6ba0 msgr2=0x7f665c144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:22.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.312+0000 7f6660b85640 1 --2- 172.21.15.43:0/3409461020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c0b6ba0 0x7f665c144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.312+0000 7f6660b85640 1 -- 172.21.15.43:0/3409461020 >> v1:172.21.15.162:6789/0 conn(0x7f665c0715c0 legacy=0x7f665c13e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.312+0000 7f6660b85640 1 -- 172.21.15.43:0/3409461020 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c071dc0 con 0x7f665c070d30 2024-04-24T23:00:22.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6660b85640 1 --2- 172.21.15.43:0/3409461020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f665c070d30 0x7f665c144770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f665c0722b0 tx=0x7f665401c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b7fe52f4540a0a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:22.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f665b7fe640 1 -- 172.21.15.43:0/3409461020 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66540aa430 con 0x7f665c070d30 2024-04-24T23:00:22.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f665b7fe640 1 -- 172.21.15.43:0/3409461020 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66540af070 con 0x7f665c070d30 2024-04-24T23:00:22.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f665b7fe640 1 -- 172.21.15.43:0/3409461020 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66540aa7f0 con 0x7f665c070d30 2024-04-24T23:00:22.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 -- 172.21.15.43:0/3409461020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f665c070d30 msgr2=0x7f665c144770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 --2- 172.21.15.43:0/3409461020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f665c070d30 0x7f665c144770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f665c0722b0 tx=0x7f665401c4b0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 -- 172.21.15.43:0/3409461020 shutdown_connections 2024-04-24T23:00:22.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 --2- 172.21.15.43:0/3409461020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c0b6ba0 0x7f665c144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 --2- 172.21.15.43:0/3409461020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f665c070d30 0x7f665c144770 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 -- 172.21.15.43:0/3409461020 >> 172.21.15.43:0/3409461020 conn(0x7f665c06c300 msgr2=0x7f665c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:22.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 -- 172.21.15.43:0/3409461020 shutdown_connections 2024-04-24T23:00:22.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 -- 172.21.15.43:0/3409461020 wait complete. 2024-04-24T23:00:22.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 Processor -- start 2024-04-24T23:00:22.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 -- start start 2024-04-24T23:00:22.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c070d30 0x7f665c0b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f665c0715c0 0x7f665c1e0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665c0b6ba0 0x7f665c138d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f665c151860 con 0x7f665c0b6ba0 2024-04-24T23:00:22.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f665c13ed20 con 0x7f665c0715c0 2024-04-24T23:00:22.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6662de9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f665c1519e0 con 0x7f665c070d30 2024-04-24T23:00:22.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6661386640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665c0b6ba0 0x7f665c138d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6661386640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665c0b6ba0 0x7f665c138d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57140/0 (socket says 172.21.15.43:57140) 2024-04-24T23:00:22.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.316+0000 7f6661386640 1 -- 172.21.15.43:0/2613161367 learned_addr learned my addr 172.21.15.43:0/2613161367 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:22.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f6660b85640 1 --2- 172.21.15.43:0/2613161367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c070d30 0x7f665c0b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f665bfff640 1 --2- 172.21.15.43:0/2613161367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f665c0715c0 0x7f665c1e0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f6661386640 1 -- 172.21.15.43:0/2613161367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c070d30 msgr2=0x7f665c0b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f6661386640 1 --2- 172.21.15.43:0/2613161367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c070d30 0x7f665c0b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f6661386640 1 -- 172.21.15.43:0/2613161367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f665c0715c0 msgr2=0x7f665c1e0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f6661386640 1 --2- 172.21.15.43:0/2613161367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f665c0715c0 0x7f665c1e0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f6661386640 1 -- 172.21.15.43:0/2613161367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c13f000 con 0x7f665c0b6ba0 2024-04-24T23:00:22.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f6661386640 1 --2- 172.21.15.43:0/2613161367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665c0b6ba0 0x7f665c138d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f664c00c410 tx=0x7f664c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:22.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f66597fa640 1 -- 172.21.15.43:0/2613161367 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c0074e0 con 0x7f665c0b6ba0 2024-04-24T23:00:22.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f66597fa640 1 -- 172.21.15.43:0/2613161367 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664c007680 con 0x7f665c0b6ba0 2024-04-24T23:00:22.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f6662de9640 1 -- 172.21.15.43:0/2613161367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665c1dfa90 con 0x7f665c0b6ba0 2024-04-24T23:00:22.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f66597fa640 1 -- 172.21.15.43:0/2613161367 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c004a10 con 0x7f665c0b6ba0 2024-04-24T23:00:22.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f6662de9640 1 -- 172.21.15.43:0/2613161367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665c1dfd50 con 0x7f665c0b6ba0 2024-04-24T23:00:22.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f6662de9640 1 -- 172.21.15.43:0/2613161367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f665c04f580 con 0x7f665c0b6ba0 2024-04-24T23:00:22.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f66597fa640 1 -- 172.21.15.43:0/2613161367 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f664c01a020 con 0x7f665c0b6ba0 2024-04-24T23:00:22.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f66597fa640 1 --2- 172.21.15.43:0/2613161367 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f663c0678c0 0x7f663c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f66597fa640 1 -- 172.21.15.43:0/2613161367 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f664c085e20 con 0x7f665c0b6ba0 2024-04-24T23:00:22.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f6660b85640 1 --2- 172.21.15.43:0/2613161367 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f663c0678c0 0x7f663c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.320+0000 7f6660b85640 1 --2- 172.21.15.43:0/2613161367 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f663c0678c0 0x7f663c069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f66540ae000 tx=0x7f66540a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:22.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.324+0000 7f66597fa640 1 -- 172.21.15.43:0/2613161367 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f664c021070 con 0x7f665c0b6ba0 2024-04-24T23:00:22.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.488+0000 7f6662de9640 1 -- 172.21.15.43:0/2613161367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f665c1dff20 con 0x7f665c0b6ba0 2024-04-24T23:00:22.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.488+0000 7f66597fa640 1 -- 172.21.15.43:0/2613161367 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18518 (secure 0 0 0) 0x7f664c056790 con 0x7f665c0b6ba0 2024-04-24T23:00:22.494 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:22.495 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:20.863941+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:22.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.492+0000 7f6662de9640 1 -- 172.21.15.43:0/2613161367 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f663c0678c0 msgr2=0x7f663c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.492+0000 7f6662de9640 1 --2- 172.21.15.43:0/2613161367 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f663c0678c0 0x7f663c069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f66540ae000 tx=0x7f66540a7000 comp rx=0 tx=0).stop 2024-04-24T23:00:22.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.492+0000 7f6662de9640 1 -- 172.21.15.43:0/2613161367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665c0b6ba0 msgr2=0x7f665c138d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.492+0000 7f6662de9640 1 --2- 172.21.15.43:0/2613161367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665c0b6ba0 0x7f665c138d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f664c00c410 tx=0x7f664c00c8d0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.492+0000 7f6662de9640 1 -- 172.21.15.43:0/2613161367 shutdown_connections 2024-04-24T23:00:22.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.492+0000 7f6662de9640 1 --2- 172.21.15.43:0/2613161367 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f663c0678c0 0x7f663c069d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.492+0000 7f6662de9640 1 --2- 172.21.15.43:0/2613161367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665c0b6ba0 0x7f665c138d80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.492+0000 7f6662de9640 1 --2- 172.21.15.43:0/2613161367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f665c0715c0 0x7f665c1e0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.492+0000 7f6662de9640 1 --2- 172.21.15.43:0/2613161367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c070d30 0x7f665c0b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.492+0000 7f6662de9640 1 -- 172.21.15.43:0/2613161367 >> 172.21.15.43:0/2613161367 conn(0x7f665c06c300 msgr2=0x7f665c141210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:22.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.492+0000 7f6662de9640 1 -- 172.21.15.43:0/2613161367 shutdown_connections 2024-04-24T23:00:22.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.492+0000 7f6662de9640 1 -- 172.21.15.43:0/2613161367 wait complete. 2024-04-24T23:00:22.529 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:00:22.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9db63b8640 1 Processor -- start 2024-04-24T23:00:22.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9db63b8640 1 -- start start 2024-04-24T23:00:22.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9db63b8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9db0073690 0x7f9db0142410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9db63b8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9db00b7e40 0x7f9db0142950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9db63b8640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9db00b8320 con 0x7f9db00b7030 2024-04-24T23:00:22.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9db63b8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9db00b8600 con 0x7f9db00b7e40 2024-04-24T23:00:22.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9db63b8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9db00b59f0 con 0x7f9db0073690 2024-04-24T23:00:22.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daffff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9db00b7030 0x7f9db00b5e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46282/0 (socket says 172.21.15.43:46282) 2024-04-24T23:00:22.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daffff640 1 -- 172.21.15.43:0/792861518 learned_addr learned my addr 172.21.15.43:0/792861518 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:22.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 -- 172.21.15.43:0/792861518 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878316683 0 0) 0x7f9db00b8320 con 0x7f9db00b7030 2024-04-24T23:00:22.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9db4955640 1 --2- 172.21.15.43:0/792861518 >> v2:172.21.15.162:3300/0 conn(0x7f9db00b7e40 0x7f9db0142950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 -- 172.21.15.43:0/792861518 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d9c003530 con 0x7f9db00b7030 2024-04-24T23:00:22.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9da7fff640 1 --2- 172.21.15.43:0/792861518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9db0073690 0x7f9db0142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 -- 172.21.15.43:0/792861518 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3279707729 0 0) 0x7f9d9c003530 con 0x7f9db00b7030 2024-04-24T23:00:22.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 -- 172.21.15.43:0/792861518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9db0073690 msgr2=0x7f9db0142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:22.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 --2- 172.21.15.43:0/792861518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9db0073690 0x7f9db0142410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 -- 172.21.15.43:0/792861518 >> v2:172.21.15.162:3300/0 conn(0x7f9db00b7e40 msgr2=0x7f9db0142950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:22.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 --2- 172.21.15.43:0/792861518 >> v2:172.21.15.162:3300/0 conn(0x7f9db00b7e40 0x7f9db0142950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 -- 172.21.15.43:0/792861518 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db00b7410 con 0x7f9db00b7030 2024-04-24T23:00:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 -- 172.21.15.43:0/792861518 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f9da0001680 con 0x7f9db00b7030 2024-04-24T23:00:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 -- 172.21.15.43:0/792861518 >> v1:172.21.15.43:6789/0 conn(0x7f9db00b7030 legacy=0x7f9db00b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 --2- 172.21.15.43:0/792861518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0039c0 0x7f9d9c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 --2- 172.21.15.43:0/792861518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9db0073690 0x7f9d9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 --2- 172.21.15.43:0/792861518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d9c004d50 0x7f9d9c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 -- 172.21.15.43:0/792861518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9db00b8600 con 0x7f9d9c0039c0 2024-04-24T23:00:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 -- 172.21.15.43:0/792861518 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9db00b59f0 con 0x7f9d9c004d50 2024-04-24T23:00:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daf7fe640 1 -- 172.21.15.43:0/792861518 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9d9c00bb60 con 0x7f9db0073690 2024-04-24T23:00:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daffff640 1 --2- 172.21.15.43:0/792861518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0039c0 0x7f9d9c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9db4955640 1 --2- 172.21.15.43:0/792861518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d9c004d50 0x7f9d9c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9da7fff640 1 --2- 172.21.15.43:0/792861518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9db0073690 0x7f9d9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daffff640 1 -- 172.21.15.43:0/792861518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9db0073690 msgr2=0x7f9d9c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daffff640 1 --2- 172.21.15.43:0/792861518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9db0073690 0x7f9d9c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daffff640 1 -- 172.21.15.43:0/792861518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d9c004d50 msgr2=0x7f9d9c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:22.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daffff640 1 --2- 172.21.15.43:0/792861518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d9c004d50 0x7f9d9c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.636+0000 7f9daffff640 1 -- 172.21.15.43:0/792861518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9c003530 con 0x7f9d9c0039c0 2024-04-24T23:00:22.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9daffff640 1 --2- 172.21.15.43:0/792861518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0039c0 0x7f9d9c003de0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9da0001060 tx=0x7f9da001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2fa21bb1baf5ac server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:22.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9daf7fe640 1 -- 172.21.15.43:0/792861518 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0007d80 con 0x7f9d9c0039c0 2024-04-24T23:00:22.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9daf7fe640 1 -- 172.21.15.43:0/792861518 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da00a9020 con 0x7f9d9c0039c0 2024-04-24T23:00:22.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9daf7fe640 1 -- 172.21.15.43:0/792861518 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0005b00 con 0x7f9d9c0039c0 2024-04-24T23:00:22.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 -- 172.21.15.43:0/792861518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0039c0 msgr2=0x7f9d9c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 --2- 172.21.15.43:0/792861518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0039c0 0x7f9d9c003de0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9da0001060 tx=0x7f9da001cca0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db4955640 1 -- 172.21.15.43:0/792861518 reap_dead start 2024-04-24T23:00:22.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 -- 172.21.15.43:0/792861518 shutdown_connections 2024-04-24T23:00:22.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 -- 172.21.15.43:0/792861518 >> 172.21.15.43:0/792861518 conn(0x7f9db0062030 msgr2=0x7f9db0062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:22.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 -- 172.21.15.43:0/792861518 shutdown_connections 2024-04-24T23:00:22.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 -- 172.21.15.43:0/792861518 wait complete. 2024-04-24T23:00:22.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 Processor -- start 2024-04-24T23:00:22.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 -- start start 2024-04-24T23:00:22.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d9c0039c0 0x7f9db00bb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9db006db80 0x7f9db01e4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9db006c930 0x7f9db013de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9db0150800 con 0x7f9db006db80 2024-04-24T23:00:22.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9db0150680 con 0x7f9d9c0039c0 2024-04-24T23:00:22.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9db0150980 con 0x7f9db006c930 2024-04-24T23:00:22.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9da7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9db006db80 0x7f9db01e4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9da7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9db006db80 0x7f9db01e4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57154/0 (socket says 172.21.15.43:57154) 2024-04-24T23:00:22.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9da7fff640 1 -- 172.21.15.43:0/2691274810 learned_addr learned my addr 172.21.15.43:0/2691274810 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:22.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9daffff640 1 --2- 172.21.15.43:0/2691274810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d9c0039c0 0x7f9db00bb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9da7fff640 1 -- 172.21.15.43:0/2691274810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9db006c930 msgr2=0x7f9db013de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9da7fff640 1 --2- 172.21.15.43:0/2691274810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9db006c930 0x7f9db013de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9da7fff640 1 -- 172.21.15.43:0/2691274810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d9c0039c0 msgr2=0x7f9db00bb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9da7fff640 1 --2- 172.21.15.43:0/2691274810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d9c0039c0 0x7f9db00bb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9da7fff640 1 -- 172.21.15.43:0/2691274810 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db00a94d0 con 0x7f9db006db80 2024-04-24T23:00:22.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9daffff640 1 --2- 172.21.15.43:0/2691274810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d9c0039c0 0x7f9db00bb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:22.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9da7fff640 1 --2- 172.21.15.43:0/2691274810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9db006db80 0x7f9db01e4180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800f580 tx=0x7f9d9800fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:22.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9dad7fa640 1 -- 172.21.15.43:0/2691274810 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d98019020 con 0x7f9db006db80 2024-04-24T23:00:22.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9dad7fa640 1 -- 172.21.15.43:0/2691274810 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d98014870 con 0x7f9db006db80 2024-04-24T23:00:22.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9dad7fa640 1 -- 172.21.15.43:0/2691274810 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d98014c40 con 0x7f9db006db80 2024-04-24T23:00:22.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 -- 172.21.15.43:0/2691274810 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db01e3980 con 0x7f9db006db80 2024-04-24T23:00:22.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.640+0000 7f9db63b8640 1 -- 172.21.15.43:0/2691274810 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db00bb9c0 con 0x7f9db006db80 2024-04-24T23:00:22.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.644+0000 7f9db63b8640 1 -- 172.21.15.43:0/2691274810 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db004f580 con 0x7f9db006db80 2024-04-24T23:00:22.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.644+0000 7f9dad7fa640 1 -- 172.21.15.43:0/2691274810 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9d9801c020 con 0x7f9db006db80 2024-04-24T23:00:22.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.644+0000 7f9dad7fa640 1 --2- 172.21.15.43:0/2691274810 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9d900678f0 0x7f9d90069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.644+0000 7f9dad7fa640 1 -- 172.21.15.43:0/2691274810 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9d98086770 con 0x7f9db006db80 2024-04-24T23:00:22.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.644+0000 7f9daffff640 1 --2- 172.21.15.43:0/2691274810 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9d900678f0 0x7f9d90069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.644+0000 7f9daffff640 1 --2- 172.21.15.43:0/2691274810 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9d900678f0 0x7f9d90069db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9da00aa000 tx=0x7f9da0001a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:22.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.648+0000 7f9dad7fa640 1 -- 172.21.15.43:0/2691274810 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9d98023020 con 0x7f9db006db80 2024-04-24T23:00:22.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.840+0000 7f9db63b8640 1 -- 172.21.15.43:0/2691274810 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9db0144b00 con 0x7f9db006db80 2024-04-24T23:00:22.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.844+0000 7f9dad7fa640 1 -- 172.21.15.43:0/2691274810 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3529 (secure 0 0 0) 0x7f9d98026350 con 0x7f9db006db80 2024-04-24T23:00:22.847 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:22.847 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/2236776475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2236776475},{"type":"v1","addr":"172.21.15.162:6833","nonce":2236776475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:00:15.762941+0000","modified":"2024-04-24T23:00:20.864265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6835/152091432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":152091432},{"type":"v1","addr":"172.21.15.43:6835","nonce":152091432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-04-24T23:00:22.847 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 7 2024-04-24T23:00:22.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.844+0000 7f9db63b8640 1 -- 172.21.15.43:0/2691274810 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9d900678f0 msgr2=0x7f9d90069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.844+0000 7f9db63b8640 1 --2- 172.21.15.43:0/2691274810 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9d900678f0 0x7f9d90069db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9da00aa000 tx=0x7f9da0001a50 comp rx=0 tx=0).stop 2024-04-24T23:00:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.844+0000 7f9db63b8640 1 -- 172.21.15.43:0/2691274810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9db006db80 msgr2=0x7f9db01e4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.844+0000 7f9db63b8640 1 --2- 172.21.15.43:0/2691274810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9db006db80 0x7f9db01e4180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800f580 tx=0x7f9d9800fa40 comp rx=0 tx=0).stop 2024-04-24T23:00:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.844+0000 7f9db63b8640 1 -- 172.21.15.43:0/2691274810 shutdown_connections 2024-04-24T23:00:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.844+0000 7f9db63b8640 1 --2- 172.21.15.43:0/2691274810 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9d900678f0 0x7f9d90069db0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.844+0000 7f9db63b8640 1 --2- 172.21.15.43:0/2691274810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9db006c930 0x7f9db013de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.844+0000 7f9db63b8640 1 --2- 172.21.15.43:0/2691274810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9db006db80 0x7f9db01e4180 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.844+0000 7f9db63b8640 1 --2- 172.21.15.43:0/2691274810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d9c0039c0 0x7f9db00bb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.844+0000 7f9db63b8640 1 -- 172.21.15.43:0/2691274810 >> 172.21.15.43:0/2691274810 conn(0x7f9db0062030 msgr2=0x7f9db00b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.844+0000 7f9db63b8640 1 -- 172.21.15.43:0/2691274810 shutdown_connections 2024-04-24T23:00:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.844+0000 7f9db63b8640 1 -- 172.21.15.43:0/2691274810 wait complete. 2024-04-24T23:00:22.865 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:22.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.984+0000 7faf6c017640 1 Processor -- start 2024-04-24T23:00:22.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.984+0000 7faf6c017640 1 -- start start 2024-04-24T23:00:22.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.984+0000 7faf6c017640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faf64070640 0x7faf64145300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.984+0000 7faf6c017640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf64072580 0x7faf6413f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.984+0000 7faf6c017640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf64062270 con 0x7faf64061e90 2024-04-24T23:00:22.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.984+0000 7faf6c017640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7faf64071700 con 0x7faf64070640 2024-04-24T23:00:22.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.984+0000 7faf6c017640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faf64145920 con 0x7faf64072580 2024-04-24T23:00:22.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.984+0000 7faf695b2640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faf64070640 0x7faf64145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.984+0000 7faf695b2640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faf64070640 0x7faf64145300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57156/0 (socket says 172.21.15.43:57156) 2024-04-24T23:00:22.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.984+0000 7faf695b2640 1 -- 172.21.15.43:0/107361643 learned_addr learned my addr 172.21.15.43:0/107361643 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:22.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.984+0000 7faf6a5b4640 1 --2- 172.21.15.43:0/107361643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf64072580 0x7faf6413f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.984+0000 7faf695b2640 1 -- 172.21.15.43:0/107361643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf64072580 msgr2=0x7faf6413f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:22.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.984+0000 7faf695b2640 1 --2- 172.21.15.43:0/107361643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf64072580 0x7faf6413f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.984+0000 7faf695b2640 1 -- 172.21.15.43:0/107361643 >> v1:172.21.15.162:6789/0 conn(0x7faf64061e90 legacy=0x7faf64071e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:22.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.984+0000 7faf695b2640 1 -- 172.21.15.43:0/107361643 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf64145c00 con 0x7faf64070640 2024-04-24T23:00:22.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf695b2640 1 --2- 172.21.15.43:0/107361643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf64070640 0x7faf64145300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faf54009870 tx=0x7faf5401cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5717361a0d999b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:22.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf68db1640 1 -- 172.21.15.43:0/107361643 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf540a9610 con 0x7faf64070640 2024-04-24T23:00:22.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf68db1640 1 -- 172.21.15.43:0/107361643 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf540a97b0 con 0x7faf64070640 2024-04-24T23:00:22.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf68db1640 1 -- 172.21.15.43:0/107361643 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf540a9b80 con 0x7faf64070640 2024-04-24T23:00:22.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 -- 172.21.15.43:0/107361643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf64070640 msgr2=0x7faf64145300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 --2- 172.21.15.43:0/107361643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf64070640 0x7faf64145300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faf54009870 tx=0x7faf5401cf90 comp rx=0 tx=0).stop 2024-04-24T23:00:22.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 -- 172.21.15.43:0/107361643 shutdown_connections 2024-04-24T23:00:22.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 --2- 172.21.15.43:0/107361643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf64072580 0x7faf6413f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 --2- 172.21.15.43:0/107361643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf64070640 0x7faf64145300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 -- 172.21.15.43:0/107361643 >> 172.21.15.43:0/107361643 conn(0x7faf640b93e0 msgr2=0x7faf640b97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:22.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 -- 172.21.15.43:0/107361643 shutdown_connections 2024-04-24T23:00:22.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 -- 172.21.15.43:0/107361643 wait complete. 2024-04-24T23:00:22.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 Processor -- start 2024-04-24T23:00:22.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 -- start start 2024-04-24T23:00:22.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf64061e90 0x7faf640b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf64070640 0x7faf641ddfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf64072580 0x7faf6413acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faf64152830 con 0x7faf64070640 2024-04-24T23:00:22.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf641526b0 con 0x7faf64072580 2024-04-24T23:00:22.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6c017640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faf641529b0 con 0x7faf64061e90 2024-04-24T23:00:22.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf695b2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf64070640 0x7faf641ddfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf695b2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf64070640 0x7faf641ddfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57168/0 (socket says 172.21.15.43:57168) 2024-04-24T23:00:22.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf695b2640 1 -- 172.21.15.43:0/2206612354 learned_addr learned my addr 172.21.15.43:0/2206612354 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:22.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf69db3640 1 --2- 172.21.15.43:0/2206612354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf64061e90 0x7faf640b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf6a5b4640 1 --2- 172.21.15.43:0/2206612354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf64072580 0x7faf6413acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf695b2640 1 -- 172.21.15.43:0/2206612354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf64061e90 msgr2=0x7faf640b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf695b2640 1 --2- 172.21.15.43:0/2206612354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf64061e90 0x7faf640b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf695b2640 1 -- 172.21.15.43:0/2206612354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf64072580 msgr2=0x7faf6413acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:22.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf695b2640 1 --2- 172.21.15.43:0/2206612354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf64072580 0x7faf6413acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:22.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf695b2640 1 -- 172.21.15.43:0/2206612354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf640b88e0 con 0x7faf64070640 2024-04-24T23:00:22.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf695b2640 1 --2- 172.21.15.43:0/2206612354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf64070640 0x7faf641ddfe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faf540ab040 tx=0x7faf5401ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:22.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf5a7fc640 1 -- 172.21.15.43:0/2206612354 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf540bc650 con 0x7faf64070640 2024-04-24T23:00:22.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.988+0000 7faf5a7fc640 1 -- 172.21.15.43:0/2206612354 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf540bc7f0 con 0x7faf64070640 2024-04-24T23:00:22.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.992+0000 7faf6c017640 1 -- 172.21.15.43:0/2206612354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf641e16d0 con 0x7faf64070640 2024-04-24T23:00:22.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.992+0000 7faf5a7fc640 1 -- 172.21.15.43:0/2206612354 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf540bcbe0 con 0x7faf64070640 2024-04-24T23:00:22.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.992+0000 7faf6c017640 1 -- 172.21.15.43:0/2206612354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf641de520 con 0x7faf64070640 2024-04-24T23:00:22.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.992+0000 7faf6c017640 1 -- 172.21.15.43:0/2206612354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf6406c200 con 0x7faf64070640 2024-04-24T23:00:22.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.992+0000 7faf5a7fc640 1 -- 172.21.15.43:0/2206612354 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf540c53f0 con 0x7faf64070640 2024-04-24T23:00:22.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.992+0000 7faf5a7fc640 1 --2- 172.21.15.43:0/2206612354 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7faf480678c0 0x7faf48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:22.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.992+0000 7faf5a7fc640 1 -- 172.21.15.43:0/2206612354 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7faf541207e0 con 0x7faf64070640 2024-04-24T23:00:22.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.992+0000 7faf69db3640 1 --2- 172.21.15.43:0/2206612354 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7faf480678c0 0x7faf48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:22.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.992+0000 7faf69db3640 1 --2- 172.21.15.43:0/2206612354 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7faf480678c0 0x7faf48069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faf60001650 tx=0x7faf60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:22.996+0000 7faf5a7fc640 1 -- 172.21.15.43:0/2206612354 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7faf540ad020 con 0x7faf64070640 2024-04-24T23:00:23.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.152+0000 7faf6c017640 1 -- 172.21.15.43:0/2206612354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf64071140 con 0x7faf64070640 2024-04-24T23:00:23.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.152+0000 7faf5a7fc640 1 -- 172.21.15.43:0/2206612354 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18518 (secure 0 0 0) 0x7faf54016150 con 0x7faf64070640 2024-04-24T23:00:23.158 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:23.158 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:20.863941+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:23.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.156+0000 7faf6c017640 1 -- 172.21.15.43:0/2206612354 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7faf480678c0 msgr2=0x7faf48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.156+0000 7faf6c017640 1 --2- 172.21.15.43:0/2206612354 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7faf480678c0 0x7faf48069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faf60001650 tx=0x7faf60009040 comp rx=0 tx=0).stop 2024-04-24T23:00:23.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.156+0000 7faf6c017640 1 -- 172.21.15.43:0/2206612354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf64070640 msgr2=0x7faf641ddfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.156+0000 7faf6c017640 1 --2- 172.21.15.43:0/2206612354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf64070640 0x7faf641ddfe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faf540ab040 tx=0x7faf5401ad70 comp rx=0 tx=0).stop 2024-04-24T23:00:23.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.156+0000 7faf6c017640 1 -- 172.21.15.43:0/2206612354 shutdown_connections 2024-04-24T23:00:23.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.156+0000 7faf6c017640 1 --2- 172.21.15.43:0/2206612354 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7faf480678c0 0x7faf48069d80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.156+0000 7faf6c017640 1 --2- 172.21.15.43:0/2206612354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf64072580 0x7faf6413acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.156+0000 7faf6c017640 1 --2- 172.21.15.43:0/2206612354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf64070640 0x7faf641ddfe0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.156+0000 7faf6c017640 1 --2- 172.21.15.43:0/2206612354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf64061e90 0x7faf640b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.156+0000 7faf6c017640 1 -- 172.21.15.43:0/2206612354 >> 172.21.15.43:0/2206612354 conn(0x7faf640b93e0 msgr2=0x7faf64143270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:23.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.156+0000 7faf6c017640 1 -- 172.21.15.43:0/2206612354 shutdown_connections 2024-04-24T23:00:23.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.156+0000 7faf6c017640 1 -- 172.21.15.43:0/2206612354 wait complete. 2024-04-24T23:00:23.376 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:00:15.762941+0000', 'modified': '2024-04-24T23:00:20.864265+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4248}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4248': {'gid': 4248, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6835/152091432', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 152091432}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 152091432}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4248, 'qdb_cluster': [4248]} 2024-04-24T23:00:23.377 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:00:23.377 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-24T23:00:23.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd39ab40640 1 Processor -- start 2024-04-24T23:00:23.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd39ab40640 1 -- start start 2024-04-24T23:00:23.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd39ab40640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3940b37f0 0x7fd394072820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd39ab40640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd3940733a0 0x7fd394144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd39ab40640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3940b3bd0 con 0x7fd394072d60 2024-04-24T23:00:23.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd39ab40640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd3940b24f0 con 0x7fd3940733a0 2024-04-24T23:00:23.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd39ab40640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd3940b2980 con 0x7fd3940b37f0 2024-04-24T23:00:23.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd3990dd640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fd394072d60 0x7fd3941477d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.43:49012/0 (socket says 172.21.15.43:49012) 2024-04-24T23:00:23.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd3990dd640 1 -- 172.21.15.43:0/2483786447 learned_addr learned my addr 172.21.15.43:0/2483786447 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:23.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd393fff640 1 --2- 172.21.15.43:0/2483786447 >> v2:172.21.15.162:3300/0 conn(0x7fd3940733a0 0x7fd394144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd3988dc640 1 --2- 172.21.15.43:0/2483786447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3940b37f0 0x7fd394072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd3937fe640 1 -- 172.21.15.43:0/2483786447 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2694237654 0 0) 0x7fd3940b3bd0 con 0x7fd394072d60 2024-04-24T23:00:23.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd3937fe640 1 -- 172.21.15.43:0/2483786447 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd37c003530 con 0x7fd394072d60 2024-04-24T23:00:23.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd393fff640 1 -- 172.21.15.43:0/2483786447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3940b37f0 msgr2=0x7fd394072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:23.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd393fff640 1 --2- 172.21.15.43:0/2483786447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3940b37f0 0x7fd394072820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd393fff640 1 -- 172.21.15.43:0/2483786447 >> v1:172.21.15.162:6789/0 conn(0x7fd394072d60 legacy=0x7fd3941477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd393fff640 1 -- 172.21.15.43:0/2483786447 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39406fdd0 con 0x7fd3940733a0 2024-04-24T23:00:23.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.504+0000 7fd3988dc640 1 --2- 172.21.15.43:0/2483786447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3940b37f0 0x7fd394072820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:00:23.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.508+0000 7fd393fff640 1 --2- 172.21.15.43:0/2483786447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3940733a0 0x7fd394144260 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd3840097c0 tx=0x7fd38401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab8004a295633b94 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.508+0000 7fd3937fe640 1 -- 172.21.15.43:0/2483786447 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3840b0070 con 0x7fd3940733a0 2024-04-24T23:00:23.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.508+0000 7fd3937fe640 1 -- 172.21.15.43:0/2483786447 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3840ab600 con 0x7fd3940733a0 2024-04-24T23:00:23.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.508+0000 7fd3937fe640 1 -- 172.21.15.43:0/2483786447 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3840ab9b0 con 0x7fd3940733a0 2024-04-24T23:00:23.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.508+0000 7fd39ab40640 1 -- 172.21.15.43:0/2483786447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3940733a0 msgr2=0x7fd394144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.508+0000 7fd39ab40640 1 --2- 172.21.15.43:0/2483786447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3940733a0 0x7fd394144260 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd3840097c0 tx=0x7fd38401c410 comp rx=0 tx=0).stop 2024-04-24T23:00:23.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.508+0000 7fd39ab40640 1 -- 172.21.15.43:0/2483786447 shutdown_connections 2024-04-24T23:00:23.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.508+0000 7fd39ab40640 1 --2- 172.21.15.43:0/2483786447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3940733a0 0x7fd394144260 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.508+0000 7fd39ab40640 1 --2- 172.21.15.43:0/2483786447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3940b37f0 0x7fd394072820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.508+0000 7fd39ab40640 1 -- 172.21.15.43:0/2483786447 >> 172.21.15.43:0/2483786447 conn(0x7fd3940b5690 msgr2=0x7fd3940b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:23.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.508+0000 7fd39ab40640 1 -- 172.21.15.43:0/2483786447 shutdown_connections 2024-04-24T23:00:23.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.508+0000 7fd39ab40640 1 -- 172.21.15.43:0/2483786447 wait complete. 2024-04-24T23:00:23.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd39ab40640 1 Processor -- start 2024-04-24T23:00:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd39ab40640 1 -- start start 2024-04-24T23:00:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd39ab40640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd394072d60 0x7fd3940ad5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd39ab40640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3940733a0 0x7fd3940b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd39ab40640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3940b37f0 0x7fd394140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd39ab40640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd394151eb0 con 0x7fd3940733a0 2024-04-24T23:00:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd39ab40640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd394151d30 con 0x7fd3940b37f0 2024-04-24T23:00:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd39ab40640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd394152030 con 0x7fd394072d60 2024-04-24T23:00:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd393fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3940733a0 0x7fd3940b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd393fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3940733a0 0x7fd3940b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57182/0 (socket says 172.21.15.43:57182) 2024-04-24T23:00:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd393fff640 1 -- 172.21.15.43:0/4027797549 learned_addr learned my addr 172.21.15.43:0/4027797549 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd3990dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3940b37f0 0x7fd394140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd3988dc640 1 --2- 172.21.15.43:0/4027797549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd394072d60 0x7fd3940ad5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd393fff640 1 -- 172.21.15.43:0/4027797549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd394072d60 msgr2=0x7fd3940ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd393fff640 1 --2- 172.21.15.43:0/4027797549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd394072d60 0x7fd3940ad5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd393fff640 1 -- 172.21.15.43:0/4027797549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3940b37f0 msgr2=0x7fd394140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd393fff640 1 --2- 172.21.15.43:0/4027797549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3940b37f0 0x7fd394140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd393fff640 1 -- 172.21.15.43:0/4027797549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3940ae8e0 con 0x7fd3940733a0 2024-04-24T23:00:23.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd393fff640 1 --2- 172.21.15.43:0/4027797549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3940733a0 0x7fd3940b3e50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd38401a040 tx=0x7fd3840191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd3917fa640 1 -- 172.21.15.43:0/4027797549 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3840b0040 con 0x7fd3940733a0 2024-04-24T23:00:23.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd3917fa640 1 -- 172.21.15.43:0/4027797549 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3840ab9b0 con 0x7fd3940733a0 2024-04-24T23:00:23.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd39ab40640 1 -- 172.21.15.43:0/4027797549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3940ac4d0 con 0x7fd3940733a0 2024-04-24T23:00:23.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd3917fa640 1 -- 172.21.15.43:0/4027797549 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3840abd60 con 0x7fd3940733a0 2024-04-24T23:00:23.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd39ab40640 1 -- 172.21.15.43:0/4027797549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3940ae600 con 0x7fd3940733a0 2024-04-24T23:00:23.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.512+0000 7fd3917fa640 1 -- 172.21.15.43:0/4027797549 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd3840ab480 con 0x7fd3940733a0 2024-04-24T23:00:23.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd3917fa640 1 --2- 172.21.15.43:0/4027797549 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd3800678c0 0x7fd380069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd3917fa640 1 -- 172.21.15.43:0/4027797549 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd38411f990 con 0x7fd3940733a0 2024-04-24T23:00:23.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd3988dc640 1 --2- 172.21.15.43:0/4027797549 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd3800678c0 0x7fd380069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 Processor -- start 2024-04-24T23:00:23.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd3988dc640 1 --2- 172.21.15.43:0/4027797549 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd3800678c0 0x7fd380069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd388009580 tx=0x7fd388009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 -- start start 2024-04-24T23:00:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9827d90 0x55c1c97fbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9826310 0x55c1c98266f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9827010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c1c96445e0 con 0x55c1c9826c30 2024-04-24T23:00:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c1c95cbc50 con 0x55c1c9826310 2024-04-24T23:00:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c1c96405a0 con 0x55c1c9827d90 2024-04-24T23:00:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd3990dd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9827010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd3990dd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9827010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57184/0 (socket says 172.21.15.43:57184) 2024-04-24T23:00:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd3990dd640 1 -- 172.21.15.43:0/2416367076 learned_addr learned my addr 172.21.15.43:0/2416367076 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd393fff640 1 --2- 172.21.15.43:0/2416367076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9826310 0x55c1c98266f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd3988dc640 1 --2- 172.21.15.43:0/2416367076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9827d90 0x55c1c97fbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd3990dd640 1 -- 172.21.15.43:0/2416367076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9827d90 msgr2=0x55c1c97fbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd3990dd640 1 --2- 172.21.15.43:0/2416367076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9827d90 0x55c1c97fbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd3990dd640 1 -- 172.21.15.43:0/2416367076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9826310 msgr2=0x55c1c98266f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd3990dd640 1 --2- 172.21.15.43:0/2416367076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9826310 0x55c1c98266f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd3990dd640 1 -- 172.21.15.43:0/2416367076 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1c95c9d10 con 0x55c1c9826c30 2024-04-24T23:00:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd3990dd640 1 --2- 172.21.15.43:0/2416367076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9827010 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0070c0 tx=0x7fd38c007580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6110a726945ab070 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd37a7fc640 1 -- 172.21.15.43:0/2416367076 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c017020 con 0x55c1c9826c30 2024-04-24T23:00:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd37a7fc640 1 -- 172.21.15.43:0/2416367076 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38c013600 con 0x55c1c9826c30 2024-04-24T23:00:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd37a7fc640 1 -- 172.21.15.43:0/2416367076 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0139d0 con 0x55c1c9826c30 2024-04-24T23:00:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 -- 172.21.15.43:0/2416367076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 msgr2=0x55c1c9827010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/2416367076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9827010 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0070c0 tx=0x7fd38c007580 comp rx=0 tx=0).stop 2024-04-24T23:00:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 -- 172.21.15.43:0/2416367076 shutdown_connections 2024-04-24T23:00:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/2416367076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9827010 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/2416367076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9826310 0x55c1c98266f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/2416367076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9827d90 0x55c1c97fbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 -- 172.21.15.43:0/2416367076 >> 172.21.15.43:0/2416367076 conn(0x55c1c98220c0 msgr2=0x55c1c98244b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:23.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 -- 172.21.15.43:0/2416367076 shutdown_connections 2024-04-24T23:00:23.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 -- 172.21.15.43:0/2416367076 wait complete. 2024-04-24T23:00:23.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 -- start start 2024-04-24T23:00:23.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.516+0000 7fd39dcb9000 1 Processor -- start 2024-04-24T23:00:23.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826310 0x55c1c98214f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9826c30 0x55c1c9800a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9827d90 0x55c1c9800fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c1c9648c10 con 0x55c1c9826310 2024-04-24T23:00:23.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c1c95fe520 con 0x55c1c9827d90 2024-04-24T23:00:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c1c9611340 con 0x55c1c9826c30 2024-04-24T23:00:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 10 client.0 _ll_register_callbacks cb 0x55c1c97e15c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:00:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3988dc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826310 0x55c1c98214f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3988dc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826310 0x55c1c98214f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57200/0 (socket says 172.21.15.43:57200) 2024-04-24T23:00:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3988dc640 1 -- 172.21.15.43:0/1006779870 learned_addr learned my addr 172.21.15.43:0/1006779870 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3988dc640 1 -- 172.21.15.43:0/1006779870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9826c30 msgr2=0x55c1c9800a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3988dc640 1 --2- 172.21.15.43:0/1006779870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9826c30 0x55c1c9800a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3988dc640 1 -- 172.21.15.43:0/1006779870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9827d90 msgr2=0x55c1c9800fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3990dd640 1 --2- 172.21.15.43:0/1006779870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9827d90 0x55c1c9800fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3988dc640 1 --2- 172.21.15.43:0/1006779870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9827d90 0x55c1c9800fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3988dc640 1 -- 172.21.15.43:0/1006779870 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1c95dc7b0 con 0x55c1c9826310 2024-04-24T23:00:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3988dc640 1 --2- 172.21.15.43:0/1006779870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826310 0x55c1c98214f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd3880045f0 tx=0x7fd3880046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbdfaf450570eee server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3737fe640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-24T23:00:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3737fe640 1 -- 172.21.15.43:0/1006779870 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388026070 con 0x55c1c9826310 2024-04-24T23:00:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 -- 172.21.15.43:0/1006779870 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd38c013600 con 0x55c1c9826310 2024-04-24T23:00:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3737fe640 1 -- 172.21.15.43:0/1006779870 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd388014440 con 0x55c1c9826310 2024-04-24T23:00:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3737fe640 1 -- 172.21.15.43:0/1006779870 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fd388031050 con 0x55c1c9826310 2024-04-24T23:00:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 10 client.4389 fetch_fsmap learned FSMap version 7 2024-04-24T23:00:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 -- 172.21.15.43:0/1006779870 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55c1c95cbea0 con 0x55c1c9826310 2024-04-24T23:00:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3737fe640 1 -- 172.21.15.43:0/1006779870 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38c013600 con 0x55c1c9826310 2024-04-24T23:00:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3737fe640 1 -- 172.21.15.43:0/1006779870 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 7) ==== 2292+0+0 (secure 0 0 0) 0x7fd388034020 con 0x55c1c9826310 2024-04-24T23:00:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 10 client.4389 fetch_fsmap finished waiting for FSMap version 7 2024-04-24T23:00:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 10 client.4389 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T23:00:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 20 client.4389 populate_metadata read hostname 'smithi043' 2024-04-24T23:00:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/1006779870 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x55c1c98019e0 0x55c1c9801dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 4 client.4389 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:00:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 -- 172.21.15.43:0/1006779870 --> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1c95dfab0 con 0x55c1c98019e0 2024-04-24T23:00:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd393fff640 1 --2- 172.21.15.43:0/1006779870 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x55c1c98019e0 0x55c1c9801dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3737fe640 10 client.4389 ms_handle_connect on v2:172.21.15.43:6834/152091432 2024-04-24T23:00:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd393fff640 1 --2- 172.21.15.43:0/1006779870 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x55c1c98019e0 0x55c1c9801dc0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=776d9b379c1e074a server_cookie=1f775bb72c6fcb79 in_seq=0 out_seq=0 2024-04-24T23:00:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3737fe640 1 -- 172.21.15.43:0/1006779870 <== mds.0 v2:172.21.15.43:6834/152091432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c1c95dfab0 con 0x55c1c98019e0 2024-04-24T23:00:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3737fe640 10 client.4389 handle_command_reply: tid=0 2024-04-24T23:00:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 client.4389 shutdown 2024-04-24T23:00:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 -- 172.21.15.43:0/1006779870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826310 msgr2=0x55c1c98214f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/1006779870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826310 0x55c1c98214f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd3880045f0 tx=0x7fd3880046d0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 -- 172.21.15.43:0/1006779870 shutdown_connections 2024-04-24T23:00:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/1006779870 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x55c1c98019e0 0x55c1c9801dc0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/1006779870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9827d90 0x55c1c9800fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd3737fe640 0 client.4389 ms_handle_reset on v2:172.21.15.43:6834/152091432 2024-04-24T23:00:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/1006779870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9826c30 0x55c1c9800a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/1006779870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826310 0x55c1c98214f0 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd3880045f0 tx=0x7fd3880046d0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 -- 172.21.15.43:0/1006779870 >> 172.21.15.43:0/1006779870 conn(0x55c1c98220c0 msgr2=0x55c1c98244b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:23.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 -- 172.21.15.43:0/1006779870 shutdown_connections 2024-04-24T23:00:23.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 1 -- 172.21.15.43:0/1006779870 wait complete. 2024-04-24T23:00:23.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.520+0000 7fd39dcb9000 20 client.4389 trim_cache size 0 max 16384 2024-04-24T23:00:23.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 Processor -- start 2024-04-24T23:00:23.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 -- start start 2024-04-24T23:00:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9846800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9827d90 0x55c1c9820ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9821400 0x55c1c9824fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd3941e9ec0 con 0x55c1c9826c30 2024-04-24T23:00:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd3940ab110 con 0x55c1c9821400 2024-04-24T23:00:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c1c96438f0 con 0x55c1c9827d90 2024-04-24T23:00:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd3988dc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9846800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd3988dc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9846800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57210/0 (socket says 172.21.15.43:57210) 2024-04-24T23:00:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd3988dc640 1 -- 172.21.15.43:0/1110660793 learned_addr learned my addr 172.21.15.43:0/1110660793 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd3988dc640 1 -- 172.21.15.43:0/1110660793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9827d90 msgr2=0x55c1c9820ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd3988dc640 1 --2- 172.21.15.43:0/1110660793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9827d90 0x55c1c9820ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd3988dc640 1 -- 172.21.15.43:0/1110660793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9821400 msgr2=0x55c1c9824fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd3988dc640 1 --2- 172.21.15.43:0/1110660793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9821400 0x55c1c9824fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd3988dc640 1 -- 172.21.15.43:0/1110660793 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1c95cce80 con 0x55c1c9826c30 2024-04-24T23:00:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd3988dc640 1 --2- 172.21.15.43:0/1110660793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9846800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd388011730 tx=0x7fd38801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06f8d9695b5b32c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd379ffb640 1 -- 172.21.15.43:0/1110660793 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388026070 con 0x55c1c9826c30 2024-04-24T23:00:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd379ffb640 1 -- 172.21.15.43:0/1110660793 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38801b030 con 0x55c1c9826c30 2024-04-24T23:00:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd379ffb640 1 -- 172.21.15.43:0/1110660793 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38802b790 con 0x55c1c9826c30 2024-04-24T23:00:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 -- 172.21.15.43:0/1110660793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 msgr2=0x55c1c9846800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/1110660793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9846800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd388011730 tx=0x7fd38801d000 comp rx=0 tx=0).stop 2024-04-24T23:00:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 -- 172.21.15.43:0/1110660793 shutdown_connections 2024-04-24T23:00:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/1110660793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9821400 0x55c1c9824fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/1110660793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9827d90 0x55c1c9820ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/1110660793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9846800 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 -- 172.21.15.43:0/1110660793 >> 172.21.15.43:0/1110660793 conn(0x55c1c98220c0 msgr2=0x55c1c983caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:23.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 -- 172.21.15.43:0/1110660793 shutdown_connections 2024-04-24T23:00:23.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 -- 172.21.15.43:0/1110660793 wait complete. 2024-04-24T23:00:23.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 -- start start 2024-04-24T23:00:23.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.540+0000 7fd39dcb9000 1 Processor -- start 2024-04-24T23:00:23.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9821400 0x55c1c98467f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9842f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9827d90 0x55c1c98434a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c1c95ea810 con 0x55c1c9826c30 2024-04-24T23:00:23.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c1c9648c10 con 0x55c1c9821400 2024-04-24T23:00:23.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55c1c95fe520 con 0x55c1c9827d90 2024-04-24T23:00:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 10 client.0 _ll_register_callbacks cb 0x7fd388004270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:00:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd393fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9842f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd393fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9842f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57214/0 (socket says 172.21.15.43:57214) 2024-04-24T23:00:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd393fff640 1 -- 172.21.15.43:0/3936220406 learned_addr learned my addr 172.21.15.43:0/3936220406 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd393fff640 1 -- 172.21.15.43:0/3936220406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9827d90 msgr2=0x55c1c98434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd3988dc640 1 --2- 172.21.15.43:0/3936220406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9821400 0x55c1c98467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd3990dd640 1 --2- 172.21.15.43:0/3936220406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9827d90 0x55c1c98434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd393fff640 1 --2- 172.21.15.43:0/3936220406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9827d90 0x55c1c98434a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd393fff640 1 -- 172.21.15.43:0/3936220406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9821400 msgr2=0x55c1c98467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd393fff640 1 --2- 172.21.15.43:0/3936220406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9821400 0x55c1c98467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd393fff640 1 -- 172.21.15.43:0/3936220406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1c9611760 con 0x55c1c9826c30 2024-04-24T23:00:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd3988dc640 1 --2- 172.21.15.43:0/3936220406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9821400 0x55c1c98467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd393fff640 1 --2- 172.21.15.43:0/3936220406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9842f60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd38401c8f0 tx=0x7fd3840ab400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392d873353592d56 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd3737fe640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-24T23:00:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd3737fe640 1 -- 172.21.15.43:0/3936220406 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3840f3e30 con 0x55c1c9826c30 2024-04-24T23:00:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd3737fe640 1 -- 172.21.15.43:0/3936220406 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd384117150 con 0x55c1c9826c30 2024-04-24T23:00:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 -- 172.21.15.43:0/3936220406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd38801b030 con 0x55c1c9826c30 2024-04-24T23:00:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd3737fe640 1 -- 172.21.15.43:0/3936220406 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fd3840f8660 con 0x55c1c9826c30 2024-04-24T23:00:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 10 client.4395 fetch_fsmap learned FSMap version 7 2024-04-24T23:00:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 -- 172.21.15.43:0/3936220406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55c1c969d9e0 con 0x55c1c9826c30 2024-04-24T23:00:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd3737fe640 1 -- 172.21.15.43:0/3936220406 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38801b030 con 0x55c1c9826c30 2024-04-24T23:00:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd3737fe640 1 -- 172.21.15.43:0/3936220406 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 7) ==== 2292+0+0 (secure 0 0 0) 0x7fd384107ce0 con 0x55c1c9826c30 2024-04-24T23:00:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 10 client.4395 fetch_fsmap finished waiting for FSMap version 7 2024-04-24T23:00:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 10 client.4395 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T23:00:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 20 client.4395 populate_metadata read hostname 'smithi043' 2024-04-24T23:00:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/3936220406 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x55c1c98439e0 0x55c1c9843dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 4 client.4395 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:00:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 -- 172.21.15.43:0/3936220406 --> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] -- command(tid 0: {"prefix": "status"}) -- 0x55c1c9651b20 con 0x55c1c98439e0 2024-04-24T23:00:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd3988dc640 1 --2- 172.21.15.43:0/3936220406 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x55c1c98439e0 0x55c1c9843dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd3737fe640 10 client.4395 ms_handle_connect on v2:172.21.15.43:6834/152091432 2024-04-24T23:00:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd3988dc640 1 --2- 172.21.15.43:0/3936220406 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x55c1c98439e0 0x55c1c9843dc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9971a4d2023383a4 server_cookie=861b0ae09a645b7f in_seq=0 out_seq=0 2024-04-24T23:00:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd3737fe640 1 -- 172.21.15.43:0/3936220406 <== mds.0 v2:172.21.15.43:6834/152091432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55c1c9651b20 con 0x55c1c98439e0 2024-04-24T23:00:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd3737fe640 10 client.4395 handle_command_reply: tid=0 2024-04-24T23:00:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 client.4395 shutdown 2024-04-24T23:00:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 -- 172.21.15.43:0/3936220406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 msgr2=0x55c1c9842f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/3936220406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9842f60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd38401c8f0 tx=0x7fd3840ab400 comp rx=0 tx=0).stop 2024-04-24T23:00:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 -- 172.21.15.43:0/3936220406 shutdown_connections 2024-04-24T23:00:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/3936220406 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x55c1c98439e0 0x55c1c9843dc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/3936220406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55c1c9827d90 0x55c1c98434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/3936220406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1c9826c30 0x55c1c9842f60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 --2- 172.21.15.43:0/3936220406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1c9821400 0x55c1c98467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 -- 172.21.15.43:0/3936220406 >> 172.21.15.43:0/3936220406 conn(0x55c1c98220c0 msgr2=0x55c1c97fae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:23.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd3737fe640 0 client.4395 ms_handle_reset on v2:172.21.15.43:6834/152091432 2024-04-24T23:00:23.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 -- 172.21.15.43:0/3936220406 shutdown_connections 2024-04-24T23:00:23.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 1 -- 172.21.15.43:0/3936220406 wait complete. 2024-04-24T23:00:23.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39dcb9000 20 client.4395 trim_cache size 0 max 16384 2024-04-24T23:00:23.556 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-24T23:00:23.556 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "97891efb-e5ff-41f6-b724-29d534e60717", 2024-04-24T23:00:23.556 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-04-24T23:00:23.557 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4248, 2024-04-24T23:00:23.557 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-24T23:00:23.557 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-24T23:00:23.557 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-24T23:00:23.557 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 7.1258420720000002, 2024-04-24T23:00:23.557 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 7, 2024-04-24T23:00:23.557 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 25, 2024-04-24T23:00:23.557 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 25, 2024-04-24T23:00:23.557 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 13.926451651000001 2024-04-24T23:00:23.557 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-24T23:00:23.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39ab40640 1 -- 172.21.15.43:0/4027797549 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd3800678c0 msgr2=0x7fd380069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39ab40640 1 --2- 172.21.15.43:0/4027797549 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd3800678c0 0x7fd380069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd388009580 tx=0x7fd388009190 comp rx=0 tx=0).stop 2024-04-24T23:00:23.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39ab40640 1 -- 172.21.15.43:0/4027797549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3940733a0 msgr2=0x7fd3940b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39ab40640 1 --2- 172.21.15.43:0/4027797549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3940733a0 0x7fd3940b3e50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd38401a040 tx=0x7fd3840191b0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39ab40640 1 -- 172.21.15.43:0/4027797549 shutdown_connections 2024-04-24T23:00:23.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39ab40640 1 --2- 172.21.15.43:0/4027797549 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd3800678c0 0x7fd380069d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39ab40640 1 --2- 172.21.15.43:0/4027797549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3940b37f0 0x7fd394140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39ab40640 1 --2- 172.21.15.43:0/4027797549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3940733a0 0x7fd3940b3e50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39ab40640 1 --2- 172.21.15.43:0/4027797549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd394072d60 0x7fd3940ad5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39ab40640 1 -- 172.21.15.43:0/4027797549 >> 172.21.15.43:0/4027797549 conn(0x7fd3940b5690 msgr2=0x7fd394142c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:23.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39ab40640 1 -- 172.21.15.43:0/4027797549 shutdown_connections 2024-04-24T23:00:23.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.544+0000 7fd39ab40640 1 -- 172.21.15.43:0/4027797549 wait complete. 2024-04-24T23:00:23.566 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-24T23:00:23.566 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:23.566 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:00:23.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.672+0000 7fd55c470640 1 Processor -- start 2024-04-24T23:00:23.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.672+0000 7fd55c470640 1 -- start start 2024-04-24T23:00:23.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.672+0000 7fd55c470640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd5540b2500 0x7fd554145450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.672+0000 7fd55c470640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd554145990 0x7fd55413f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.672+0000 7fd55c470640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd55413f730 0x7fd5541489c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.672+0000 7fd55c470640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fd554070060 con 0x7fd554145990 2024-04-24T23:00:23.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.672+0000 7fd55c470640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd5540b28e0 con 0x7fd5540b2500 2024-04-24T23:00:23.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.672+0000 7fd55c470640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd5540af8f0 con 0x7fd55413f730 2024-04-24T23:00:23.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.672+0000 7fd559a0b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd554145990 0x7fd55413f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.672+0000 7fd559a0b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd554145990 0x7fd55413f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57228/0 (socket says 172.21.15.43:57228) 2024-04-24T23:00:23.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.672+0000 7fd559a0b640 1 -- 172.21.15.43:0/4024543642 learned_addr learned my addr 172.21.15.43:0/4024543642 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:23.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.672+0000 7fd55aa0d640 1 --2- 172.21.15.43:0/4024543642 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd55413f730 0x7fd5541489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.672+0000 7fd55a20c640 1 --2- 172.21.15.43:0/4024543642 >> v2:172.21.15.162:3300/0 conn(0x7fd5540b2500 0x7fd554145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd559a0b640 1 -- 172.21.15.43:0/4024543642 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd55413f730 msgr2=0x7fd5541489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd559a0b640 1 --2- 172.21.15.43:0/4024543642 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd55413f730 0x7fd5541489c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd559a0b640 1 -- 172.21.15.43:0/4024543642 >> v2:172.21.15.162:3300/0 conn(0x7fd5540b2500 msgr2=0x7fd554145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd559a0b640 1 --2- 172.21.15.43:0/4024543642 >> v2:172.21.15.162:3300/0 conn(0x7fd5540b2500 0x7fd554145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd559a0b640 1 -- 172.21.15.43:0/4024543642 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55406fb40 con 0x7fd554145990 2024-04-24T23:00:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd55a20c640 1 --2- 172.21.15.43:0/4024543642 >> v2:172.21.15.162:3300/0 conn(0x7fd5540b2500 0x7fd554145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:23.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd559a0b640 1 --2- 172.21.15.43:0/4024543642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd554145990 0x7fd55413f1f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd554075020 tx=0x7fd54401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8e2929d42a2e33 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd55920a640 1 -- 172.21.15.43:0/4024543642 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5440b0070 con 0x7fd554145990 2024-04-24T23:00:23.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd55920a640 1 -- 172.21.15.43:0/4024543642 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5440ab600 con 0x7fd554145990 2024-04-24T23:00:23.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd55920a640 1 -- 172.21.15.43:0/4024543642 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5540b63c0 con 0x7fd554145990 2024-04-24T23:00:23.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd55c470640 1 -- 172.21.15.43:0/4024543642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd554145990 msgr2=0x7fd55413f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd55c470640 1 --2- 172.21.15.43:0/4024543642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd554145990 0x7fd55413f1f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd554075020 tx=0x7fd54401c260 comp rx=0 tx=0).stop 2024-04-24T23:00:23.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd55c470640 1 -- 172.21.15.43:0/4024543642 shutdown_connections 2024-04-24T23:00:23.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd55c470640 1 --2- 172.21.15.43:0/4024543642 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd55413f730 0x7fd5541489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd55c470640 1 --2- 172.21.15.43:0/4024543642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd554145990 0x7fd55413f1f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd55c470640 1 --2- 172.21.15.43:0/4024543642 >> v2:172.21.15.162:3300/0 conn(0x7fd5540b2500 0x7fd554145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd55c470640 1 -- 172.21.15.43:0/4024543642 >> 172.21.15.43:0/4024543642 conn(0x7fd5540b5690 msgr2=0x7fd5540b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:23.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd55c470640 1 -- 172.21.15.43:0/4024543642 shutdown_connections 2024-04-24T23:00:23.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.676+0000 7fd55c470640 1 -- 172.21.15.43:0/4024543642 wait complete. 2024-04-24T23:00:23.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55c470640 1 Processor -- start 2024-04-24T23:00:23.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55c470640 1 -- start start 2024-04-24T23:00:23.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55c470640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5540b2500 0x7fd5541ddf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55c470640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd55413f730 0x7fd554138f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55c470640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd554145990 0x7fd5541394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55c470640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd5540b4c70 con 0x7fd554145990 2024-04-24T23:00:23.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55c470640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd5540b4af0 con 0x7fd5540b2500 2024-04-24T23:00:23.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55c470640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd554151d00 con 0x7fd55413f730 2024-04-24T23:00:23.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55aa0d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd554145990 0x7fd5541394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55aa0d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd554145990 0x7fd5541394b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57238/0 (socket says 172.21.15.43:57238) 2024-04-24T23:00:23.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55aa0d640 1 -- 172.21.15.43:0/74230989 learned_addr learned my addr 172.21.15.43:0/74230989 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:23.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd559a0b640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd55413f730 0x7fd554138f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55a20c640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5540b2500 0x7fd5541ddf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55aa0d640 1 -- 172.21.15.43:0/74230989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd55413f730 msgr2=0x7fd554138f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55aa0d640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd55413f730 0x7fd554138f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55aa0d640 1 -- 172.21.15.43:0/74230989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5540b2500 msgr2=0x7fd5541ddf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55aa0d640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5540b2500 0x7fd5541ddf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55aa0d640 1 -- 172.21.15.43:0/74230989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55413b760 con 0x7fd554145990 2024-04-24T23:00:23.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55a20c640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5540b2500 0x7fd5541ddf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:23.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd559a0b640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd55413f730 0x7fd554138f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:23.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55aa0d640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd554145990 0x7fd5541394b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00efc0 tx=0x7fd54c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd54affd640 1 -- 172.21.15.43:0/74230989 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c018020 con 0x7fd554145990 2024-04-24T23:00:23.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd54affd640 1 -- 172.21.15.43:0/74230989 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd54c014480 con 0x7fd554145990 2024-04-24T23:00:23.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd54affd640 1 -- 172.21.15.43:0/74230989 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c014870 con 0x7fd554145990 2024-04-24T23:00:23.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55c470640 1 -- 172.21.15.43:0/74230989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd554144100 con 0x7fd554145990 2024-04-24T23:00:23.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.680+0000 7fd55c470640 1 -- 172.21.15.43:0/74230989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd55413a790 con 0x7fd554145990 2024-04-24T23:00:23.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.684+0000 7fd55c470640 1 -- 172.21.15.43:0/74230989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd55404f580 con 0x7fd554145990 2024-04-24T23:00:23.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.684+0000 7fd54affd640 1 -- 172.21.15.43:0/74230989 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd54c01b020 con 0x7fd554145990 2024-04-24T23:00:23.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.684+0000 7fd54affd640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd5380678c0 0x7fd538069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:23.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.684+0000 7fd55a20c640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd5380678c0 0x7fd538069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:23.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.684+0000 7fd54affd640 1 -- 172.21.15.43:0/74230989 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd54c086960 con 0x7fd554145990 2024-04-24T23:00:23.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.684+0000 7fd55a20c640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd5380678c0 0x7fd538069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd5500097a0 tx=0x7fd550008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:23.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.688+0000 7fd54affd640 1 -- 172.21.15.43:0/74230989 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd54c022070 con 0x7fd554145990 2024-04-24T23:00:23.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.876+0000 7fd55c470640 1 -- 172.21.15.43:0/74230989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd55413a9d0 con 0x7fd554145990 2024-04-24T23:00:23.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.876+0000 7fd54affd640 1 -- 172.21.15.43:0/74230989 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7fd54c010040 con 0x7fd554145990 2024-04-24T23:00:23.882 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-24T23:00:23.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.880+0000 7fd55c470640 1 -- 172.21.15.43:0/74230989 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd5380678c0 msgr2=0x7fd538069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.880+0000 7fd55c470640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd5380678c0 0x7fd538069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd5500097a0 tx=0x7fd550008040 comp rx=0 tx=0).stop 2024-04-24T23:00:23.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.880+0000 7fd55c470640 1 -- 172.21.15.43:0/74230989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd554145990 msgr2=0x7fd5541394b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:23.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.880+0000 7fd55c470640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd554145990 0x7fd5541394b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00efc0 tx=0x7fd54c00c490 comp rx=0 tx=0).stop 2024-04-24T23:00:23.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.880+0000 7fd55c470640 1 -- 172.21.15.43:0/74230989 shutdown_connections 2024-04-24T23:00:23.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.880+0000 7fd55c470640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd5380678c0 0x7fd538069d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.880+0000 7fd55c470640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd554145990 0x7fd5541394b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.880+0000 7fd55c470640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd55413f730 0x7fd554138f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.880+0000 7fd55c470640 1 --2- 172.21.15.43:0/74230989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5540b2500 0x7fd5541ddf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:23.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.880+0000 7fd55c470640 1 -- 172.21.15.43:0/74230989 >> 172.21.15.43:0/74230989 conn(0x7fd5540b5690 msgr2=0x7fd554139ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:23.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.880+0000 7fd55c470640 1 -- 172.21.15.43:0/74230989 shutdown_connections 2024-04-24T23:00:23.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23.880+0000 7fd55c470640 1 -- 172.21.15.43:0/74230989 wait complete. 2024-04-24T23:00:23.900 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-24T23:00:23.900 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:00:23.900 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-04-24T23:00:23.900 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-24T23:00:23.900 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:23.900 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-24T23:00:23.900 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T23:00:23.900 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:00:23.900 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-24T23:00:23.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:23.901 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-04-24T23:00:23.906 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:00:23.906 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:00:23.906 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:00:23.906 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:23.906 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-04-24T23:00:23.906 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:23.906 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T23:00:23.906 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:23.906 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-04-24T23:00:23.906 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T23:00:23.906 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:23.906 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-04-24T23:00:23.907 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:00:23.907 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:23.907 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-04-24T23:00:23.907 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-24T23:00:23.907 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42489sec preferred_lft 42489sec 2024-04-24T23:00:23.907 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link 2024-04-24T23:00:23.907 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:23.907 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T23:00:23.907 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:23.907 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-04-24T23:00:23.907 INFO:teuthology.orchestra.run.smithi043.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-24T23:00:23.907 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 02:42:3d:31:53:9e brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:23.907 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-24T23:00:23.907 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:23.908 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-24T23:00:23.908 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:23.908 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-24T23:00:23.908 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2024-04-24T23:00:23.908 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2024-04-24T23:00:23.908 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2024-04-24T23:00:23.908 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-24T23:00:23.909 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-24T23:00:23.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:24.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:24.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:24.032 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:00:24.083 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-04-24T23:00:24.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:24.084 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-04-24T23:00:24.145 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-04-24T23:00:24.145 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:00:24.145 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-24T23:00:24.145 INFO:teuthology.orchestra.run.smithi043.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-24T23:00:24.145 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-24T23:00:24.145 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:00:24.146 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:24.146 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-24T23:00:24.146 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-24T23:00:24.146 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-24T23:00:24.146 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-24T23:00:24.146 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-24T23:00:24.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:24.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:24.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:24.270 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-24T23:00:24.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:24.277 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-04-24T23:00:24.324 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:24.324 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-24T23:00:24.324 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:24.324 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-24T23:00:24.324 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-24T23:00:24.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:24.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:24.445 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-24T23:00:24.445 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:24.445 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-24T23:00:24.445 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-24T23:00:24.446 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-24T23:00:24.446 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-24T23:00:24.446 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-24T23:00:24.446 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-24T23:00:24.446 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-24T23:00:24.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:24.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:24.552 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:24.552 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-24T23:00:24.553 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-04-24T23:00:24.553 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2024-04-24T23:00:24.553 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-24T23:00:24.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:24.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:24.661 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-24T23:00:24.661 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:00:24.661 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:24.707 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-24T23:00:24.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:00:24.707 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:24.755 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-04-24T23:00:24.813 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:00:24.860 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-04-24T23:00:24.860 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-04-24T23:00:24.860 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-04-24T23:00:24.860 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-04-24T23:00:24.860 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-04-24T23:00:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-04-24T23:00:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-04-24T23:00:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-04-24T23:00:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:/run/lock 2024-04-24T23:00:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-04-24T23:00:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-04-24T23:00:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-04-24T23:00:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:00:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-04-24T23:00:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-04-24T23:00:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-04-24T23:00:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-04-24T23:00:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/fs/nfsd 2024-04-24T23:00:24.861 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-04-24T23:00:24.862 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-04-24T23:00:24.862 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T23:00:24.862 INFO:teuthology.orchestra.run.smithi043.stdout:/run/rpc_pipefs 2024-04-24T23:00:24.862 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-04-24T23:00:24.862 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-04-24T23:00:24.862 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-0 2024-04-24T23:00:24.862 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-1 2024-04-24T23:00:24.862 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-2 2024-04-24T23:00:24.862 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-3 2024-04-24T23:00:24.863 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-04-24T23:00:24.863 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:24.863 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:24.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:24.864 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-04-24T23:00:24.912 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-24T23:00:24.912 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-24T23:00:24.956 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-04-24T23:00:24.972 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:00:25.019 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-04-24T23:00:25.019 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-04-24T23:00:25.020 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-04-24T23:00:25.020 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-04-24T23:00:25.020 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-04-24T23:00:25.020 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-04-24T23:00:25.020 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-04-24T23:00:25.020 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-04-24T23:00:25.020 INFO:teuthology.orchestra.run.smithi043.stdout:/run/lock 2024-04-24T23:00:25.020 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-04-24T23:00:25.020 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-04-24T23:00:25.020 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-04-24T23:00:25.020 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:00:25.020 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-04-24T23:00:25.020 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-04-24T23:00:25.020 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-04-24T23:00:25.021 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-04-24T23:00:25.021 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/fs/nfsd 2024-04-24T23:00:25.021 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-04-24T23:00:25.021 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-04-24T23:00:25.021 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T23:00:25.021 INFO:teuthology.orchestra.run.smithi043.stdout:/run/rpc_pipefs 2024-04-24T23:00:25.021 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-04-24T23:00:25.021 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-04-24T23:00:25.021 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-0 2024-04-24T23:00:25.021 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-1 2024-04-24T23:00:25.021 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-2 2024-04-24T23:00:25.021 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-3 2024-04-24T23:00:25.021 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-04-24T23:00:25.021 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:25.022 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:25.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:25.022 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-04-24T23:00:25.042 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:2024-04-24T23:00:25.036+0000 7fe83b1c1580 -1 init, newargv = 0x55d0069666c0 newargc=15 2024-04-24T23:00:25.043 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:ceph-fuse[32099]: starting ceph client 2024-04-24T23:00:25.050 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:ceph-fuse[32099]: starting fuse 2024-04-24T23:00:26.147 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-04-24T23:00:26.165 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:00:26.214 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-04-24T23:00:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-04-24T23:00:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-04-24T23:00:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-04-24T23:00:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-04-24T23:00:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-04-24T23:00:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-04-24T23:00:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-04-24T23:00:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:/run/lock 2024-04-24T23:00:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-04-24T23:00:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-04-24T23:00:26.216 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-04-24T23:00:26.216 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:00:26.216 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-04-24T23:00:26.216 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-04-24T23:00:26.216 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-04-24T23:00:26.216 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-04-24T23:00:26.216 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/fs/nfsd 2024-04-24T23:00:26.216 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-04-24T23:00:26.216 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-04-24T23:00:26.216 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T23:00:26.216 INFO:teuthology.orchestra.run.smithi043.stdout:/run/rpc_pipefs 2024-04-24T23:00:26.216 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-04-24T23:00:26.216 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-04-24T23:00:26.216 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-0 2024-04-24T23:00:26.217 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-1 2024-04-24T23:00:26.217 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-2 2024-04-24T23:00:26.217 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-3 2024-04-24T23:00:26.217 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-04-24T23:00:26.217 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:26.217 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:26.217 INFO:teuthology.orchestra.run.smithi043.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:26.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:26.218 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-04-24T23:00:26.268 INFO:teuthology.orchestra.run.smithi043.stdout:45 2024-04-24T23:00:26.268 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-24T23:00:26.269 DEBUG:teuthology.orchestra.run.smithi043:> sudo stdin-killer -- python3 -c ' 2024-04-24T23:00:26.269 DEBUG:teuthology.orchestra.run.smithi043:> import glob 2024-04-24T23:00:26.269 DEBUG:teuthology.orchestra.run.smithi043:> import re 2024-04-24T23:00:26.269 DEBUG:teuthology.orchestra.run.smithi043:> import os 2024-04-24T23:00:26.269 DEBUG:teuthology.orchestra.run.smithi043:> import subprocess 2024-04-24T23:00:26.270 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-24T23:00:26.270 DEBUG:teuthology.orchestra.run.smithi043:> def _find_admin_socket(client_name): 2024-04-24T23:00:26.270 DEBUG:teuthology.orchestra.run.smithi043:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-24T23:00:26.270 DEBUG:teuthology.orchestra.run.smithi043:> files = glob.glob(asok_path) 2024-04-24T23:00:26.270 DEBUG:teuthology.orchestra.run.smithi043:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-24T23:00:26.270 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-24T23:00:26.271 DEBUG:teuthology.orchestra.run.smithi043:> # Given a non-glob path, it better be there 2024-04-24T23:00:26.271 DEBUG:teuthology.orchestra.run.smithi043:> if "*" not in asok_path: 2024-04-24T23:00:26.271 DEBUG:teuthology.orchestra.run.smithi043:> assert(len(files) == 1) 2024-04-24T23:00:26.271 DEBUG:teuthology.orchestra.run.smithi043:> return files[0] 2024-04-24T23:00:26.271 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-24T23:00:26.271 DEBUG:teuthology.orchestra.run.smithi043:> for f in files: 2024-04-24T23:00:26.271 DEBUG:teuthology.orchestra.run.smithi043:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-24T23:00:26.271 DEBUG:teuthology.orchestra.run.smithi043:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-24T23:00:26.272 DEBUG:teuthology.orchestra.run.smithi043:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-24T23:00:26.272 DEBUG:teuthology.orchestra.run.smithi043:> contents = proc_f.read() 2024-04-24T23:00:26.272 DEBUG:teuthology.orchestra.run.smithi043:> if mountpoint in contents: 2024-04-24T23:00:26.272 DEBUG:teuthology.orchestra.run.smithi043:> return f 2024-04-24T23:00:26.272 DEBUG:teuthology.orchestra.run.smithi043:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-24T23:00:26.272 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-24T23:00:26.272 DEBUG:teuthology.orchestra.run.smithi043:> print(_find_admin_socket("client.admin")) 2024-04-24T23:00:26.272 DEBUG:teuthology.orchestra.run.smithi043:> ' 2024-04-24T23:00:26.399 INFO:teuthology.orchestra.run.smithi043.stdout:/var/run/ceph/ceph-client.admin.32099.asok 2024-04-24T23:00:26.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:26.412 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32099.asok 2024-04-24T23:00:26.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:26.412 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32099.asok status 2024-04-24T23:00:26.566 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-24T23:00:26.566 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": { 2024-04-24T23:00:26.566 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_sha1": "d2c45d977142e024a59b68a8f1dce8f0b9840551", 2024-04-24T23:00:26.566 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_version": "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)", 2024-04-24T23:00:26.567 INFO:teuthology.orchestra.run.smithi043.stdout: "entity_id": "admin", 2024-04-24T23:00:26.567 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": "smithi043", 2024-04-24T23:00:26.567 INFO:teuthology.orchestra.run.smithi043.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-24T23:00:26.567 INFO:teuthology.orchestra.run.smithi043.stdout: "pid": "32099", 2024-04-24T23:00:26.567 INFO:teuthology.orchestra.run.smithi043.stdout: "root": "/" 2024-04-24T23:00:26.567 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:00:26.567 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_count": 0, 2024-04-24T23:00:26.567 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_pinned_count": 0, 2024-04-24T23:00:26.567 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4410, 2024-04-24T23:00:26.567 INFO:teuthology.orchestra.run.smithi043.stdout: "inst": { 2024-04-24T23:00:26.567 INFO:teuthology.orchestra.run.smithi043.stdout: "name": { 2024-04-24T23:00:26.567 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "client", 2024-04-24T23:00:26.567 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 4410 2024-04-24T23:00:26.567 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2122387508 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2122387508 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi043.stdout: "inst_str": "client.4410 192.168.0.1:0/2122387508", 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi043.stdout: "addr_str": "192.168.0.1:0/2122387508", 2024-04-24T23:00:26.568 INFO:teuthology.orchestra.run.smithi043.stdout: "inode_count": 1, 2024-04-24T23:00:26.569 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_epoch": 7, 2024-04-24T23:00:26.569 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch": 25, 2024-04-24T23:00:26.569 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch_barrier": 0, 2024-04-24T23:00:26.569 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklisted": false, 2024-04-24T23:00:26.569 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs" 2024-04-24T23:00:26.569 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-24T23:00:26.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:26.582 DEBUG:teuthology.orchestra.run.smithi043:> stat --file-system '--printf=%T 2024-04-24T23:00:26.582 DEBUG:teuthology.orchestra.run.smithi043:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:26.589 INFO:teuthology.orchestra.run.smithi043.stdout:fuseblk 2024-04-24T23:00:26.589 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:26.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:26.589 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:26.642 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-24T23:00:26.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-24T23:00:26.761 INFO:teuthology.orchestra.run.smithi043.stdout:# file: . 2024-04-24T23:00:26.761 INFO:teuthology.orchestra.run.smithi043.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-24T23:00:26.761 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:26.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:26.769 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T23:00:26.769 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:00:26.815 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:26.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.983+0000 7f9d2251c640 1 Processor -- start 2024-04-24T23:00:26.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.983+0000 7f9d2251c640 1 -- start start 2024-04-24T23:00:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.987+0000 7f9d2251c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9d1c072e00 0x7f9d1c148050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.987+0000 7f9d2251c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d1c09ee70 0x7f9d1c09f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.987+0000 7f9d2251c640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d1c148590 con 0x7f9d1c09fc50 2024-04-24T23:00:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.987+0000 7f9d2251c640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f9d1c14bb00 con 0x7f9d1c072e00 2024-04-24T23:00:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.987+0000 7f9d2251c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9d1c0731e0 con 0x7f9d1c09ee70 2024-04-24T23:00:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.987+0000 7f9d1bfff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9d1c072e00 0x7f9d1c148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.987+0000 7f9d1bfff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9d1c072e00 0x7f9d1c148050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57246/0 (socket says 172.21.15.43:57246) 2024-04-24T23:00:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.987+0000 7f9d1bfff640 1 -- 172.21.15.43:0/3737819073 learned_addr learned my addr 172.21.15.43:0/3737819073 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.987+0000 7f9d1b7fe640 1 --2- 172.21.15.43:0/3737819073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d1c09ee70 0x7f9d1c09f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.987+0000 7f9d1bfff640 1 -- 172.21.15.43:0/3737819073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d1c09ee70 msgr2=0x7f9d1c09f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:26.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.987+0000 7f9d1bfff640 1 --2- 172.21.15.43:0/3737819073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d1c09ee70 0x7f9d1c09f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.987+0000 7f9d1bfff640 1 -- 172.21.15.43:0/3737819073 >> v1:172.21.15.43:6789/0 conn(0x7f9d1c09fc50 legacy=0x7f9d1c14b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.987+0000 7f9d1affd640 1 -- 172.21.15.43:0/3737819073 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803008216 0 0) 0x7f9d1c148590 con 0x7f9d1c09fc50 2024-04-24T23:00:26.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.987+0000 7f9d1bfff640 1 -- 172.21.15.43:0/3737819073 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1c147850 con 0x7f9d1c072e00 2024-04-24T23:00:26.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d1bfff640 1 --2- 172.21.15.43:0/3737819073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d1c072e00 0x7f9d1c148050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009870 tx=0x7f9d0401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72cc2418a57cb694 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:26.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d1affd640 1 -- 172.21.15.43:0/3737819073 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d040b1070 con 0x7f9d1c072e00 2024-04-24T23:00:26.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d1affd640 1 -- 172.21.15.43:0/3737819073 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d040a8050 con 0x7f9d1c072e00 2024-04-24T23:00:26.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d1affd640 1 -- 172.21.15.43:0/3737819073 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d040ac860 con 0x7f9d1c072e00 2024-04-24T23:00:26.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 -- 172.21.15.43:0/3737819073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d1c072e00 msgr2=0x7f9d1c148050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:26.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 --2- 172.21.15.43:0/3737819073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d1c072e00 0x7f9d1c148050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009870 tx=0x7f9d0401c4d0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 -- 172.21.15.43:0/3737819073 shutdown_connections 2024-04-24T23:00:26.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 --2- 172.21.15.43:0/3737819073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d1c09ee70 0x7f9d1c09f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 --2- 172.21.15.43:0/3737819073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d1c072e00 0x7f9d1c148050 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:26.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 -- 172.21.15.43:0/3737819073 >> 172.21.15.43:0/3737819073 conn(0x7f9d1c0b7880 msgr2=0x7f9d1c0b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:26.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 -- 172.21.15.43:0/3737819073 shutdown_connections 2024-04-24T23:00:26.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 -- 172.21.15.43:0/3737819073 wait complete. 2024-04-24T23:00:26.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 Processor -- start 2024-04-24T23:00:26.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 -- start start 2024-04-24T23:00:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d1c072e00 0x7f9d1c0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d1c09ee70 0x7f9d1c0b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d1c09fc50 0x7f9d1c1e3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1c154880 con 0x7f9d1c09fc50 2024-04-24T23:00:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1c154700 con 0x7f9d1c09ee70 2024-04-24T23:00:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d2251c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9d1c154a00 con 0x7f9d1c072e00 2024-04-24T23:00:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d20ab9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d1c09fc50 0x7f9d1c1e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d20ab9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d1c09fc50 0x7f9d1c1e3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57258/0 (socket says 172.21.15.43:57258) 2024-04-24T23:00:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d20ab9640 1 -- 172.21.15.43:0/1346097713 learned_addr learned my addr 172.21.15.43:0/1346097713 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d1bfff640 1 --2- 172.21.15.43:0/1346097713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d1c072e00 0x7f9d1c0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d1b7fe640 1 --2- 172.21.15.43:0/1346097713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d1c09ee70 0x7f9d1c0b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d20ab9640 1 -- 172.21.15.43:0/1346097713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d1c072e00 msgr2=0x7f9d1c0b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d20ab9640 1 --2- 172.21.15.43:0/1346097713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d1c072e00 0x7f9d1c0b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d20ab9640 1 -- 172.21.15.43:0/1346097713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d1c09ee70 msgr2=0x7f9d1c0b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d20ab9640 1 --2- 172.21.15.43:0/1346097713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d1c09ee70 0x7f9d1c0b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d20ab9640 1 -- 172.21.15.43:0/1346097713 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1c0b4390 con 0x7f9d1c09fc50 2024-04-24T23:00:27.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d20ab9640 1 --2- 172.21.15.43:0/1346097713 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d1c09fc50 0x7f9d1c1e3190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00c480 tx=0x7f9d0c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.991+0000 7f9d18ff9640 1 -- 172.21.15.43:0/1346097713 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c005480 con 0x7f9d1c09fc50 2024-04-24T23:00:27.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.995+0000 7f9d18ff9640 1 -- 172.21.15.43:0/1346097713 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d0c003600 con 0x7f9d1c09fc50 2024-04-24T23:00:27.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.995+0000 7f9d18ff9640 1 -- 172.21.15.43:0/1346097713 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c0039f0 con 0x7f9d1c09fc50 2024-04-24T23:00:27.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.995+0000 7f9d2251c640 1 -- 172.21.15.43:0/1346097713 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1c0b2d00 con 0x7f9d1c09fc50 2024-04-24T23:00:27.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.995+0000 7f9d2251c640 1 -- 172.21.15.43:0/1346097713 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d1c0b17b0 con 0x7f9d1c09fc50 2024-04-24T23:00:27.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.995+0000 7f9d2251c640 1 -- 172.21.15.43:0/1346097713 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d1c04f580 con 0x7f9d1c09fc50 2024-04-24T23:00:27.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.995+0000 7f9d18ff9640 1 -- 172.21.15.43:0/1346097713 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9d0c003b90 con 0x7f9d1c09fc50 2024-04-24T23:00:27.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.995+0000 7f9d18ff9640 1 --2- 172.21.15.43:0/1346097713 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9cfc0678f0 0x7f9cfc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.995+0000 7f9d18ff9640 1 -- 172.21.15.43:0/1346097713 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9d0c085af0 con 0x7f9d1c09fc50 2024-04-24T23:00:27.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.995+0000 7f9d1bfff640 1 --2- 172.21.15.43:0/1346097713 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9cfc0678f0 0x7f9cfc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.995+0000 7f9d1bfff640 1 --2- 172.21.15.43:0/1346097713 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9cfc0678f0 0x7f9cfc069db0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9d040ae000 tx=0x7f9d040a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:26.999+0000 7f9d18ff9640 1 -- 172.21.15.43:0/1346097713 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9d0c056380 con 0x7f9d1c09fc50 2024-04-24T23:00:27.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.163+0000 7f9d2251c640 1 -- 172.21.15.43:0/1346097713 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d1c0b8000 con 0x7f9d1c09fc50 2024-04-24T23:00:27.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.167+0000 7f9d18ff9640 1 -- 172.21.15.43:0/1346097713 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18518 (secure 0 0 0) 0x7f9d0c007e20 con 0x7f9d1c09fc50 2024-04-24T23:00:27.173 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:27.173 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:20.863941+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:27.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.171+0000 7f9d2251c640 1 -- 172.21.15.43:0/1346097713 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9cfc0678f0 msgr2=0x7f9cfc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.171+0000 7f9d2251c640 1 --2- 172.21.15.43:0/1346097713 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9cfc0678f0 0x7f9cfc069db0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9d040ae000 tx=0x7f9d040a7000 comp rx=0 tx=0).stop 2024-04-24T23:00:27.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.171+0000 7f9d2251c640 1 -- 172.21.15.43:0/1346097713 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d1c09fc50 msgr2=0x7f9d1c1e3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.171+0000 7f9d2251c640 1 --2- 172.21.15.43:0/1346097713 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d1c09fc50 0x7f9d1c1e3190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00c480 tx=0x7f9d0c00c940 comp rx=0 tx=0).stop 2024-04-24T23:00:27.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.171+0000 7f9d2251c640 1 -- 172.21.15.43:0/1346097713 shutdown_connections 2024-04-24T23:00:27.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.171+0000 7f9d2251c640 1 --2- 172.21.15.43:0/1346097713 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9cfc0678f0 0x7f9cfc069db0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.171+0000 7f9d2251c640 1 --2- 172.21.15.43:0/1346097713 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d1c09fc50 0x7f9d1c1e3190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.171+0000 7f9d2251c640 1 --2- 172.21.15.43:0/1346097713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d1c09ee70 0x7f9d1c0b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.171+0000 7f9d2251c640 1 --2- 172.21.15.43:0/1346097713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d1c072e00 0x7f9d1c0b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.171+0000 7f9d2251c640 1 -- 172.21.15.43:0/1346097713 >> 172.21.15.43:0/1346097713 conn(0x7f9d1c0b7880 msgr2=0x7f9d1c146dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.171+0000 7f9d2251c640 1 -- 172.21.15.43:0/1346097713 shutdown_connections 2024-04-24T23:00:27.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.171+0000 7f9d2251c640 1 -- 172.21.15.43:0/1346097713 wait complete. 2024-04-24T23:00:27.193 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:00:02.322280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:00:14.136303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:00:14.764010+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T23:00:18.504756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:00:27.194 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:00:27.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cf1e3640 1 Processor -- start 2024-04-24T23:00:27.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cf1e3640 1 -- start start 2024-04-24T23:00:27.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cf1e3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe8c8072b30 0x7fe8c806c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cf1e3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c8072f10 0x7fe8c806f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cf1e3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe8c80b57a0 0x7fe8c80b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cf1e3640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c806fb30 con 0x7fe8c80b57a0 2024-04-24T23:00:27.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cf1e3640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c8070590 con 0x7fe8c8072b30 2024-04-24T23:00:27.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cf1e3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c806ee50 con 0x7fe8c8072f10 2024-04-24T23:00:27.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cd780640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe8c80b57a0 0x7fe8c80b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cd780640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe8c80b57a0 0x7fe8c80b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57274/0 (socket says 172.21.15.43:57274) 2024-04-24T23:00:27.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cd780640 1 -- 172.21.15.43:0/2039922081 learned_addr learned my addr 172.21.15.43:0/2039922081 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:27.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8ccf7f640 1 --2- 172.21.15.43:0/2039922081 >> v2:172.21.15.162:3300/0 conn(0x7fe8c8072b30 0x7fe8c806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8c7fff640 1 --2- 172.21.15.43:0/2039922081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c8072f10 0x7fe8c806f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cd780640 1 -- 172.21.15.43:0/2039922081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c8072f10 msgr2=0x7fe8c806f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cd780640 1 --2- 172.21.15.43:0/2039922081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c8072f10 0x7fe8c806f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cd780640 1 -- 172.21.15.43:0/2039922081 >> v2:172.21.15.162:3300/0 conn(0x7fe8c8072b30 msgr2=0x7fe8c806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cd780640 1 --2- 172.21.15.43:0/2039922081 >> v2:172.21.15.162:3300/0 conn(0x7fe8c8072b30 0x7fe8c806c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8cd780640 1 -- 172.21.15.43:0/2039922081 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c80b75e0 con 0x7fe8c80b57a0 2024-04-24T23:00:27.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.319+0000 7fe8ccf7f640 1 --2- 172.21.15.43:0/2039922081 >> v2:172.21.15.162:3300/0 conn(0x7fe8c8072b30 0x7fe8c806c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:27.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cd780640 1 --2- 172.21.15.43:0/2039922081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8c80b57a0 0x7fe8c80b5c50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80bbd70 tx=0x7fe8c001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12adddfc5edc3f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8c77fe640 1 -- 172.21.15.43:0/2039922081 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00b1070 con 0x7fe8c80b57a0 2024-04-24T23:00:27.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8c77fe640 1 -- 172.21.15.43:0/2039922081 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c00ac410 con 0x7fe8c80b57a0 2024-04-24T23:00:27.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8c77fe640 1 -- 172.21.15.43:0/2039922081 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00ac7e0 con 0x7fe8c80b57a0 2024-04-24T23:00:27.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 -- 172.21.15.43:0/2039922081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8c80b57a0 msgr2=0x7fe8c80b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 --2- 172.21.15.43:0/2039922081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8c80b57a0 0x7fe8c80b5c50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80bbd70 tx=0x7fe8c001c3d0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 -- 172.21.15.43:0/2039922081 shutdown_connections 2024-04-24T23:00:27.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 --2- 172.21.15.43:0/2039922081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c8072f10 0x7fe8c806f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 --2- 172.21.15.43:0/2039922081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8c80b57a0 0x7fe8c80b5c50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 --2- 172.21.15.43:0/2039922081 >> v2:172.21.15.162:3300/0 conn(0x7fe8c8072b30 0x7fe8c806c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 -- 172.21.15.43:0/2039922081 >> 172.21.15.43:0/2039922081 conn(0x7fe8c80b78a0 msgr2=0x7fe8c80b7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 -- 172.21.15.43:0/2039922081 shutdown_connections 2024-04-24T23:00:27.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 -- 172.21.15.43:0/2039922081 wait complete. 2024-04-24T23:00:27.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 Processor -- start 2024-04-24T23:00:27.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 -- start start 2024-04-24T23:00:27.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c8072b30 0x7fe8c80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8c8072f10 0x7fe8c81e7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8c80b57a0 0x7fe8c81e8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c8070230 con 0x7fe8c80b57a0 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c80700b0 con 0x7fe8c8072f10 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cf1e3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c814ebd0 con 0x7fe8c8072b30 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.323+0000 7fe8cd780640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8c80b57a0 0x7fe8c81e8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8cd780640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8c80b57a0 0x7fe8c81e8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57276/0 (socket says 172.21.15.43:57276) 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8cd780640 1 -- 172.21.15.43:0/931685508 learned_addr learned my addr 172.21.15.43:0/931685508 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8ccf7f640 1 --2- 172.21.15.43:0/931685508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c8072b30 0x7fe8c80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8c7fff640 1 --2- 172.21.15.43:0/931685508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8c8072f10 0x7fe8c81e7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8cd780640 1 -- 172.21.15.43:0/931685508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c8072b30 msgr2=0x7fe8c80b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8cd780640 1 --2- 172.21.15.43:0/931685508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c8072b30 0x7fe8c80b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8cd780640 1 -- 172.21.15.43:0/931685508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8c8072f10 msgr2=0x7fe8c81e7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8cd780640 1 --2- 172.21.15.43:0/931685508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8c8072f10 0x7fe8c81e7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8cd780640 1 -- 172.21.15.43:0/931685508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c814f9e0 con 0x7fe8c80b57a0 2024-04-24T23:00:27.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8cd780640 1 --2- 172.21.15.43:0/931685508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8c80b57a0 0x7fe8c81e8400 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe8c001aa80 tx=0x7fe8c0019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8c57fa640 1 -- 172.21.15.43:0/931685508 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00b9020 con 0x7fe8c80b57a0 2024-04-24T23:00:27.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8c57fa640 1 -- 172.21.15.43:0/931685508 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c00ace20 con 0x7fe8c80b57a0 2024-04-24T23:00:27.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8c57fa640 1 -- 172.21.15.43:0/931685508 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00b1040 con 0x7fe8c80b57a0 2024-04-24T23:00:27.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8cf1e3640 1 -- 172.21.15.43:0/931685508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c809cd20 con 0x7fe8c80b57a0 2024-04-24T23:00:27.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8cf1e3640 1 -- 172.21.15.43:0/931685508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c809f4f0 con 0x7fe8c80b57a0 2024-04-24T23:00:27.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8cf1e3640 1 -- 172.21.15.43:0/931685508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c804f580 con 0x7fe8c80b57a0 2024-04-24T23:00:27.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8c57fa640 1 -- 172.21.15.43:0/931685508 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe8c00bc020 con 0x7fe8c80b57a0 2024-04-24T23:00:27.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8c57fa640 1 --2- 172.21.15.43:0/931685508 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe8b40678c0 0x7fe8b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8c57fa640 1 -- 172.21.15.43:0/931685508 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe8c011fa00 con 0x7fe8c80b57a0 2024-04-24T23:00:27.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8ccf7f640 1 --2- 172.21.15.43:0/931685508 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe8b40678c0 0x7fe8b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.327+0000 7fe8ccf7f640 1 --2- 172.21.15.43:0/931685508 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe8b40678c0 0x7fe8b4069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800b930 tx=0x7fe8b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.331+0000 7fe8c57fa640 1 -- 172.21.15.43:0/931685508 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe8c00c3030 con 0x7fe8c80b57a0 2024-04-24T23:00:27.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.495+0000 7fe8cf1e3640 1 -- 172.21.15.43:0/931685508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe8c806fcf0 con 0x7fe8c80b57a0 2024-04-24T23:00:27.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.499+0000 7fe8c57fa640 1 -- 172.21.15.43:0/931685508 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fe8c0016110 con 0x7fe8c80b57a0 2024-04-24T23:00:27.503 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-24T23:00:27.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.499+0000 7fe8cf1e3640 1 -- 172.21.15.43:0/931685508 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe8b40678c0 msgr2=0x7fe8b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.499+0000 7fe8cf1e3640 1 --2- 172.21.15.43:0/931685508 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe8b40678c0 0x7fe8b4069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800b930 tx=0x7fe8b8008040 comp rx=0 tx=0).stop 2024-04-24T23:00:27.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.499+0000 7fe8cf1e3640 1 -- 172.21.15.43:0/931685508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8c80b57a0 msgr2=0x7fe8c81e8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.499+0000 7fe8cf1e3640 1 --2- 172.21.15.43:0/931685508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8c80b57a0 0x7fe8c81e8400 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe8c001aa80 tx=0x7fe8c0019170 comp rx=0 tx=0).stop 2024-04-24T23:00:27.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.499+0000 7fe8cf1e3640 1 -- 172.21.15.43:0/931685508 shutdown_connections 2024-04-24T23:00:27.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.499+0000 7fe8cf1e3640 1 --2- 172.21.15.43:0/931685508 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe8b40678c0 0x7fe8b4069d80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.499+0000 7fe8cf1e3640 1 --2- 172.21.15.43:0/931685508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8c80b57a0 0x7fe8c81e8400 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.499+0000 7fe8cf1e3640 1 --2- 172.21.15.43:0/931685508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8c8072f10 0x7fe8c81e7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.499+0000 7fe8cf1e3640 1 --2- 172.21.15.43:0/931685508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c8072b30 0x7fe8c80b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.499+0000 7fe8cf1e3640 1 -- 172.21.15.43:0/931685508 >> 172.21.15.43:0/931685508 conn(0x7fe8c80b78a0 msgr2=0x7fe8c80b8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.499+0000 7fe8cf1e3640 1 -- 172.21.15.43:0/931685508 shutdown_connections 2024-04-24T23:00:27.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.499+0000 7fe8cf1e3640 1 -- 172.21.15.43:0/931685508 wait complete. 2024-04-24T23:00:27.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:00:27.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.643+0000 7feb5f7ef640 1 Processor -- start 2024-04-24T23:00:27.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.643+0000 7feb5f7ef640 1 -- start start 2024-04-24T23:00:27.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5f7ef640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7feb580b37f0 0x7feb58072820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5f7ef640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7feb580733a0 0x7feb58144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5f7ef640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb580b3bd0 con 0x7feb58072d60 2024-04-24T23:00:27.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5f7ef640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7feb580b24f0 con 0x7feb580b37f0 2024-04-24T23:00:27.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5f7ef640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7feb580b2980 con 0x7feb580733a0 2024-04-24T23:00:27.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5dd8c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7feb58072d60 0x7feb581477d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46296/0 (socket says 172.21.15.43:46296) 2024-04-24T23:00:27.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5dd8c640 1 -- 172.21.15.43:0/3214510988 learned_addr learned my addr 172.21.15.43:0/3214510988 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:27.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5d58b640 1 --2- 172.21.15.43:0/3214510988 >> v2:172.21.15.43:3300/0 conn(0x7feb580b37f0 0x7feb58072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5cd8a640 1 --2- 172.21.15.43:0/3214510988 >> v2:172.21.15.162:3300/0 conn(0x7feb580733a0 0x7feb58144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb4ffff640 1 -- 172.21.15.43:0/3214510988 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883287964 0 0) 0x7feb580b3bd0 con 0x7feb58072d60 2024-04-24T23:00:27.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb4ffff640 1 -- 172.21.15.43:0/3214510988 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb44005740 con 0x7feb58072d60 2024-04-24T23:00:27.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5d58b640 1 -- 172.21.15.43:0/3214510988 >> v2:172.21.15.162:3300/0 conn(0x7feb580733a0 msgr2=0x7feb58144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5d58b640 1 --2- 172.21.15.43:0/3214510988 >> v2:172.21.15.162:3300/0 conn(0x7feb580733a0 0x7feb58144260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5d58b640 1 -- 172.21.15.43:0/3214510988 >> v1:172.21.15.43:6789/0 conn(0x7feb58072d60 legacy=0x7feb581477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5d58b640 1 -- 172.21.15.43:0/3214510988 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5806fdd0 con 0x7feb580b37f0 2024-04-24T23:00:27.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5d58b640 1 --2- 172.21.15.43:0/3214510988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb580b37f0 0x7feb58072820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb58148890 tx=0x7feb5401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4c467b801fff17 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb4ffff640 1 -- 172.21.15.43:0/3214510988 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb540b0070 con 0x7feb580b37f0 2024-04-24T23:00:27.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb4ffff640 1 -- 172.21.15.43:0/3214510988 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb540ab600 con 0x7feb580b37f0 2024-04-24T23:00:27.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb4ffff640 1 -- 172.21.15.43:0/3214510988 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb540ab9b0 con 0x7feb580b37f0 2024-04-24T23:00:27.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5f7ef640 1 -- 172.21.15.43:0/3214510988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb580b37f0 msgr2=0x7feb58072820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.647+0000 7feb5f7ef640 1 --2- 172.21.15.43:0/3214510988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb580b37f0 0x7feb58072820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb58148890 tx=0x7feb5401c3f0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 -- 172.21.15.43:0/3214510988 shutdown_connections 2024-04-24T23:00:27.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 --2- 172.21.15.43:0/3214510988 >> v2:172.21.15.162:3300/0 conn(0x7feb580733a0 0x7feb58144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 --2- 172.21.15.43:0/3214510988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb580b37f0 0x7feb58072820 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 -- 172.21.15.43:0/3214510988 >> 172.21.15.43:0/3214510988 conn(0x7feb580b5690 msgr2=0x7feb580b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 -- 172.21.15.43:0/3214510988 shutdown_connections 2024-04-24T23:00:27.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 -- 172.21.15.43:0/3214510988 wait complete. 2024-04-24T23:00:27.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 Processor -- start 2024-04-24T23:00:27.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 -- start start 2024-04-24T23:00:27.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb58072d60 0x7feb58071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb580733a0 0x7feb581e3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb580b37f0 0x7feb5813bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feb580b41f0 con 0x7feb58072d60 2024-04-24T23:00:27.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feb580b4070 con 0x7feb580b37f0 2024-04-24T23:00:27.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feb580b4370 con 0x7feb580733a0 2024-04-24T23:00:27.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5d58b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb58072d60 0x7feb58071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5d58b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb58072d60 0x7feb58071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57284/0 (socket says 172.21.15.43:57284) 2024-04-24T23:00:27.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5d58b640 1 -- 172.21.15.43:0/2595749565 learned_addr learned my addr 172.21.15.43:0/2595749565 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:27.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5d58b640 1 -- 172.21.15.43:0/2595749565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb580733a0 msgr2=0x7feb581e3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5dd8c640 1 --2- 172.21.15.43:0/2595749565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb580b37f0 0x7feb5813bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5d58b640 1 --2- 172.21.15.43:0/2595749565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb580733a0 0x7feb581e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5d58b640 1 -- 172.21.15.43:0/2595749565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb580b37f0 msgr2=0x7feb5813bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5d58b640 1 --2- 172.21.15.43:0/2595749565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb580b37f0 0x7feb5813bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5d58b640 1 -- 172.21.15.43:0/2595749565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb580b6b30 con 0x7feb58072d60 2024-04-24T23:00:27.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5dd8c640 1 --2- 172.21.15.43:0/2595749565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb580b37f0 0x7feb5813bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:27.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5d58b640 1 --2- 172.21.15.43:0/2595749565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb58072d60 0x7feb58071b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feb54000c10 tx=0x7feb54019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb4dffb640 1 -- 172.21.15.43:0/2595749565 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb540b0040 con 0x7feb58072d60 2024-04-24T23:00:27.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb4dffb640 1 -- 172.21.15.43:0/2595749565 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb540ab9b0 con 0x7feb58072d60 2024-04-24T23:00:27.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 -- 172.21.15.43:0/2595749565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb58141770 con 0x7feb58072d60 2024-04-24T23:00:27.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb4dffb640 1 -- 172.21.15.43:0/2595749565 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb540abd60 con 0x7feb58072d60 2024-04-24T23:00:27.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 -- 172.21.15.43:0/2595749565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb580b70b0 con 0x7feb58072d60 2024-04-24T23:00:27.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.651+0000 7feb5f7ef640 1 -- 172.21.15.43:0/2595749565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb5804f580 con 0x7feb58072d60 2024-04-24T23:00:27.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.655+0000 7feb4dffb640 1 -- 172.21.15.43:0/2595749565 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb540ab4c0 con 0x7feb58072d60 2024-04-24T23:00:27.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.655+0000 7feb4dffb640 1 --2- 172.21.15.43:0/2595749565 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7feb3c0678c0 0x7feb3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.655+0000 7feb4dffb640 1 -- 172.21.15.43:0/2595749565 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feb5411f9a0 con 0x7feb58072d60 2024-04-24T23:00:27.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.655+0000 7feb5cd8a640 1 --2- 172.21.15.43:0/2595749565 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7feb3c0678c0 0x7feb3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.655+0000 7feb5cd8a640 1 --2- 172.21.15.43:0/2595749565 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7feb3c0678c0 0x7feb3c069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb580ae5d0 tx=0x7feb48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.659+0000 7feb4dffb640 1 -- 172.21.15.43:0/2595749565 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7feb54016070 con 0x7feb58072d60 2024-04-24T23:00:27.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.819+0000 7feb5f7ef640 1 -- 172.21.15.43:0/2595749565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7feb58141eb0 con 0x7feb58072d60 2024-04-24T23:00:27.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.819+0000 7feb4dffb640 1 -- 172.21.15.43:0/2595749565 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7feb540f0230 con 0x7feb58072d60 2024-04-24T23:00:27.824 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-24T23:00:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.819+0000 7feb5f7ef640 1 -- 172.21.15.43:0/2595749565 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7feb3c0678c0 msgr2=0x7feb3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.819+0000 7feb5f7ef640 1 --2- 172.21.15.43:0/2595749565 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7feb3c0678c0 0x7feb3c069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb580ae5d0 tx=0x7feb48008040 comp rx=0 tx=0).stop 2024-04-24T23:00:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.819+0000 7feb5f7ef640 1 -- 172.21.15.43:0/2595749565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb58072d60 msgr2=0x7feb58071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.819+0000 7feb5f7ef640 1 --2- 172.21.15.43:0/2595749565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb58072d60 0x7feb58071b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feb54000c10 tx=0x7feb54019190 comp rx=0 tx=0).stop 2024-04-24T23:00:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.823+0000 7feb5f7ef640 1 -- 172.21.15.43:0/2595749565 shutdown_connections 2024-04-24T23:00:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.823+0000 7feb5f7ef640 1 --2- 172.21.15.43:0/2595749565 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7feb3c0678c0 0x7feb3c069d80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.823+0000 7feb5f7ef640 1 --2- 172.21.15.43:0/2595749565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb580b37f0 0x7feb5813bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.823+0000 7feb5f7ef640 1 --2- 172.21.15.43:0/2595749565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb580733a0 0x7feb581e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.823+0000 7feb5f7ef640 1 --2- 172.21.15.43:0/2595749565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb58072d60 0x7feb58071b10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.823+0000 7feb5f7ef640 1 -- 172.21.15.43:0/2595749565 >> 172.21.15.43:0/2595749565 conn(0x7feb580b5690 msgr2=0x7feb5813e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.823+0000 7feb5f7ef640 1 -- 172.21.15.43:0/2595749565 shutdown_connections 2024-04-24T23:00:27.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.823+0000 7feb5f7ef640 1 -- 172.21.15.43:0/2595749565 wait complete. 2024-04-24T23:00:27.843 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:00:27.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc25b06640 1 Processor -- start 2024-04-24T23:00:27.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc25b06640 1 -- start start 2024-04-24T23:00:27.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc25b06640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbc200b1320 0x7fbc200b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc25b06640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbc20072ec0 0x7fbc2014b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc25b06640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc20073370 0x7fbc2014bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc25b06640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fbc200b0f30 con 0x7fbc20072ec0 2024-04-24T23:00:27.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc25b06640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbc200b28f0 con 0x7fbc200b1320 2024-04-24T23:00:27.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc25b06640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbc200b1700 con 0x7fbc20073370 2024-04-24T23:00:27.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc1effd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbc20072ec0 0x7fbc2014b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc1effd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbc20072ec0 0x7fbc2014b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57298/0 (socket says 172.21.15.43:57298) 2024-04-24T23:00:27.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc1effd640 1 -- 172.21.15.43:0/527010354 learned_addr learned my addr 172.21.15.43:0/527010354 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:27.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc1f7fe640 1 --2- 172.21.15.43:0/527010354 >> v2:172.21.15.162:3300/0 conn(0x7fbc200b1320 0x7fbc200b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc1ffff640 1 --2- 172.21.15.43:0/527010354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc20073370 0x7fbc2014bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc1effd640 1 -- 172.21.15.43:0/527010354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc20073370 msgr2=0x7fbc2014bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc1effd640 1 --2- 172.21.15.43:0/527010354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc20073370 0x7fbc2014bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc1effd640 1 -- 172.21.15.43:0/527010354 >> v2:172.21.15.162:3300/0 conn(0x7fbc200b1320 msgr2=0x7fbc200b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:27.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc1effd640 1 --2- 172.21.15.43:0/527010354 >> v2:172.21.15.162:3300/0 conn(0x7fbc200b1320 0x7fbc200b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc1effd640 1 -- 172.21.15.43:0/527010354 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc200b0400 con 0x7fbc20072ec0 2024-04-24T23:00:27.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc1ffff640 1 --2- 172.21.15.43:0/527010354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc20073370 0x7fbc2014bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:27.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.955+0000 7fbc1f7fe640 1 --2- 172.21.15.43:0/527010354 >> v2:172.21.15.162:3300/0 conn(0x7fbc200b1320 0x7fbc200b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:27.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc1effd640 1 --2- 172.21.15.43:0/527010354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc20072ec0 0x7fbc2014b9f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbc20075020 tx=0x7fbc0801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fdd8f4cf697caf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc1e7fc640 1 -- 172.21.15.43:0/527010354 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc080b2070 con 0x7fbc20072ec0 2024-04-24T23:00:27.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc1e7fc640 1 -- 172.21.15.43:0/527010354 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc080ad680 con 0x7fbc20072ec0 2024-04-24T23:00:27.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc1e7fc640 1 -- 172.21.15.43:0/527010354 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc080ada50 con 0x7fbc20072ec0 2024-04-24T23:00:27.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 -- 172.21.15.43:0/527010354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc20072ec0 msgr2=0x7fbc2014b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 --2- 172.21.15.43:0/527010354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc20072ec0 0x7fbc2014b9f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbc20075020 tx=0x7fbc0801c460 comp rx=0 tx=0).stop 2024-04-24T23:00:27.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 -- 172.21.15.43:0/527010354 shutdown_connections 2024-04-24T23:00:27.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 --2- 172.21.15.43:0/527010354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc20073370 0x7fbc2014bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 --2- 172.21.15.43:0/527010354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc20072ec0 0x7fbc2014b9f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 --2- 172.21.15.43:0/527010354 >> v2:172.21.15.162:3300/0 conn(0x7fbc200b1320 0x7fbc200b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 -- 172.21.15.43:0/527010354 >> 172.21.15.43:0/527010354 conn(0x7fbc200b5690 msgr2=0x7fbc200b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:27.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 -- 172.21.15.43:0/527010354 shutdown_connections 2024-04-24T23:00:27.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 -- 172.21.15.43:0/527010354 wait complete. 2024-04-24T23:00:27.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 Processor -- start 2024-04-24T23:00:27.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 -- start start 2024-04-24T23:00:27.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc20072ec0 0x7fbc200b84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc20073370 0x7fbc201485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc200b1320 0x7fbc20148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2014f950 con 0x7fbc200b1320 2024-04-24T23:00:27.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2014f7d0 con 0x7fbc20073370 2024-04-24T23:00:27.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbc2014fad0 con 0x7fbc20072ec0 2024-04-24T23:00:27.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc1ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc200b1320 0x7fbc20148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc1ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc200b1320 0x7fbc20148b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57308/0 (socket says 172.21.15.43:57308) 2024-04-24T23:00:27.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc1ffff640 1 -- 172.21.15.43:0/2292379862 learned_addr learned my addr 172.21.15.43:0/2292379862 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:27.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc1f7fe640 1 --2- 172.21.15.43:0/2292379862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc20072ec0 0x7fbc200b84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc1effd640 1 --2- 172.21.15.43:0/2292379862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc20073370 0x7fbc201485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc1ffff640 1 -- 172.21.15.43:0/2292379862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc20072ec0 msgr2=0x7fbc200b84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc1ffff640 1 --2- 172.21.15.43:0/2292379862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc20072ec0 0x7fbc200b84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc1ffff640 1 -- 172.21.15.43:0/2292379862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc20073370 msgr2=0x7fbc201485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:27.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc1ffff640 1 --2- 172.21.15.43:0/2292379862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc20073370 0x7fbc201485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:27.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc1ffff640 1 -- 172.21.15.43:0/2292379862 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc20147370 con 0x7fbc200b1320 2024-04-24T23:00:27.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc1ffff640 1 --2- 172.21.15.43:0/2292379862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc200b1320 0x7fbc20148b00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000c7f0 tx=0x7fbc1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc17fff640 1 -- 172.21.15.43:0/2292379862 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10015070 con 0x7fbc200b1320 2024-04-24T23:00:27.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc17fff640 1 -- 172.21.15.43:0/2292379862 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc10007820 con 0x7fbc200b1320 2024-04-24T23:00:27.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc17fff640 1 -- 172.21.15.43:0/2292379862 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10007c10 con 0x7fbc200b1320 2024-04-24T23:00:27.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 -- 172.21.15.43:0/2292379862 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc20147650 con 0x7fbc200b1320 2024-04-24T23:00:27.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.959+0000 7fbc25b06640 1 -- 172.21.15.43:0/2292379862 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc20147dc0 con 0x7fbc200b1320 2024-04-24T23:00:27.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.963+0000 7fbc25b06640 1 -- 172.21.15.43:0/2292379862 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc2004f580 con 0x7fbc200b1320 2024-04-24T23:00:27.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.963+0000 7fbc17fff640 1 -- 172.21.15.43:0/2292379862 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbc10018070 con 0x7fbc200b1320 2024-04-24T23:00:27.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.963+0000 7fbc17fff640 1 --2- 172.21.15.43:0/2292379862 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbc000678c0 0x7fbc00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:27.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.963+0000 7fbc17fff640 1 -- 172.21.15.43:0/2292379862 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbc10086070 con 0x7fbc200b1320 2024-04-24T23:00:27.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.963+0000 7fbc1f7fe640 1 --2- 172.21.15.43:0/2292379862 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbc000678c0 0x7fbc00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:27.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.963+0000 7fbc1f7fe640 1 --2- 172.21.15.43:0/2292379862 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbc000678c0 0x7fbc00069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbc18007510 tx=0x7fbc180074a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:27.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:27.967+0000 7fbc17fff640 1 -- 172.21.15.43:0/2292379862 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fbc100569c0 con 0x7fbc200b1320 2024-04-24T23:00:28.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.127+0000 7fbc25b06640 1 -- 172.21.15.43:0/2292379862 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbc20073820 con 0x7fbc200b1320 2024-04-24T23:00:28.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.127+0000 7fbc17fff640 1 -- 172.21.15.43:0/2292379862 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fbc100562c0 con 0x7fbc200b1320 2024-04-24T23:00:28.134 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-24T23:00:28.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.131+0000 7fbc25b06640 1 -- 172.21.15.43:0/2292379862 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbc000678c0 msgr2=0x7fbc00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.131+0000 7fbc25b06640 1 --2- 172.21.15.43:0/2292379862 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbc000678c0 0x7fbc00069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbc18007510 tx=0x7fbc180074a0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.131+0000 7fbc25b06640 1 -- 172.21.15.43:0/2292379862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc200b1320 msgr2=0x7fbc20148b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.131+0000 7fbc25b06640 1 --2- 172.21.15.43:0/2292379862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc200b1320 0x7fbc20148b00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000c7f0 tx=0x7fbc1000ccb0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.131+0000 7fbc25b06640 1 -- 172.21.15.43:0/2292379862 shutdown_connections 2024-04-24T23:00:28.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.131+0000 7fbc25b06640 1 --2- 172.21.15.43:0/2292379862 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbc000678c0 0x7fbc00069d80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.131+0000 7fbc25b06640 1 --2- 172.21.15.43:0/2292379862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc200b1320 0x7fbc20148b00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.131+0000 7fbc25b06640 1 --2- 172.21.15.43:0/2292379862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc20073370 0x7fbc201485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.131+0000 7fbc25b06640 1 --2- 172.21.15.43:0/2292379862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc20072ec0 0x7fbc200b84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.131+0000 7fbc25b06640 1 -- 172.21.15.43:0/2292379862 >> 172.21.15.43:0/2292379862 conn(0x7fbc200b5690 msgr2=0x7fbc2006d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:28.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.131+0000 7fbc25b06640 1 -- 172.21.15.43:0/2292379862 shutdown_connections 2024-04-24T23:00:28.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.131+0000 7fbc25b06640 1 -- 172.21.15.43:0/2292379862 wait complete. 2024-04-24T23:00:28.154 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:00:28.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.259+0000 7f1d8fd31640 1 Processor -- start 2024-04-24T23:00:28.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.259+0000 7f1d8fd31640 1 -- start start 2024-04-24T23:00:28.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.259+0000 7f1d8fd31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d880b2cf0 0x7f1d8814b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.259+0000 7f1d8fd31640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d880735d0 con 0x7f1d880b1320 2024-04-24T23:00:28.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.259+0000 7f1d8fd31640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d880b1700 con 0x7f1d8814bf30 2024-04-24T23:00:28.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.259+0000 7f1d8fd31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1d880b0f30 con 0x7f1d880b2cf0 2024-04-24T23:00:28.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.259+0000 7f1d8dacd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1d880b1320 0x7f1d88072ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46298/0 (socket says 172.21.15.43:46298) 2024-04-24T23:00:28.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.259+0000 7f1d8dacd640 1 -- 172.21.15.43:0/1090224812 learned_addr learned my addr 172.21.15.43:0/1090224812 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:28.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 -- 172.21.15.43:0/1090224812 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4202335011 0 0) 0x7f1d880735d0 con 0x7f1d880b1320 2024-04-24T23:00:28.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 -- 172.21.15.43:0/1090224812 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d74003530 con 0x7f1d880b1320 2024-04-24T23:00:28.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8d2cc640 1 --2- 172.21.15.43:0/1090224812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d880b2cf0 0x7f1d8814b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 -- 172.21.15.43:0/1090224812 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3589264438 0 0) 0x7f1d74003530 con 0x7f1d880b1320 2024-04-24T23:00:28.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 -- 172.21.15.43:0/1090224812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d880b2cf0 msgr2=0x7f1d8814b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:28.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 --2- 172.21.15.43:0/1090224812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d880b2cf0 0x7f1d8814b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 -- 172.21.15.43:0/1090224812 >> v1:172.21.15.162:6789/0 conn(0x7f1d8814bf30 legacy=0x7f1d88156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 -- 172.21.15.43:0/1090224812 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d880b0400 con 0x7f1d880b1320 2024-04-24T23:00:28.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 -- 172.21.15.43:0/1090224812 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f1d84001a00 con 0x7f1d880b1320 2024-04-24T23:00:28.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 -- 172.21.15.43:0/1090224812 >> v1:172.21.15.43:6789/0 conn(0x7f1d880b1320 legacy=0x7f1d88072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 --2- 172.21.15.43:0/1090224812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d740039f0 0x7f1d74003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 --2- 172.21.15.43:0/1090224812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d74004810 0x7f1d74004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 --2- 172.21.15.43:0/1090224812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d74005220 0x7f1d7400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 -- 172.21.15.43:0/1090224812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7400c0f0 con 0x7f1d74005220 2024-04-24T23:00:28.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 -- 172.21.15.43:0/1090224812 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7400c2a0 con 0x7f1d74004810 2024-04-24T23:00:28.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 -- 172.21.15.43:0/1090224812 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1d7400c4a0 con 0x7f1d740039f0 2024-04-24T23:00:28.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8d2cc640 1 --2- 172.21.15.43:0/1090224812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d880b2cf0 0x7f1d8814b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:28.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8e2ce640 1 --2- 172.21.15.43:0/1090224812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d74005220 0x7f1d7400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8dacd640 1 --2- 172.21.15.43:0/1090224812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d740039f0 0x7f1d74003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8d2cc640 1 --2- 172.21.15.43:0/1090224812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d74004810 0x7f1d74004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8e2ce640 1 -- 172.21.15.43:0/1090224812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d740039f0 msgr2=0x7f1d74003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:28.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8e2ce640 1 --2- 172.21.15.43:0/1090224812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d740039f0 0x7f1d74003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8e2ce640 1 -- 172.21.15.43:0/1090224812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d74004810 msgr2=0x7f1d74004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:28.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8e2ce640 1 --2- 172.21.15.43:0/1090224812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d74004810 0x7f1d74004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8e2ce640 1 -- 172.21.15.43:0/1090224812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d74003530 con 0x7f1d74005220 2024-04-24T23:00:28.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8dacd640 1 --2- 172.21.15.43:0/1090224812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d740039f0 0x7f1d74003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:28.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8e2ce640 1 --2- 172.21.15.43:0/1090224812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d74005220 0x7f1d7400b9d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1d80001780 tx=0x7f1d8001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03e9dfdfcf56765 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:28.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 -- 172.21.15.43:0/1090224812 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d800013a0 con 0x7f1d74005220 2024-04-24T23:00:28.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 -- 172.21.15.43:0/1090224812 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d800a9070 con 0x7f1d74005220 2024-04-24T23:00:28.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8cacb640 1 -- 172.21.15.43:0/1090224812 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d80003600 con 0x7f1d74005220 2024-04-24T23:00:28.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8fd31640 1 -- 172.21.15.43:0/1090224812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d74005220 msgr2=0x7f1d7400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8fd31640 1 --2- 172.21.15.43:0/1090224812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d74005220 0x7f1d7400b9d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1d80001780 tx=0x7f1d8001c420 comp rx=0 tx=0).stop 2024-04-24T23:00:28.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8e2ce640 1 -- 172.21.15.43:0/1090224812 reap_dead start 2024-04-24T23:00:28.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8fd31640 1 -- 172.21.15.43:0/1090224812 shutdown_connections 2024-04-24T23:00:28.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8fd31640 1 -- 172.21.15.43:0/1090224812 >> 172.21.15.43:0/1090224812 conn(0x7f1d880b5690 msgr2=0x7f1d880b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:28.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8fd31640 1 -- 172.21.15.43:0/1090224812 shutdown_connections 2024-04-24T23:00:28.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.263+0000 7f1d8fd31640 1 -- 172.21.15.43:0/1090224812 wait complete. 2024-04-24T23:00:28.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8fd31640 1 Processor -- start 2024-04-24T23:00:28.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8fd31640 1 -- start start 2024-04-24T23:00:28.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8fd31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d880a9d10 0x7f1d881e19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8fd31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d881487f0 0x7f1d880ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8fd31640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d880aee10 0x7f1d881e4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8fd31640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1d880b0090 con 0x7f1d880aee10 2024-04-24T23:00:28.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8fd31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1d880b28f0 con 0x7f1d881487f0 2024-04-24T23:00:28.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8fd31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1d880b61b0 con 0x7f1d880a9d10 2024-04-24T23:00:28.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8e2ce640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d880aee10 0x7f1d881e4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8e2ce640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d880aee10 0x7f1d881e4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57322/0 (socket says 172.21.15.43:57322) 2024-04-24T23:00:28.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8e2ce640 1 -- 172.21.15.43:0/52873165 learned_addr learned my addr 172.21.15.43:0/52873165 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:28.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8d2cc640 1 --2- 172.21.15.43:0/52873165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d881487f0 0x7f1d880ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8dacd640 1 --2- 172.21.15.43:0/52873165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d880a9d10 0x7f1d881e19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8e2ce640 1 -- 172.21.15.43:0/52873165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d880a9d10 msgr2=0x7f1d881e19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8e2ce640 1 --2- 172.21.15.43:0/52873165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d880a9d10 0x7f1d881e19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8e2ce640 1 -- 172.21.15.43:0/52873165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d881487f0 msgr2=0x7f1d880ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8e2ce640 1 --2- 172.21.15.43:0/52873165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d881487f0 0x7f1d880ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8e2ce640 1 -- 172.21.15.43:0/52873165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d880aa0f0 con 0x7f1d880aee10 2024-04-24T23:00:28.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8d2cc640 1 --2- 172.21.15.43:0/52873165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d881487f0 0x7f1d880ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:28.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8e2ce640 1 --2- 172.21.15.43:0/52873165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d880aee10 0x7f1d881e4320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1d80001780 tx=0x7f1d74005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:28.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d7e7fc640 1 -- 172.21.15.43:0/52873165 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d800bb070 con 0x7f1d880aee10 2024-04-24T23:00:28.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d7e7fc640 1 -- 172.21.15.43:0/52873165 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d80007250 con 0x7f1d880aee10 2024-04-24T23:00:28.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8fd31640 1 -- 172.21.15.43:0/52873165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d880ab010 con 0x7f1d880aee10 2024-04-24T23:00:28.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d7e7fc640 1 -- 172.21.15.43:0/52873165 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d800013a0 con 0x7f1d880aee10 2024-04-24T23:00:28.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8fd31640 1 -- 172.21.15.43:0/52873165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d881e0ec0 con 0x7f1d880aee10 2024-04-24T23:00:28.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d8fd31640 1 -- 172.21.15.43:0/52873165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d88148bd0 con 0x7f1d880aee10 2024-04-24T23:00:28.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d7e7fc640 1 -- 172.21.15.43:0/52873165 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d800be070 con 0x7f1d880aee10 2024-04-24T23:00:28.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.267+0000 7f1d7e7fc640 1 --2- 172.21.15.43:0/52873165 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1d6c0678f0 0x7f1d6c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.271+0000 7f1d7e7fc640 1 -- 172.21.15.43:0/52873165 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1d8011f080 con 0x7f1d880aee10 2024-04-24T23:00:28.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.271+0000 7f1d8dacd640 1 --2- 172.21.15.43:0/52873165 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1d6c0678f0 0x7f1d6c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.271+0000 7f1d8dacd640 1 --2- 172.21.15.43:0/52873165 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1d6c0678f0 0x7f1d6c069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1d84001b70 tx=0x7f1d840012c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:28.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.275+0000 7f1d7e7fc640 1 -- 172.21.15.43:0/52873165 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f1d800c4060 con 0x7f1d880aee10 2024-04-24T23:00:28.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.431+0000 7f1d8fd31640 1 -- 172.21.15.43:0/52873165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1d8804f580 con 0x7f1d880aee10 2024-04-24T23:00:28.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.431+0000 7f1d7e7fc640 1 -- 172.21.15.43:0/52873165 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f1d80016130 con 0x7f1d880aee10 2024-04-24T23:00:28.438 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-24T23:00:28.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.435+0000 7f1d8fd31640 1 -- 172.21.15.43:0/52873165 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1d6c0678f0 msgr2=0x7f1d6c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.435+0000 7f1d8fd31640 1 --2- 172.21.15.43:0/52873165 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1d6c0678f0 0x7f1d6c069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1d84001b70 tx=0x7f1d840012c0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.435+0000 7f1d8fd31640 1 -- 172.21.15.43:0/52873165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d880aee10 msgr2=0x7f1d881e4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.435+0000 7f1d8fd31640 1 --2- 172.21.15.43:0/52873165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d880aee10 0x7f1d881e4320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1d80001780 tx=0x7f1d74005840 comp rx=0 tx=0).stop 2024-04-24T23:00:28.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.435+0000 7f1d8fd31640 1 -- 172.21.15.43:0/52873165 shutdown_connections 2024-04-24T23:00:28.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.435+0000 7f1d8fd31640 1 --2- 172.21.15.43:0/52873165 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1d6c0678f0 0x7f1d6c069db0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.435+0000 7f1d8fd31640 1 --2- 172.21.15.43:0/52873165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d880aee10 0x7f1d881e4320 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.435+0000 7f1d8fd31640 1 --2- 172.21.15.43:0/52873165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d881487f0 0x7f1d880ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.435+0000 7f1d8fd31640 1 --2- 172.21.15.43:0/52873165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d880a9d10 0x7f1d881e19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.435+0000 7f1d8fd31640 1 -- 172.21.15.43:0/52873165 >> 172.21.15.43:0/52873165 conn(0x7f1d880b5690 msgr2=0x7f1d880b71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:28.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.435+0000 7f1d8fd31640 1 -- 172.21.15.43:0/52873165 shutdown_connections 2024-04-24T23:00:28.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.435+0000 7f1d8fd31640 1 -- 172.21.15.43:0/52873165 wait complete. 2024-04-24T23:00:28.456 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:00:28.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.583+0000 7f8419cfd640 1 Processor -- start 2024-04-24T23:00:28.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.583+0000 7f8419cfd640 1 -- start start 2024-04-24T23:00:28.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.583+0000 7f8419cfd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f84140bd870 0x7f84140b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.583+0000 7f8419cfd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84140b9590 0x7f841414ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.583+0000 7f8419cfd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f841414b600 con 0x7f841414b190 2024-04-24T23:00:28.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.583+0000 7f8419cfd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f84140bdc50 con 0x7f84140bd870 2024-04-24T23:00:28.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.583+0000 7f8419cfd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f84140b5740 con 0x7f84140b9590 2024-04-24T23:00:28.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.583+0000 7f8412ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84140b9590 0x7f841414ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.583+0000 7f84137fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f84140bd870 0x7f84140b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.583+0000 7f84137fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f84140bd870 0x7f84140b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.43:46418/0 (socket says 172.21.15.43:46418) 2024-04-24T23:00:28.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.583+0000 7f84137fe640 1 -- 172.21.15.43:0/2965709584 learned_addr learned my addr 172.21.15.43:0/2965709584 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:28.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.583+0000 7f84137fe640 1 -- 172.21.15.43:0/2965709584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84140b9590 msgr2=0x7f841414ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:28.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.583+0000 7f84137fe640 1 --2- 172.21.15.43:0/2965709584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84140b9590 0x7f841414ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.583+0000 7f84137fe640 1 -- 172.21.15.43:0/2965709584 >> v1:172.21.15.162:6789/0 conn(0x7f841414b190 legacy=0x7f84141411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.583+0000 7f84137fe640 1 -- 172.21.15.43:0/2965709584 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84140b5a20 con 0x7f84140bd870 2024-04-24T23:00:28.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.587+0000 7f84137fe640 1 --2- 172.21.15.43:0/2965709584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84140bd870 0x7f84140b49d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8404009870 tx=0x7f840401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25b9a90f692e76fa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:28.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.587+0000 7f84127fc640 1 -- 172.21.15.43:0/2965709584 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84040ab680 con 0x7f84140bd870 2024-04-24T23:00:28.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.587+0000 7f84127fc640 1 -- 172.21.15.43:0/2965709584 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84040b0070 con 0x7f84140bd870 2024-04-24T23:00:28.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.587+0000 7f84127fc640 1 -- 172.21.15.43:0/2965709584 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84040aba40 con 0x7f84140bd870 2024-04-24T23:00:28.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.587+0000 7f8419cfd640 1 -- 172.21.15.43:0/2965709584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84140bd870 msgr2=0x7f84140b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.587+0000 7f8419cfd640 1 --2- 172.21.15.43:0/2965709584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84140bd870 0x7f84140b49d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8404009870 tx=0x7f840401c4a0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.587+0000 7f8419cfd640 1 -- 172.21.15.43:0/2965709584 shutdown_connections 2024-04-24T23:00:28.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.587+0000 7f8419cfd640 1 --2- 172.21.15.43:0/2965709584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84140b9590 0x7f841414ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.587+0000 7f8419cfd640 1 --2- 172.21.15.43:0/2965709584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84140bd870 0x7f84140b49d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.587+0000 7f8419cfd640 1 -- 172.21.15.43:0/2965709584 >> 172.21.15.43:0/2965709584 conn(0x7f8414072f20 msgr2=0x7f84140bcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:28.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.587+0000 7f8419cfd640 1 -- 172.21.15.43:0/2965709584 shutdown_connections 2024-04-24T23:00:28.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.587+0000 7f8419cfd640 1 -- 172.21.15.43:0/2965709584 wait complete. 2024-04-24T23:00:28.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.587+0000 7f8419cfd640 1 Processor -- start 2024-04-24T23:00:28.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.587+0000 7f8419cfd640 1 -- start start 2024-04-24T23:00:28.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8419cfd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84140bd870 0x7f841413e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8419cfd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f841414b190 0x7f8414144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8419cfd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84141446c0 0x7f8414141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8419cfd640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f84141549e0 con 0x7f84141446c0 2024-04-24T23:00:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8419cfd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8414154860 con 0x7f841414b190 2024-04-24T23:00:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8419cfd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8414154b60 con 0x7f84140bd870 2024-04-24T23:00:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8413fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84141446c0 0x7f8414141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8413fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84141446c0 0x7f8414141da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57326/0 (socket says 172.21.15.43:57326) 2024-04-24T23:00:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8413fff640 1 -- 172.21.15.43:0/3624853827 learned_addr learned my addr 172.21.15.43:0/3624853827 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f84137fe640 1 --2- 172.21.15.43:0/3624853827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84140bd870 0x7f841413e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8412ffd640 1 --2- 172.21.15.43:0/3624853827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f841414b190 0x7f8414144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8413fff640 1 -- 172.21.15.43:0/3624853827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84140bd870 msgr2=0x7f841413e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8413fff640 1 --2- 172.21.15.43:0/3624853827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84140bd870 0x7f841413e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8413fff640 1 -- 172.21.15.43:0/3624853827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f841414b190 msgr2=0x7f8414144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8413fff640 1 --2- 172.21.15.43:0/3624853827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f841414b190 0x7f8414144180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8413fff640 1 -- 172.21.15.43:0/3624853827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841414bcd0 con 0x7f84141446c0 2024-04-24T23:00:28.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8412ffd640 1 --2- 172.21.15.43:0/3624853827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f841414b190 0x7f8414144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:28.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8413fff640 1 --2- 172.21.15.43:0/3624853827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84141446c0 0x7f8414141da0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c760 tx=0x7f840c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:28.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f83fbfff640 1 -- 172.21.15.43:0/3624853827 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c016020 con 0x7f84141446c0 2024-04-24T23:00:28.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f83fbfff640 1 -- 172.21.15.43:0/3624853827 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c006d60 con 0x7f84141446c0 2024-04-24T23:00:28.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8419cfd640 1 -- 172.21.15.43:0/3624853827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841414ccc0 con 0x7f84141446c0 2024-04-24T23:00:28.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f83fbfff640 1 -- 172.21.15.43:0/3624853827 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c003bc0 con 0x7f84141446c0 2024-04-24T23:00:28.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8419cfd640 1 -- 172.21.15.43:0/3624853827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8414145030 con 0x7f84141446c0 2024-04-24T23:00:28.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f8419cfd640 1 -- 172.21.15.43:0/3624853827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8414143cb0 con 0x7f84141446c0 2024-04-24T23:00:28.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f83fbfff640 1 -- 172.21.15.43:0/3624853827 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f840c0050d0 con 0x7f84141446c0 2024-04-24T23:00:28.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f83fbfff640 1 --2- 172.21.15.43:0/3624853827 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f84000678f0 0x7f8400069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f84137fe640 1 --2- 172.21.15.43:0/3624853827 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f84000678f0 0x7f8400069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.591+0000 7f83fbfff640 1 -- 172.21.15.43:0/3624853827 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f840c085b70 con 0x7f84141446c0 2024-04-24T23:00:28.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.595+0000 7f84137fe640 1 --2- 172.21.15.43:0/3624853827 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f84000678f0 0x7f8400069db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f84040af000 tx=0x7f8404008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:28.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.595+0000 7f83fbfff640 1 -- 172.21.15.43:0/3624853827 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f840c020020 con 0x7f84141446c0 2024-04-24T23:00:28.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.767+0000 7f8419cfd640 1 -- 172.21.15.43:0/3624853827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f841404f580 con 0x7f84141446c0 2024-04-24T23:00:28.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.771+0000 7f83fbfff640 1 -- 172.21.15.43:0/3624853827 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f841414bcd0 con 0x7f84141446c0 2024-04-24T23:00:28.775 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2024-04-24T23:00:28.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.771+0000 7f8419cfd640 1 -- 172.21.15.43:0/3624853827 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f84000678f0 msgr2=0x7f8400069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.771+0000 7f8419cfd640 1 --2- 172.21.15.43:0/3624853827 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f84000678f0 0x7f8400069db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f84040af000 tx=0x7f8404008040 comp rx=0 tx=0).stop 2024-04-24T23:00:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.771+0000 7f8419cfd640 1 -- 172.21.15.43:0/3624853827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84141446c0 msgr2=0x7f8414141da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.771+0000 7f8419cfd640 1 --2- 172.21.15.43:0/3624853827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84141446c0 0x7f8414141da0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c760 tx=0x7f840c00cb60 comp rx=0 tx=0).stop 2024-04-24T23:00:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.771+0000 7f8419cfd640 1 -- 172.21.15.43:0/3624853827 shutdown_connections 2024-04-24T23:00:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.771+0000 7f8419cfd640 1 --2- 172.21.15.43:0/3624853827 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f84000678f0 0x7f8400069db0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.771+0000 7f8419cfd640 1 --2- 172.21.15.43:0/3624853827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84141446c0 0x7f8414141da0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.771+0000 7f8419cfd640 1 --2- 172.21.15.43:0/3624853827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f841414b190 0x7f8414144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.771+0000 7f8419cfd640 1 --2- 172.21.15.43:0/3624853827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84140bd870 0x7f841413e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.771+0000 7f8419cfd640 1 -- 172.21.15.43:0/3624853827 >> 172.21.15.43:0/3624853827 conn(0x7f8414072f20 msgr2=0x7f841413f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.771+0000 7f8419cfd640 1 -- 172.21.15.43:0/3624853827 shutdown_connections 2024-04-24T23:00:28.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.771+0000 7f8419cfd640 1 -- 172.21.15.43:0/3624853827 wait complete. 2024-04-24T23:00:28.794 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T23:00:28.794 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:00:28.800 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:28.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.963+0000 7fed241d5640 1 Processor -- start 2024-04-24T23:00:28.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.963+0000 7fed241d5640 1 -- start start 2024-04-24T23:00:28.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.963+0000 7fed241d5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fed1c0b4080 0x7fed1c0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.963+0000 7fed241d5640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed1c0adaf0 con 0x7fed1c0b1f80 2024-04-24T23:00:28.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.963+0000 7fed241d5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed1c14b690 con 0x7fed1c14aef0 2024-04-24T23:00:28.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.963+0000 7fed241d5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fed1c0b01c0 con 0x7fed1c0b4080 2024-04-24T23:00:28.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.963+0000 7fed22772640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fed1c0b1f80 0x7fed1c151fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46314/0 (socket says 172.21.15.43:46314) 2024-04-24T23:00:28.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.963+0000 7fed22772640 1 -- 172.21.15.43:0/1340070571 learned_addr learned my addr 172.21.15.43:0/1340070571 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:28.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.963+0000 7fed21770640 1 --2- 172.21.15.43:0/1340070571 >> v2:172.21.15.162:3300/0 conn(0x7fed1c0b4080 0x7fed1c0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.963+0000 7fed20f6f640 1 -- 172.21.15.43:0/1340070571 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1404315642 0 0) 0x7fed1c0adaf0 con 0x7fed1c0b1f80 2024-04-24T23:00:28.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.963+0000 7fed20f6f640 1 -- 172.21.15.43:0/1340070571 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed08003530 con 0x7fed1c0b1f80 2024-04-24T23:00:28.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.963+0000 7fed21770640 1 -- 172.21.15.43:0/1340070571 >> v1:172.21.15.162:6789/0 conn(0x7fed1c14aef0 legacy=0x7fed1c0b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.963+0000 7fed21770640 1 -- 172.21.15.43:0/1340070571 >> v1:172.21.15.43:6789/0 conn(0x7fed1c0b1f80 legacy=0x7fed1c151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.963+0000 7fed21770640 1 -- 172.21.15.43:0/1340070571 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1c14b970 con 0x7fed1c0b4080 2024-04-24T23:00:28.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed21770640 1 --2- 172.21.15.43:0/1340070571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1c0b4080 0x7fed1c0b1a40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed0c0097c0 tx=0x7fed0c01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d915bf01e10aabbe server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:28.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed20f6f640 1 -- 172.21.15.43:0/1340070571 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0b0070 con 0x7fed1c0b4080 2024-04-24T23:00:28.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed20f6f640 1 -- 172.21.15.43:0/1340070571 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed0c0ab600 con 0x7fed1c0b4080 2024-04-24T23:00:28.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed20f6f640 1 -- 172.21.15.43:0/1340070571 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0ab9b0 con 0x7fed1c0b4080 2024-04-24T23:00:28.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed241d5640 1 -- 172.21.15.43:0/1340070571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1c0b4080 msgr2=0x7fed1c0b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed241d5640 1 --2- 172.21.15.43:0/1340070571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1c0b4080 0x7fed1c0b1a40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed0c0097c0 tx=0x7fed0c01c380 comp rx=0 tx=0).stop 2024-04-24T23:00:28.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed241d5640 1 -- 172.21.15.43:0/1340070571 shutdown_connections 2024-04-24T23:00:28.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed241d5640 1 --2- 172.21.15.43:0/1340070571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1c0b4080 0x7fed1c0b1a40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed241d5640 1 -- 172.21.15.43:0/1340070571 >> 172.21.15.43:0/1340070571 conn(0x7fed1c0b5690 msgr2=0x7fed1c0b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:28.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed241d5640 1 -- 172.21.15.43:0/1340070571 shutdown_connections 2024-04-24T23:00:28.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed241d5640 1 -- 172.21.15.43:0/1340070571 wait complete. 2024-04-24T23:00:28.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed241d5640 1 Processor -- start 2024-04-24T23:00:28.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed241d5640 1 -- start start 2024-04-24T23:00:28.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed241d5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1c0b1f80 0x7fed1c1464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed241d5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed1c0b4080 0x7fed1c1476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed241d5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1c14aef0 0x7fed1c144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed241d5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c0b6330 con 0x7fed1c0b4080 2024-04-24T23:00:28.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed241d5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c0b61b0 con 0x7fed1c0b1f80 2024-04-24T23:00:28.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed241d5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fed1c155f00 con 0x7fed1c14aef0 2024-04-24T23:00:28.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed21770640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed1c0b4080 0x7fed1c1476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed21770640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed1c0b4080 0x7fed1c1476f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57340/0 (socket says 172.21.15.43:57340) 2024-04-24T23:00:28.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed21770640 1 -- 172.21.15.43:0/3788352832 learned_addr learned my addr 172.21.15.43:0/3788352832 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:28.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed21f71640 1 --2- 172.21.15.43:0/3788352832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1c0b1f80 0x7fed1c1464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed22772640 1 --2- 172.21.15.43:0/3788352832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1c14aef0 0x7fed1c144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed21770640 1 -- 172.21.15.43:0/3788352832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1c14aef0 msgr2=0x7fed1c144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed21770640 1 --2- 172.21.15.43:0/3788352832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1c14aef0 0x7fed1c144100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed21770640 1 -- 172.21.15.43:0/3788352832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1c0b1f80 msgr2=0x7fed1c1464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:28.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed21770640 1 --2- 172.21.15.43:0/3788352832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1c0b1f80 0x7fed1c1464d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:28.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed21770640 1 -- 172.21.15.43:0/3788352832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1c146a10 con 0x7fed1c0b4080 2024-04-24T23:00:28.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed21770640 1 --2- 172.21.15.43:0/3788352832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed1c0b4080 0x7fed1c1476f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fed0c0097c0 tx=0x7fed0c01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:28.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.967+0000 7fed127fc640 1 -- 172.21.15.43:0/3788352832 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0b0070 con 0x7fed1c0b4080 2024-04-24T23:00:28.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.971+0000 7fed127fc640 1 -- 172.21.15.43:0/3788352832 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed0c0ba070 con 0x7fed1c0b4080 2024-04-24T23:00:28.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.971+0000 7fed241d5640 1 -- 172.21.15.43:0/3788352832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed1c147f40 con 0x7fed1c0b4080 2024-04-24T23:00:28.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.971+0000 7fed127fc640 1 -- 172.21.15.43:0/3788352832 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0abbc0 con 0x7fed1c0b4080 2024-04-24T23:00:28.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.971+0000 7fed241d5640 1 -- 172.21.15.43:0/3788352832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed1c1458f0 con 0x7fed1c0b4080 2024-04-24T23:00:28.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.971+0000 7fed241d5640 1 -- 172.21.15.43:0/3788352832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed1c145e10 con 0x7fed1c0b4080 2024-04-24T23:00:28.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.971+0000 7fed127fc640 1 -- 172.21.15.43:0/3788352832 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed0c003620 con 0x7fed1c0b4080 2024-04-24T23:00:28.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.971+0000 7fed127fc640 1 --2- 172.21.15.43:0/3788352832 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fed000678c0 0x7fed00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:28.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.971+0000 7fed127fc640 1 -- 172.21.15.43:0/3788352832 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fed0c120b60 con 0x7fed1c0b4080 2024-04-24T23:00:28.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.971+0000 7fed21f71640 1 --2- 172.21.15.43:0/3788352832 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fed000678c0 0x7fed00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:28.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.971+0000 7fed21f71640 1 --2- 172.21.15.43:0/3788352832 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fed000678c0 0x7fed00069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed180015b0 tx=0x7fed18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:28.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:28.975+0000 7fed127fc640 1 -- 172.21.15.43:0/3788352832 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fed1c146a10 con 0x7fed1c0b4080 2024-04-24T23:00:29.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.139+0000 7fed241d5640 1 -- 172.21.15.43:0/3788352832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed1c04f580 con 0x7fed1c0b4080 2024-04-24T23:00:29.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.139+0000 7fed127fc640 1 -- 172.21.15.43:0/3788352832 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18518 (secure 0 0 0) 0x7fed0c016090 con 0x7fed1c0b4080 2024-04-24T23:00:29.145 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:29.145 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:20.863941+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:29.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.143+0000 7fed241d5640 1 -- 172.21.15.43:0/3788352832 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fed000678c0 msgr2=0x7fed00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.143+0000 7fed241d5640 1 --2- 172.21.15.43:0/3788352832 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fed000678c0 0x7fed00069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed180015b0 tx=0x7fed18009040 comp rx=0 tx=0).stop 2024-04-24T23:00:29.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.143+0000 7fed241d5640 1 -- 172.21.15.43:0/3788352832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed1c0b4080 msgr2=0x7fed1c1476f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.143+0000 7fed241d5640 1 --2- 172.21.15.43:0/3788352832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed1c0b4080 0x7fed1c1476f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fed0c0097c0 tx=0x7fed0c01abc0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.143+0000 7fed241d5640 1 -- 172.21.15.43:0/3788352832 shutdown_connections 2024-04-24T23:00:29.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.143+0000 7fed241d5640 1 --2- 172.21.15.43:0/3788352832 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fed000678c0 0x7fed00069d80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.143+0000 7fed241d5640 1 --2- 172.21.15.43:0/3788352832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1c14aef0 0x7fed1c144100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.143+0000 7fed241d5640 1 --2- 172.21.15.43:0/3788352832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed1c0b4080 0x7fed1c1476f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.143+0000 7fed241d5640 1 --2- 172.21.15.43:0/3788352832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1c0b1f80 0x7fed1c1464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.143+0000 7fed241d5640 1 -- 172.21.15.43:0/3788352832 >> 172.21.15.43:0/3788352832 conn(0x7fed1c0b5690 msgr2=0x7fed1c0ae710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.143+0000 7fed241d5640 1 -- 172.21.15.43:0/3788352832 shutdown_connections 2024-04-24T23:00:29.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.143+0000 7fed241d5640 1 -- 172.21.15.43:0/3788352832 wait complete. 2024-04-24T23:00:29.165 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:00:02.322280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:00:14.136303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:00:14.764010+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T23:00:18.504756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:00:29.165 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:00:29.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.283+0000 7f3160d57640 1 Processor -- start 2024-04-24T23:00:29.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.283+0000 7f3160d57640 1 -- start start 2024-04-24T23:00:29.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.283+0000 7f3160d57640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f315c148630 0x7f315c1451b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.283+0000 7f3160d57640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c0b06e0 con 0x7f315c0b4cb0 2024-04-24T23:00:29.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.283+0000 7f3160d57640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c0b0440 con 0x7f315c0b28a0 2024-04-24T23:00:29.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.283+0000 7f3160d57640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f315c0b2380 con 0x7f315c148630 2024-04-24T23:00:29.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.283+0000 7f315ad9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f315c148630 0x7f315c1451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.283+0000 7f315a59c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f315c0b4cb0 0x7f315c147f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46318/0 (socket says 172.21.15.43:46318) 2024-04-24T23:00:29.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.283+0000 7f315ad9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f315c148630 0x7f315c1451b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57342/0 (socket says 172.21.15.43:57342) 2024-04-24T23:00:29.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.283+0000 7f315a59c640 1 -- 172.21.15.43:0/2105640886 learned_addr learned my addr 172.21.15.43:0/2105640886 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:29.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.283+0000 7f315ad9d640 1 -- 172.21.15.43:0/2105640886 >> v1:172.21.15.162:6789/0 conn(0x7f315c0b28a0 legacy=0x7f315c144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.283+0000 7f315ad9d640 1 -- 172.21.15.43:0/2105640886 >> v1:172.21.15.43:6789/0 conn(0x7f315c0b4cb0 legacy=0x7f315c147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.283+0000 7f315ad9d640 1 -- 172.21.15.43:0/2105640886 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c0b5090 con 0x7f315c148630 2024-04-24T23:00:29.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f315ad9d640 1 --2- 172.21.15.43:0/2105640886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f315c148630 0x7f315c1451b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f31540097c0 tx=0x7f315401c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e7e83a2edf73d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f315959a640 1 -- 172.21.15.43:0/2105640886 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31540b0070 con 0x7f315c148630 2024-04-24T23:00:29.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f315959a640 1 -- 172.21.15.43:0/2105640886 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31540ab600 con 0x7f315c148630 2024-04-24T23:00:29.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f315959a640 1 -- 172.21.15.43:0/2105640886 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31540ab9d0 con 0x7f315c148630 2024-04-24T23:00:29.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3160d57640 1 -- 172.21.15.43:0/2105640886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f315c148630 msgr2=0x7f315c1451b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3160d57640 1 --2- 172.21.15.43:0/2105640886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f315c148630 0x7f315c1451b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f31540097c0 tx=0x7f315401c350 comp rx=0 tx=0).stop 2024-04-24T23:00:29.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3160d57640 1 -- 172.21.15.43:0/2105640886 shutdown_connections 2024-04-24T23:00:29.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3160d57640 1 --2- 172.21.15.43:0/2105640886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f315c148630 0x7f315c1451b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3160d57640 1 -- 172.21.15.43:0/2105640886 >> 172.21.15.43:0/2105640886 conn(0x7f315c0b8f40 msgr2=0x7f315c0b9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3160d57640 1 -- 172.21.15.43:0/2105640886 shutdown_connections 2024-04-24T23:00:29.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3160d57640 1 -- 172.21.15.43:0/2105640886 wait complete. 2024-04-24T23:00:29.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3160d57640 1 Processor -- start 2024-04-24T23:00:29.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3160d57640 1 -- start start 2024-04-24T23:00:29.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3160d57640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c0b4cb0 0x7f315c145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3160d57640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f315c148630 0x7f315c1e04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3160d57640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f315c145e90 0x7f315c1e0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3160d57640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f315c0b4150 con 0x7f315c148630 2024-04-24T23:00:29.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3160d57640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f315c0b2130 con 0x7f315c145e90 2024-04-24T23:00:29.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3160d57640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f315c0b42d0 con 0x7f315c0b4cb0 2024-04-24T23:00:29.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3159d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f315c148630 0x7f315c1e04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3159d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f315c148630 0x7f315c1e04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57356/0 (socket says 172.21.15.43:57356) 2024-04-24T23:00:29.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3159d9b640 1 -- 172.21.15.43:0/1726207443 learned_addr learned my addr 172.21.15.43:0/1726207443 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:29.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f315a59c640 1 --2- 172.21.15.43:0/1726207443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c0b4cb0 0x7f315c145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f315ad9d640 1 --2- 172.21.15.43:0/1726207443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f315c145e90 0x7f315c1e0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3159d9b640 1 -- 172.21.15.43:0/1726207443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c0b4cb0 msgr2=0x7f315c145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3159d9b640 1 --2- 172.21.15.43:0/1726207443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c0b4cb0 0x7f315c145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3159d9b640 1 -- 172.21.15.43:0/1726207443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f315c145e90 msgr2=0x7f315c1e0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3159d9b640 1 --2- 172.21.15.43:0/1726207443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f315c145e90 0x7f315c1e0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3159d9b640 1 -- 172.21.15.43:0/1726207443 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c152390 con 0x7f315c148630 2024-04-24T23:00:29.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.287+0000 7f3159d9b640 1 --2- 172.21.15.43:0/1726207443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f315c148630 0x7f315c1e04c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f315000c430 tx=0x7f315000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.291+0000 7f314affd640 1 -- 172.21.15.43:0/1726207443 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31500052d0 con 0x7f315c148630 2024-04-24T23:00:29.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.291+0000 7f314affd640 1 -- 172.21.15.43:0/1726207443 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3150005470 con 0x7f315c148630 2024-04-24T23:00:29.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.291+0000 7f3160d57640 1 -- 172.21.15.43:0/1726207443 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315c13f780 con 0x7f315c148630 2024-04-24T23:00:29.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.291+0000 7f314affd640 1 -- 172.21.15.43:0/1726207443 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150007260 con 0x7f315c148630 2024-04-24T23:00:29.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.291+0000 7f3160d57640 1 -- 172.21.15.43:0/1726207443 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315c152600 con 0x7f315c148630 2024-04-24T23:00:29.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.291+0000 7f3160d57640 1 -- 172.21.15.43:0/1726207443 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315c04f580 con 0x7f315c148630 2024-04-24T23:00:29.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.291+0000 7f314affd640 1 -- 172.21.15.43:0/1726207443 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3150007400 con 0x7f315c148630 2024-04-24T23:00:29.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.291+0000 7f314affd640 1 --2- 172.21.15.43:0/1726207443 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f313c0678c0 0x7f313c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.291+0000 7f314affd640 1 -- 172.21.15.43:0/1726207443 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f31500853f0 con 0x7f315c148630 2024-04-24T23:00:29.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.291+0000 7f315a59c640 1 --2- 172.21.15.43:0/1726207443 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f313c0678c0 0x7f313c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.291+0000 7f315a59c640 1 --2- 172.21.15.43:0/1726207443 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f313c0678c0 0x7f313c069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f314c0012f0 tx=0x7f314c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.295+0000 7f314affd640 1 -- 172.21.15.43:0/1726207443 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3150055c80 con 0x7f315c148630 2024-04-24T23:00:29.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.459+0000 7f3160d57640 1 -- 172.21.15.43:0/1726207443 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f315c0b2510 con 0x7f315c148630 2024-04-24T23:00:29.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.459+0000 7f314affd640 1 -- 172.21.15.43:0/1726207443 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f3150055580 con 0x7f315c148630 2024-04-24T23:00:29.464 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-24T23:00:29.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.459+0000 7f3160d57640 1 -- 172.21.15.43:0/1726207443 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f313c0678c0 msgr2=0x7f313c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.459+0000 7f3160d57640 1 --2- 172.21.15.43:0/1726207443 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f313c0678c0 0x7f313c069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f314c0012f0 tx=0x7f314c009040 comp rx=0 tx=0).stop 2024-04-24T23:00:29.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.459+0000 7f3160d57640 1 -- 172.21.15.43:0/1726207443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f315c148630 msgr2=0x7f315c1e04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.459+0000 7f3160d57640 1 --2- 172.21.15.43:0/1726207443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f315c148630 0x7f315c1e04c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f315000c430 tx=0x7f315000c8f0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.459+0000 7f3160d57640 1 -- 172.21.15.43:0/1726207443 shutdown_connections 2024-04-24T23:00:29.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.459+0000 7f3160d57640 1 --2- 172.21.15.43:0/1726207443 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f313c0678c0 0x7f313c069d80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.459+0000 7f3160d57640 1 --2- 172.21.15.43:0/1726207443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f315c145e90 0x7f315c1e0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.459+0000 7f3160d57640 1 --2- 172.21.15.43:0/1726207443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f315c148630 0x7f315c1e04c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.459+0000 7f3160d57640 1 --2- 172.21.15.43:0/1726207443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f315c0b4cb0 0x7f315c145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.459+0000 7f3160d57640 1 -- 172.21.15.43:0/1726207443 >> 172.21.15.43:0/1726207443 conn(0x7f315c0b8f40 msgr2=0x7f315c074170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.459+0000 7f3160d57640 1 -- 172.21.15.43:0/1726207443 shutdown_connections 2024-04-24T23:00:29.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.459+0000 7f3160d57640 1 -- 172.21.15.43:0/1726207443 wait complete. 2024-04-24T23:00:29.482 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:00:29.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.603+0000 7f67397b8640 1 Processor -- start 2024-04-24T23:00:29.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.603+0000 7f67397b8640 1 -- start start 2024-04-24T23:00:29.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.603+0000 7f67397b8640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f67340b2500 0x7f6734145450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.603+0000 7f67397b8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f673413f900 0x7f673414fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.603+0000 7f67397b8640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6734070060 con 0x7f6734145990 2024-04-24T23:00:29.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.603+0000 7f67397b8640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f67340b28e0 con 0x7f67340b2500 2024-04-24T23:00:29.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.603+0000 7f67397b8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f67340af8f0 con 0x7f673413f900 2024-04-24T23:00:29.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.603+0000 7f67327fc640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6734145990 0x7f673413f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46320/0 (socket says 172.21.15.43:46320) 2024-04-24T23:00:29.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.603+0000 7f67327fc640 1 -- 172.21.15.43:0/2702216273 learned_addr learned my addr 172.21.15.43:0/2702216273 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:29.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.603+0000 7f6732ffd640 1 --2- 172.21.15.43:0/2702216273 >> v2:172.21.15.43:3300/0 conn(0x7f67340b2500 0x7f6734145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f67337fe640 1 --2- 172.21.15.43:0/2702216273 >> v2:172.21.15.162:3300/0 conn(0x7f673413f900 0x7f673414fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f6731ffb640 1 -- 172.21.15.43:0/2702216273 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776394232 0 0) 0x7f6734070060 con 0x7f6734145990 2024-04-24T23:00:29.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f6731ffb640 1 -- 172.21.15.43:0/2702216273 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6720003530 con 0x7f6734145990 2024-04-24T23:00:29.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f6732ffd640 1 -- 172.21.15.43:0/2702216273 >> v2:172.21.15.162:3300/0 conn(0x7f673413f900 msgr2=0x7f673414fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f6732ffd640 1 --2- 172.21.15.43:0/2702216273 >> v2:172.21.15.162:3300/0 conn(0x7f673413f900 0x7f673414fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f6732ffd640 1 -- 172.21.15.43:0/2702216273 >> v1:172.21.15.43:6789/0 conn(0x7f6734145990 legacy=0x7f673413f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f6732ffd640 1 -- 172.21.15.43:0/2702216273 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673406fb40 con 0x7f67340b2500 2024-04-24T23:00:29.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f67337fe640 1 --2- 172.21.15.43:0/2702216273 >> v2:172.21.15.162:3300/0 conn(0x7f673413f900 0x7f673414fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:29.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f6732ffd640 1 --2- 172.21.15.43:0/2702216273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67340b2500 0x7f6734145450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f67340b4a80 tx=0x7f672401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8f5dfb528ca40a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f6731ffb640 1 -- 172.21.15.43:0/2702216273 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67240b0070 con 0x7f67340b2500 2024-04-24T23:00:29.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f6731ffb640 1 -- 172.21.15.43:0/2702216273 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67240ab600 con 0x7f67340b2500 2024-04-24T23:00:29.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f6731ffb640 1 -- 172.21.15.43:0/2702216273 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67240ab9d0 con 0x7f67340b2500 2024-04-24T23:00:29.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f67397b8640 1 -- 172.21.15.43:0/2702216273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67340b2500 msgr2=0x7f6734145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f67397b8640 1 --2- 172.21.15.43:0/2702216273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67340b2500 0x7f6734145450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f67340b4a80 tx=0x7f672401c480 comp rx=0 tx=0).stop 2024-04-24T23:00:29.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f67397b8640 1 -- 172.21.15.43:0/2702216273 shutdown_connections 2024-04-24T23:00:29.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f67397b8640 1 --2- 172.21.15.43:0/2702216273 >> v2:172.21.15.162:3300/0 conn(0x7f673413f900 0x7f673414fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f67397b8640 1 --2- 172.21.15.43:0/2702216273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67340b2500 0x7f6734145450 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f67397b8640 1 -- 172.21.15.43:0/2702216273 >> 172.21.15.43:0/2702216273 conn(0x7f67340b5690 msgr2=0x7f67340b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f67397b8640 1 -- 172.21.15.43:0/2702216273 shutdown_connections 2024-04-24T23:00:29.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.607+0000 7f67397b8640 1 -- 172.21.15.43:0/2702216273 wait complete. 2024-04-24T23:00:29.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f67397b8640 1 Processor -- start 2024-04-24T23:00:29.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f67397b8640 1 -- start start 2024-04-24T23:00:29.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f67397b8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67340b2500 0x7f6734147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f67397b8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f673413f900 0x7f673413b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f67397b8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6734145990 0x7f673413a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f67397b8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f67340b54a0 con 0x7f67340b2500 2024-04-24T23:00:29.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f67397b8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f67340b4d00 con 0x7f6734145990 2024-04-24T23:00:29.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f67397b8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6734152a50 con 0x7f673413f900 2024-04-24T23:00:29.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f6732ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67340b2500 0x7f6734147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f6732ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67340b2500 0x7f6734147a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57386/0 (socket says 172.21.15.43:57386) 2024-04-24T23:00:29.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f6732ffd640 1 -- 172.21.15.43:0/48001323 learned_addr learned my addr 172.21.15.43:0/48001323 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:29.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f67327fc640 1 --2- 172.21.15.43:0/48001323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f673413f900 0x7f673413b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f67337fe640 1 --2- 172.21.15.43:0/48001323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6734145990 0x7f673413a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f6732ffd640 1 -- 172.21.15.43:0/48001323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f673413f900 msgr2=0x7f673413b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f6732ffd640 1 --2- 172.21.15.43:0/48001323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f673413f900 0x7f673413b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f6732ffd640 1 -- 172.21.15.43:0/48001323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6734145990 msgr2=0x7f673413a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f6732ffd640 1 --2- 172.21.15.43:0/48001323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6734145990 0x7f673413a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f6732ffd640 1 -- 172.21.15.43:0/48001323 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6734140920 con 0x7f67340b2500 2024-04-24T23:00:29.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f67337fe640 1 --2- 172.21.15.43:0/48001323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6734145990 0x7f673413a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:29.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f6732ffd640 1 --2- 172.21.15.43:0/48001323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67340b2500 0x7f6734147a80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f67240ae040 tx=0x7f6724019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f672b7fe640 1 -- 172.21.15.43:0/48001323 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67240b0040 con 0x7f67340b2500 2024-04-24T23:00:29.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f672b7fe640 1 -- 172.21.15.43:0/48001323 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67240b9070 con 0x7f67340b2500 2024-04-24T23:00:29.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f67397b8640 1 -- 172.21.15.43:0/48001323 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6734140c00 con 0x7f67340b2500 2024-04-24T23:00:29.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f672b7fe640 1 -- 172.21.15.43:0/48001323 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6724006e20 con 0x7f67340b2500 2024-04-24T23:00:29.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f67397b8640 1 -- 172.21.15.43:0/48001323 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6734148850 con 0x7f67340b2500 2024-04-24T23:00:29.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f67397b8640 1 -- 172.21.15.43:0/48001323 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f673404f580 con 0x7f67340b2500 2024-04-24T23:00:29.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f672b7fe640 1 -- 172.21.15.43:0/48001323 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f67240b4690 con 0x7f67340b2500 2024-04-24T23:00:29.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.611+0000 7f672b7fe640 1 --2- 172.21.15.43:0/48001323 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f67140678c0 0x7f6714069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.615+0000 7f67327fc640 1 --2- 172.21.15.43:0/48001323 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f67140678c0 0x7f6714069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.615+0000 7f672b7fe640 1 -- 172.21.15.43:0/48001323 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f672411fc00 con 0x7f67340b2500 2024-04-24T23:00:29.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.615+0000 7f67327fc640 1 --2- 172.21.15.43:0/48001323 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f67140678c0 0x7f6714069d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f671c007fd0 tx=0x7f671c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.619+0000 7f672b7fe640 1 -- 172.21.15.43:0/48001323 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f6724126080 con 0x7f67340b2500 2024-04-24T23:00:29.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.775+0000 7f67397b8640 1 -- 172.21.15.43:0/48001323 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f67341396e0 con 0x7f67340b2500 2024-04-24T23:00:29.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.779+0000 7f672b7fe640 1 -- 172.21.15.43:0/48001323 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f6724016070 con 0x7f67340b2500 2024-04-24T23:00:29.783 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-24T23:00:29.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.779+0000 7f67397b8640 1 -- 172.21.15.43:0/48001323 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f67140678c0 msgr2=0x7f6714069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.779+0000 7f67397b8640 1 --2- 172.21.15.43:0/48001323 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f67140678c0 0x7f6714069d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f671c007fd0 tx=0x7f671c009040 comp rx=0 tx=0).stop 2024-04-24T23:00:29.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.779+0000 7f67397b8640 1 -- 172.21.15.43:0/48001323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67340b2500 msgr2=0x7f6734147a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.779+0000 7f67397b8640 1 --2- 172.21.15.43:0/48001323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67340b2500 0x7f6734147a80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f67240ae040 tx=0x7f6724019220 comp rx=0 tx=0).stop 2024-04-24T23:00:29.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.779+0000 7f67397b8640 1 -- 172.21.15.43:0/48001323 shutdown_connections 2024-04-24T23:00:29.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.779+0000 7f67397b8640 1 --2- 172.21.15.43:0/48001323 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f67140678c0 0x7f6714069d80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.779+0000 7f67397b8640 1 --2- 172.21.15.43:0/48001323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6734145990 0x7f673413a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.779+0000 7f67397b8640 1 --2- 172.21.15.43:0/48001323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f673413f900 0x7f673413b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.779+0000 7f67397b8640 1 --2- 172.21.15.43:0/48001323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67340b2500 0x7f6734147a80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.779+0000 7f67397b8640 1 -- 172.21.15.43:0/48001323 >> 172.21.15.43:0/48001323 conn(0x7f67340b5690 msgr2=0x7f67340b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.779+0000 7f67397b8640 1 -- 172.21.15.43:0/48001323 shutdown_connections 2024-04-24T23:00:29.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.779+0000 7f67397b8640 1 -- 172.21.15.43:0/48001323 wait complete. 2024-04-24T23:00:29.801 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:00:29.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c90b6640 1 Processor -- start 2024-04-24T23:00:29.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c90b6640 1 -- start start 2024-04-24T23:00:29.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c90b6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f26c40b6310 0x7f26c409fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c90b6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f26c406ef90 0x7f26c4150060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c90b6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26c40b66f0 con 0x7f26c4073080 2024-04-24T23:00:29.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c90b6640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f26c40b5780 con 0x7f26c406ef90 2024-04-24T23:00:29.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c90b6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f26c406f540 con 0x7f26c40b6310 2024-04-24T23:00:29.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c359e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f26c406ef90 0x7f26c4150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c359e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f26c406ef90 0x7f26c4150060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57402/0 (socket says 172.21.15.43:57402) 2024-04-24T23:00:29.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c359e640 1 -- 172.21.15.43:0/2710389698 learned_addr learned my addr 172.21.15.43:0/2710389698 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:29.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c2d9d640 1 --2- 172.21.15.43:0/2710389698 >> v2:172.21.15.162:3300/0 conn(0x7f26c40b6310 0x7f26c409fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c359e640 1 -- 172.21.15.43:0/2710389698 >> v2:172.21.15.162:3300/0 conn(0x7f26c40b6310 msgr2=0x7f26c409fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c359e640 1 --2- 172.21.15.43:0/2710389698 >> v2:172.21.15.162:3300/0 conn(0x7f26c40b6310 0x7f26c409fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c359e640 1 -- 172.21.15.43:0/2710389698 >> v1:172.21.15.162:6789/0 conn(0x7f26c4073080 legacy=0x7f26c40b6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:29.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c359e640 1 -- 172.21.15.43:0/2710389698 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c406f820 con 0x7f26c406ef90 2024-04-24T23:00:29.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.919+0000 7f26c2d9d640 1 --2- 172.21.15.43:0/2710389698 >> v2:172.21.15.162:3300/0 conn(0x7f26c40b6310 0x7f26c409fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:29.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c359e640 1 --2- 172.21.15.43:0/2710389698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26c406ef90 0x7f26c4150060 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f26c4074090 tx=0x7f26bc01c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1bff5b71c3d7602 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c1d9b640 1 -- 172.21.15.43:0/2710389698 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0ac020 con 0x7f26c406ef90 2024-04-24T23:00:29.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c1d9b640 1 -- 172.21.15.43:0/2710389698 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26bc0a6410 con 0x7f26c406ef90 2024-04-24T23:00:29.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c1d9b640 1 -- 172.21.15.43:0/2710389698 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0a67e0 con 0x7f26c406ef90 2024-04-24T23:00:29.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 -- 172.21.15.43:0/2710389698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26c406ef90 msgr2=0x7f26c4150060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 --2- 172.21.15.43:0/2710389698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26c406ef90 0x7f26c4150060 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f26c4074090 tx=0x7f26bc01c740 comp rx=0 tx=0).stop 2024-04-24T23:00:29.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 -- 172.21.15.43:0/2710389698 shutdown_connections 2024-04-24T23:00:29.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 --2- 172.21.15.43:0/2710389698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26c406ef90 0x7f26c4150060 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 --2- 172.21.15.43:0/2710389698 >> v2:172.21.15.162:3300/0 conn(0x7f26c40b6310 0x7f26c409fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 -- 172.21.15.43:0/2710389698 >> 172.21.15.43:0/2710389698 conn(0x7f26c40b7880 msgr2=0x7f26c40b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:29.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 -- 172.21.15.43:0/2710389698 shutdown_connections 2024-04-24T23:00:29.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 -- 172.21.15.43:0/2710389698 wait complete. 2024-04-24T23:00:29.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 Processor -- start 2024-04-24T23:00:29.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 -- start start 2024-04-24T23:00:29.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26c406ef90 0x7f26c4135fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26c4073080 0x7f26c4136520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26c40b6310 0x7f26c41e1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f26c4152f40 con 0x7f26c4073080 2024-04-24T23:00:29.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26c4152dc0 con 0x7f26c40b6310 2024-04-24T23:00:29.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c90b6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f26c41530c0 con 0x7f26c406ef90 2024-04-24T23:00:29.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26c4073080 0x7f26c4136520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26c4073080 0x7f26c4136520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57418/0 (socket says 172.21.15.43:57418) 2024-04-24T23:00:29.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c259c640 1 -- 172.21.15.43:0/1641907680 learned_addr learned my addr 172.21.15.43:0/1641907680 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:29.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c359e640 1 --2- 172.21.15.43:0/1641907680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26c40b6310 0x7f26c41e1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c2d9d640 1 --2- 172.21.15.43:0/1641907680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26c406ef90 0x7f26c4135fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c259c640 1 -- 172.21.15.43:0/1641907680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26c406ef90 msgr2=0x7f26c4135fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c259c640 1 --2- 172.21.15.43:0/1641907680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26c406ef90 0x7f26c4135fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c259c640 1 -- 172.21.15.43:0/1641907680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26c40b6310 msgr2=0x7f26c41e1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:29.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c259c640 1 --2- 172.21.15.43:0/1641907680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26c40b6310 0x7f26c41e1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:29.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c259c640 1 -- 172.21.15.43:0/1641907680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c4136a60 con 0x7f26c4073080 2024-04-24T23:00:29.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26c259c640 1 --2- 172.21.15.43:0/1641907680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26c4073080 0x7f26c4136520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f26b800c450 tx=0x7f26b800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26ab7fe640 1 -- 172.21.15.43:0/1641907680 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b8012830 con 0x7f26c4073080 2024-04-24T23:00:29.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26ab7fe640 1 -- 172.21.15.43:0/1641907680 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b8017070 con 0x7f26c4073080 2024-04-24T23:00:29.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.923+0000 7f26ab7fe640 1 -- 172.21.15.43:0/1641907680 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b8012c30 con 0x7f26c4073080 2024-04-24T23:00:29.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.927+0000 7f26c90b6640 1 -- 172.21.15.43:0/1641907680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c40b38c0 con 0x7f26c4073080 2024-04-24T23:00:29.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.927+0000 7f26c90b6640 1 -- 172.21.15.43:0/1641907680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c40b2740 con 0x7f26c4073080 2024-04-24T23:00:29.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.927+0000 7f26c90b6640 1 -- 172.21.15.43:0/1641907680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c404f580 con 0x7f26c4073080 2024-04-24T23:00:29.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.927+0000 7f26ab7fe640 1 -- 172.21.15.43:0/1641907680 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f26b801c460 con 0x7f26c4073080 2024-04-24T23:00:29.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.927+0000 7f26ab7fe640 1 --2- 172.21.15.43:0/1641907680 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f26b00678f0 0x7f26b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:29.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.927+0000 7f26c2d9d640 1 --2- 172.21.15.43:0/1641907680 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f26b00678f0 0x7f26b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:29.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.927+0000 7f26ab7fe640 1 -- 172.21.15.43:0/1641907680 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f26b8085cc0 con 0x7f26c4073080 2024-04-24T23:00:29.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.927+0000 7f26c2d9d640 1 --2- 172.21.15.43:0/1641907680 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f26b00678f0 0x7f26b0069db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f26c4139000 tx=0x7f26b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:29.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:29.931+0000 7f26ab7fe640 1 -- 172.21.15.43:0/1641907680 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f26c40b38c0 con 0x7f26c4073080 2024-04-24T23:00:30.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.091+0000 7f26c90b6640 1 -- 172.21.15.43:0/1641907680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f26c40b35e0 con 0x7f26c4073080 2024-04-24T23:00:30.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.091+0000 7f26ab7fe640 1 -- 172.21.15.43:0/1641907680 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f26b8056550 con 0x7f26c4073080 2024-04-24T23:00:30.096 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-24T23:00:30.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.091+0000 7f26c90b6640 1 -- 172.21.15.43:0/1641907680 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f26b00678f0 msgr2=0x7f26b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.091+0000 7f26c90b6640 1 --2- 172.21.15.43:0/1641907680 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f26b00678f0 0x7f26b0069db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f26c4139000 tx=0x7f26b4008040 comp rx=0 tx=0).stop 2024-04-24T23:00:30.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.091+0000 7f26c90b6640 1 -- 172.21.15.43:0/1641907680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26c4073080 msgr2=0x7f26c4136520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.091+0000 7f26c90b6640 1 --2- 172.21.15.43:0/1641907680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26c4073080 0x7f26c4136520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f26b800c450 tx=0x7f26b800c910 comp rx=0 tx=0).stop 2024-04-24T23:00:30.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.095+0000 7f26c90b6640 1 -- 172.21.15.43:0/1641907680 shutdown_connections 2024-04-24T23:00:30.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.095+0000 7f26c90b6640 1 --2- 172.21.15.43:0/1641907680 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f26b00678f0 0x7f26b0069db0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.095+0000 7f26c90b6640 1 --2- 172.21.15.43:0/1641907680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26c40b6310 0x7f26c41e1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.095+0000 7f26c90b6640 1 --2- 172.21.15.43:0/1641907680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26c4073080 0x7f26c4136520 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.095+0000 7f26c90b6640 1 --2- 172.21.15.43:0/1641907680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26c406ef90 0x7f26c4135fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.095+0000 7f26c90b6640 1 -- 172.21.15.43:0/1641907680 >> 172.21.15.43:0/1641907680 conn(0x7f26c40b7880 msgr2=0x7f26c4074170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:30.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.095+0000 7f26c90b6640 1 -- 172.21.15.43:0/1641907680 shutdown_connections 2024-04-24T23:00:30.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.095+0000 7f26c90b6640 1 -- 172.21.15.43:0/1641907680 wait complete. 2024-04-24T23:00:30.115 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:00:30.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.227+0000 7f96666f4640 1 Processor -- start 2024-04-24T23:00:30.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.227+0000 7f96666f4640 1 -- start start 2024-04-24T23:00:30.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f96666f4640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f96600afb30 0x7f966014cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f96666f4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f96600affc0 0x7f966014f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f96666f4640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96600b6ba0 con 0x7f96600b67c0 2024-04-24T23:00:30.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f96666f4640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f9660073120 con 0x7f96600afb30 2024-04-24T23:00:30.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f96666f4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f96600b6300 con 0x7f96600affc0 2024-04-24T23:00:30.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f9657fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f96600afb30 0x7f966014cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f965ffff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f96600b67c0 0x7f9660072a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46336/0 (socket says 172.21.15.43:46336) 2024-04-24T23:00:30.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f965ffff640 1 -- 172.21.15.43:0/3495714248 learned_addr learned my addr 172.21.15.43:0/3495714248 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:30.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f9664c91640 1 --2- 172.21.15.43:0/3495714248 >> v2:172.21.15.162:3300/0 conn(0x7f96600affc0 0x7f966014f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f9657fff640 1 -- 172.21.15.43:0/3495714248 >> v2:172.21.15.162:3300/0 conn(0x7f96600affc0 msgr2=0x7f966014f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:30.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f9657fff640 1 --2- 172.21.15.43:0/3495714248 >> v2:172.21.15.162:3300/0 conn(0x7f96600affc0 0x7f966014f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f9657fff640 1 -- 172.21.15.43:0/3495714248 >> v1:172.21.15.43:6789/0 conn(0x7f96600b67c0 legacy=0x7f9660072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f9657fff640 1 -- 172.21.15.43:0/3495714248 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96600af330 con 0x7f96600afb30 2024-04-24T23:00:30.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f965f7fe640 1 -- 172.21.15.43:0/3495714248 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1315203166 0 0) 0x7f96600b6ba0 con 0x7f96600b67c0 2024-04-24T23:00:30.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f9657fff640 1 --2- 172.21.15.43:0/3495714248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96600afb30 0x7f966014cbf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f96600b6480 tx=0x7f964801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e4ee3d781910b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:30.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f965f7fe640 1 -- 172.21.15.43:0/3495714248 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96480b0070 con 0x7f96600afb30 2024-04-24T23:00:30.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f965f7fe640 1 -- 172.21.15.43:0/3495714248 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96480ab600 con 0x7f96600afb30 2024-04-24T23:00:30.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.231+0000 7f965f7fe640 1 -- 172.21.15.43:0/3495714248 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96480ab9d0 con 0x7f96600afb30 2024-04-24T23:00:30.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 -- 172.21.15.43:0/3495714248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96600afb30 msgr2=0x7f966014cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 --2- 172.21.15.43:0/3495714248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96600afb30 0x7f966014cbf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f96600b6480 tx=0x7f964801c340 comp rx=0 tx=0).stop 2024-04-24T23:00:30.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 -- 172.21.15.43:0/3495714248 shutdown_connections 2024-04-24T23:00:30.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 --2- 172.21.15.43:0/3495714248 >> v2:172.21.15.162:3300/0 conn(0x7f96600affc0 0x7f966014f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 --2- 172.21.15.43:0/3495714248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96600afb30 0x7f966014cbf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 -- 172.21.15.43:0/3495714248 >> 172.21.15.43:0/3495714248 conn(0x7f96600b9b50 msgr2=0x7f96600b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:30.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 -- 172.21.15.43:0/3495714248 shutdown_connections 2024-04-24T23:00:30.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 -- 172.21.15.43:0/3495714248 wait complete. 2024-04-24T23:00:30.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 Processor -- start 2024-04-24T23:00:30.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 -- start start 2024-04-24T23:00:30.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96600afb30 0x7f9660139570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96600affc0 0x7f966013a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96600b67c0 0x7f966013b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9660147890 con 0x7f96600b67c0 2024-04-24T23:00:30.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9660070b80 con 0x7f96600affc0 2024-04-24T23:00:30.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f96600aedb0 con 0x7f96600afb30 2024-04-24T23:00:30.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f9664c91640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96600b67c0 0x7f966013b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f9664c91640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96600b67c0 0x7f966013b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57432/0 (socket says 172.21.15.43:57432) 2024-04-24T23:00:30.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f9664c91640 1 -- 172.21.15.43:0/3472407422 learned_addr learned my addr 172.21.15.43:0/3472407422 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:30.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f9657fff640 1 --2- 172.21.15.43:0/3472407422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96600affc0 0x7f966013a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f965ffff640 1 --2- 172.21.15.43:0/3472407422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96600afb30 0x7f9660139570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f9664c91640 1 -- 172.21.15.43:0/3472407422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96600afb30 msgr2=0x7f9660139570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f9664c91640 1 --2- 172.21.15.43:0/3472407422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96600afb30 0x7f9660139570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f9664c91640 1 -- 172.21.15.43:0/3472407422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96600affc0 msgr2=0x7f966013a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f9664c91640 1 --2- 172.21.15.43:0/3472407422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96600affc0 0x7f966013a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f9664c91640 1 -- 172.21.15.43:0/3472407422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96600b28a0 con 0x7f96600b67c0 2024-04-24T23:00:30.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f9664c91640 1 --2- 172.21.15.43:0/3472407422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96600b67c0 0x7f966013b0b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9658007e70 tx=0x7f965800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:30.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f965d7fa640 1 -- 172.21.15.43:0/3472407422 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658014420 con 0x7f96600b67c0 2024-04-24T23:00:30.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f965d7fa640 1 -- 172.21.15.43:0/3472407422 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9658019070 con 0x7f96600b67c0 2024-04-24T23:00:30.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 -- 172.21.15.43:0/3472407422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966013a690 con 0x7f96600b67c0 2024-04-24T23:00:30.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f965d7fa640 1 -- 172.21.15.43:0/3472407422 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658014820 con 0x7f96600b67c0 2024-04-24T23:00:30.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.235+0000 7f96666f4640 1 -- 172.21.15.43:0/3472407422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f966013a940 con 0x7f96600b67c0 2024-04-24T23:00:30.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.239+0000 7f96666f4640 1 -- 172.21.15.43:0/3472407422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9660138b10 con 0x7f96600b67c0 2024-04-24T23:00:30.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.239+0000 7f965d7fa640 1 -- 172.21.15.43:0/3472407422 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f96580149c0 con 0x7f96600b67c0 2024-04-24T23:00:30.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.239+0000 7f965d7fa640 1 --2- 172.21.15.43:0/3472407422 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f96400678c0 0x7f9640069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.239+0000 7f965d7fa640 1 -- 172.21.15.43:0/3472407422 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9658086630 con 0x7f96600b67c0 2024-04-24T23:00:30.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.239+0000 7f965ffff640 1 --2- 172.21.15.43:0/3472407422 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f96400678c0 0x7f9640069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.239+0000 7f965ffff640 1 --2- 172.21.15.43:0/3472407422 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f96400678c0 0x7f9640069d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9650000f70 tx=0x7f9650007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:30.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.243+0000 7f965d7fa640 1 -- 172.21.15.43:0/3472407422 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f96600b28a0 con 0x7f96600b67c0 2024-04-24T23:00:30.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.395+0000 7f96666f4640 1 -- 172.21.15.43:0/3472407422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f966004f580 con 0x7f96600b67c0 2024-04-24T23:00:30.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.399+0000 7f965d7fa640 1 -- 172.21.15.43:0/3472407422 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f9658056870 con 0x7f96600b67c0 2024-04-24T23:00:30.403 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-24T23:00:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.399+0000 7f96666f4640 1 -- 172.21.15.43:0/3472407422 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f96400678c0 msgr2=0x7f9640069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.399+0000 7f96666f4640 1 --2- 172.21.15.43:0/3472407422 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f96400678c0 0x7f9640069d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9650000f70 tx=0x7f9650007df0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.399+0000 7f96666f4640 1 -- 172.21.15.43:0/3472407422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96600b67c0 msgr2=0x7f966013b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.399+0000 7f96666f4640 1 --2- 172.21.15.43:0/3472407422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96600b67c0 0x7f966013b0b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9658007e70 tx=0x7f965800e4b0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.399+0000 7f96666f4640 1 -- 172.21.15.43:0/3472407422 shutdown_connections 2024-04-24T23:00:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.399+0000 7f96666f4640 1 --2- 172.21.15.43:0/3472407422 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f96400678c0 0x7f9640069d80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.399+0000 7f96666f4640 1 --2- 172.21.15.43:0/3472407422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96600b67c0 0x7f966013b0b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.399+0000 7f96666f4640 1 --2- 172.21.15.43:0/3472407422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96600affc0 0x7f966013a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.399+0000 7f96666f4640 1 --2- 172.21.15.43:0/3472407422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96600afb30 0x7f9660139570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.399+0000 7f96666f4640 1 -- 172.21.15.43:0/3472407422 >> 172.21.15.43:0/3472407422 conn(0x7f96600b9b50 msgr2=0x7f966006ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.399+0000 7f96666f4640 1 -- 172.21.15.43:0/3472407422 shutdown_connections 2024-04-24T23:00:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.399+0000 7f96666f4640 1 -- 172.21.15.43:0/3472407422 wait complete. 2024-04-24T23:00:30.420 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:00:30.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.531+0000 7fa4ff1b4640 1 Processor -- start 2024-04-24T23:00:30.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.531+0000 7fa4ff1b4640 1 -- start start 2024-04-24T23:00:30.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.531+0000 7fa4ff1b4640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa4f81443b0 0x7fa4f81434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.531+0000 7fa4ff1b4640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f80b2ed0 con 0x7fa4f80afa00 2024-04-24T23:00:30.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.531+0000 7fa4ff1b4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f80b4460 con 0x7fa4f80b4080 2024-04-24T23:00:30.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.531+0000 7fa4ff1b4640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f80b1a10 con 0x7fa4f81443b0 2024-04-24T23:00:30.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.531+0000 7fa4fd751640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa4f81443b0 0x7fa4f81434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.531+0000 7fa4f7fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa4f80afa00 0x7fa4f8142de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54420/0 (socket says 172.21.15.43:54420) 2024-04-24T23:00:30.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.531+0000 7fa4fd751640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa4f81443b0 0x7fa4f81434f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42674/0 (socket says 172.21.15.43:42674) 2024-04-24T23:00:30.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.531+0000 7fa4f7fff640 1 -- 172.21.15.43:0/352751821 learned_addr learned my addr 172.21.15.43:0/352751821 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:30.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.531+0000 7fa4fd751640 1 -- 172.21.15.43:0/352751821 >> v1:172.21.15.162:6789/0 conn(0x7fa4f80b4080 legacy=0x7fa4f8143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:30.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.531+0000 7fa4fd751640 1 -- 172.21.15.43:0/352751821 >> v1:172.21.15.43:6789/0 conn(0x7fa4f80afa00 legacy=0x7fa4f8142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.531+0000 7fa4fd751640 1 -- 172.21.15.43:0/352751821 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f80b1c60 con 0x7fa4f81443b0 2024-04-24T23:00:30.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.531+0000 7fa4f77fe640 1 -- 172.21.15.43:0/352751821 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991670149 0 0) 0x7fa4f80b2ed0 con 0x7fa4f80afa00 2024-04-24T23:00:30.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4fd751640 1 --2- 172.21.15.43:0/352751821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4f81443b0 0x7fa4f81434f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009d90 tx=0x7fa4f001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52089ce51ec7e3f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:30.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4f77fe640 1 -- 172.21.15.43:0/352751821 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00b2070 con 0x7fa4f81443b0 2024-04-24T23:00:30.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4f77fe640 1 -- 172.21.15.43:0/352751821 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f00a57e0 con 0x7fa4f81443b0 2024-04-24T23:00:30.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4f77fe640 1 -- 172.21.15.43:0/352751821 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00a5bb0 con 0x7fa4f81443b0 2024-04-24T23:00:30.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 -- 172.21.15.43:0/352751821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4f81443b0 msgr2=0x7fa4f81434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 --2- 172.21.15.43:0/352751821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4f81443b0 0x7fa4f81434f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009d90 tx=0x7fa4f001c8a0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 -- 172.21.15.43:0/352751821 shutdown_connections 2024-04-24T23:00:30.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 --2- 172.21.15.43:0/352751821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4f81443b0 0x7fa4f81434f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 -- 172.21.15.43:0/352751821 >> 172.21.15.43:0/352751821 conn(0x7fa4f80b5690 msgr2=0x7fa4f80b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:30.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 -- 172.21.15.43:0/352751821 shutdown_connections 2024-04-24T23:00:30.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 -- 172.21.15.43:0/352751821 wait complete. 2024-04-24T23:00:30.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 Processor -- start 2024-04-24T23:00:30.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 -- start start 2024-04-24T23:00:30.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f80afa00 0x7fa4f80aaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4f80b4080 0x7fa4f80a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4f81443b0 0x7fa4f80aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f80b3710 con 0x7fa4f80b4080 2024-04-24T23:00:30.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f80b3590 con 0x7fa4f80afa00 2024-04-24T23:00:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f80b3890 con 0x7fa4f81443b0 2024-04-24T23:00:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4f7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4f80b4080 0x7fa4f80a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4f7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4f80b4080 0x7fa4f80a9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42684/0 (socket says 172.21.15.43:42684) 2024-04-24T23:00:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4f7fff640 1 -- 172.21.15.43:0/3352526468 learned_addr learned my addr 172.21.15.43:0/3352526468 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4fd751640 1 --2- 172.21.15.43:0/3352526468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4f81443b0 0x7fa4f80aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4fcf50640 1 --2- 172.21.15.43:0/3352526468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f80afa00 0x7fa4f80aaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4f7fff640 1 -- 172.21.15.43:0/3352526468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4f81443b0 msgr2=0x7fa4f80aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4f7fff640 1 --2- 172.21.15.43:0/3352526468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4f81443b0 0x7fa4f80aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4f7fff640 1 -- 172.21.15.43:0/3352526468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f80afa00 msgr2=0x7fa4f80aaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4f7fff640 1 --2- 172.21.15.43:0/3352526468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f80afa00 0x7fa4f80aaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4f7fff640 1 -- 172.21.15.43:0/3352526468 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f80ab2c0 con 0x7fa4f80b4080 2024-04-24T23:00:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4f7fff640 1 --2- 172.21.15.43:0/3352526468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4f80b4080 0x7fa4f80a9d30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00e960 tx=0x7fa4ec00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4f57fa640 1 -- 172.21.15.43:0/3352526468 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec0072e0 con 0x7fa4f80b4080 2024-04-24T23:00:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4f57fa640 1 -- 172.21.15.43:0/3352526468 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4ec016020 con 0x7fa4f80b4080 2024-04-24T23:00:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4f57fa640 1 -- 172.21.15.43:0/3352526468 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec00c850 con 0x7fa4f80b4080 2024-04-24T23:00:30.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 -- 172.21.15.43:0/3352526468 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f8141e90 con 0x7fa4f80b4080 2024-04-24T23:00:30.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.535+0000 7fa4ff1b4640 1 -- 172.21.15.43:0/3352526468 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f80aa270 con 0x7fa4f80b4080 2024-04-24T23:00:30.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.539+0000 7fa4ff1b4640 1 -- 172.21.15.43:0/3352526468 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f804f580 con 0x7fa4f80b4080 2024-04-24T23:00:30.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.539+0000 7fa4f57fa640 1 -- 172.21.15.43:0/3352526468 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4ec00c9f0 con 0x7fa4f80b4080 2024-04-24T23:00:30.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.539+0000 7fa4f57fa640 1 --2- 172.21.15.43:0/3352526468 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa4e40678f0 0x7fa4e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:30.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.539+0000 7fa4f57fa640 1 -- 172.21.15.43:0/3352526468 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa4ec0883b0 con 0x7fa4f80b4080 2024-04-24T23:00:30.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.539+0000 7fa4fcf50640 1 --2- 172.21.15.43:0/3352526468 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa4e40678f0 0x7fa4e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:30.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.539+0000 7fa4fcf50640 1 --2- 172.21.15.43:0/3352526468 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa4e40678f0 0x7fa4e4069db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8004e30 tx=0x7fa4e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:30.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.543+0000 7fa4f57fa640 1 -- 172.21.15.43:0/3352526468 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa4ec020030 con 0x7fa4f80b4080 2024-04-24T23:00:30.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.711+0000 7fa4ff1b4640 1 -- 172.21.15.43:0/3352526468 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa4f813dd30 con 0x7fa4f80b4080 2024-04-24T23:00:30.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.711+0000 7fa4f57fa640 1 -- 172.21.15.43:0/3352526468 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fa4ec0212b0 con 0x7fa4f80b4080 2024-04-24T23:00:30.716 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2024-04-24T23:00:30.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.711+0000 7fa4ff1b4640 1 -- 172.21.15.43:0/3352526468 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa4e40678f0 msgr2=0x7fa4e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.711+0000 7fa4ff1b4640 1 --2- 172.21.15.43:0/3352526468 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa4e40678f0 0x7fa4e4069db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8004e30 tx=0x7fa4e8009040 comp rx=0 tx=0).stop 2024-04-24T23:00:30.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.711+0000 7fa4ff1b4640 1 -- 172.21.15.43:0/3352526468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4f80b4080 msgr2=0x7fa4f80a9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:30.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.711+0000 7fa4ff1b4640 1 --2- 172.21.15.43:0/3352526468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4f80b4080 0x7fa4f80a9d30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00e960 tx=0x7fa4ec00ee20 comp rx=0 tx=0).stop 2024-04-24T23:00:30.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.711+0000 7fa4ff1b4640 1 -- 172.21.15.43:0/3352526468 shutdown_connections 2024-04-24T23:00:30.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.711+0000 7fa4ff1b4640 1 --2- 172.21.15.43:0/3352526468 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa4e40678f0 0x7fa4e4069db0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.711+0000 7fa4ff1b4640 1 --2- 172.21.15.43:0/3352526468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4f81443b0 0x7fa4f80aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.711+0000 7fa4ff1b4640 1 --2- 172.21.15.43:0/3352526468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4f80b4080 0x7fa4f80a9d30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.711+0000 7fa4ff1b4640 1 --2- 172.21.15.43:0/3352526468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f80afa00 0x7fa4f80aaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:30.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.711+0000 7fa4ff1b4640 1 -- 172.21.15.43:0/3352526468 >> 172.21.15.43:0/3352526468 conn(0x7fa4f80b5690 msgr2=0x7fa4f80b69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:30.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.711+0000 7fa4ff1b4640 1 -- 172.21.15.43:0/3352526468 shutdown_connections 2024-04-24T23:00:30.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:30.711+0000 7fa4ff1b4640 1 -- 172.21.15.43:0/3352526468 wait complete. 2024-04-24T23:00:30.734 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi043.front.sepia.ceph.com... 2024-04-24T23:00:30.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:30.735 DEBUG:teuthology.orchestra.run.smithi043:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-24T23:00:30.754 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:ceph-fuse[32099]: fuse finished with error 0 and tester_r 0 2024-04-24T23:00:30.755 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:00:30.832 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-04-24T23:00:30.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:30.833 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-24T23:00:30.846 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:31.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.003+0000 7f4ef1721640 1 Processor -- start 2024-04-24T23:00:31.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.003+0000 7f4ef1721640 1 -- start start 2024-04-24T23:00:31.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.007+0000 7f4ef1721640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eec0b6130 0x7f4eec0b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.007+0000 7f4ef1721640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4eec070f00 0x7f4eec0b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.007+0000 7f4ef1721640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eec0b7090 con 0x7f4eec0b6cb0 2024-04-24T23:00:31.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.007+0000 7f4ef1721640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f4eec072670 con 0x7f4eec070f00 2024-04-24T23:00:31.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.007+0000 7f4ef1721640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4eec0728a0 con 0x7f4eec0b6130 2024-04-24T23:00:31.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.007+0000 7f4eeaffd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4eec0b6cb0 0x7f4eec141480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54424/0 (socket says 172.21.15.43:54424) 2024-04-24T23:00:31.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.007+0000 7f4eeb7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4eec070f00 0x7f4eec0b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.007+0000 7f4eeaffd640 1 -- 172.21.15.43:0/332048196 learned_addr learned my addr 172.21.15.43:0/332048196 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:31.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.007+0000 7f4eea7fc640 1 --2- 172.21.15.43:0/332048196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eec0b6130 0x7f4eec0b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.007+0000 7f4ee9ffb640 1 -- 172.21.15.43:0/332048196 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4051750846 0 0) 0x7f4eec0b7090 con 0x7f4eec0b6cb0 2024-04-24T23:00:31.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.007+0000 7f4ee9ffb640 1 -- 172.21.15.43:0/332048196 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ed4003530 con 0x7f4eec0b6cb0 2024-04-24T23:00:31.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.007+0000 7f4eeb7fe640 1 -- 172.21.15.43:0/332048196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eec0b6130 msgr2=0x7f4eec0b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:31.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.007+0000 7f4eeb7fe640 1 --2- 172.21.15.43:0/332048196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eec0b6130 0x7f4eec0b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.007+0000 7f4eeb7fe640 1 -- 172.21.15.43:0/332048196 >> v1:172.21.15.43:6789/0 conn(0x7f4eec0b6cb0 legacy=0x7f4eec141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.007+0000 7f4eeb7fe640 1 -- 172.21.15.43:0/332048196 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eec072b80 con 0x7f4eec070f00 2024-04-24T23:00:31.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4eeb7fe640 1 --2- 172.21.15.43:0/332048196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec070f00 0x7f4eec0b5430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4009d90 tx=0x7f4ee401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7c848fd3d763de server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:31.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ee9ffb640 1 -- 172.21.15.43:0/332048196 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee40b2070 con 0x7f4eec070f00 2024-04-24T23:00:31.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ee9ffb640 1 -- 172.21.15.43:0/332048196 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee40a57a0 con 0x7f4eec070f00 2024-04-24T23:00:31.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ee9ffb640 1 -- 172.21.15.43:0/332048196 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee40a5b70 con 0x7f4eec070f00 2024-04-24T23:00:31.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 -- 172.21.15.43:0/332048196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec070f00 msgr2=0x7f4eec0b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 --2- 172.21.15.43:0/332048196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec070f00 0x7f4eec0b5430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4009d90 tx=0x7f4ee401c8e0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 -- 172.21.15.43:0/332048196 shutdown_connections 2024-04-24T23:00:31.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 --2- 172.21.15.43:0/332048196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec070f00 0x7f4eec0b5430 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 --2- 172.21.15.43:0/332048196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eec0b6130 0x7f4eec0b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 -- 172.21.15.43:0/332048196 >> 172.21.15.43:0/332048196 conn(0x7f4eec06c4d0 msgr2=0x7f4eec06c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:31.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 -- 172.21.15.43:0/332048196 shutdown_connections 2024-04-24T23:00:31.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 -- 172.21.15.43:0/332048196 wait complete. 2024-04-24T23:00:31.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 Processor -- start 2024-04-24T23:00:31.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 -- start start 2024-04-24T23:00:31.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eec070f00 0x7f4eec136df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec0b6130 0x7f4eec145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4eec0b6cb0 0x7f4eec1e34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4eec154760 con 0x7f4eec0b6130 2024-04-24T23:00:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4eec073790 con 0x7f4eec0b6cb0 2024-04-24T23:00:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4eec1548e0 con 0x7f4eec070f00 2024-04-24T23:00:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4eea7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec0b6130 0x7f4eec145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4eea7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec0b6130 0x7f4eec145930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42696/0 (socket says 172.21.15.43:42696) 2024-04-24T23:00:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4eea7fc640 1 -- 172.21.15.43:0/788672436 learned_addr learned my addr 172.21.15.43:0/788672436 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4eeb7fe640 1 --2- 172.21.15.43:0/788672436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4eec0b6cb0 0x7f4eec1e34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4eeaffd640 1 --2- 172.21.15.43:0/788672436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eec070f00 0x7f4eec136df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4eea7fc640 1 -- 172.21.15.43:0/788672436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eec070f00 msgr2=0x7f4eec136df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4eea7fc640 1 --2- 172.21.15.43:0/788672436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eec070f00 0x7f4eec136df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4eea7fc640 1 -- 172.21.15.43:0/788672436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4eec0b6cb0 msgr2=0x7f4eec1e34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4eea7fc640 1 --2- 172.21.15.43:0/788672436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4eec0b6cb0 0x7f4eec1e34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4eea7fc640 1 -- 172.21.15.43:0/788672436 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eec13a290 con 0x7f4eec0b6130 2024-04-24T23:00:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4eea7fc640 1 --2- 172.21.15.43:0/788672436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec0b6130 0x7f4eec145930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000d830 tx=0x7f4ee000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ed37fe640 1 -- 172.21.15.43:0/788672436 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee000b6c0 con 0x7f4eec0b6130 2024-04-24T23:00:31.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ed37fe640 1 -- 172.21.15.43:0/788672436 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee0019070 con 0x7f4eec0b6130 2024-04-24T23:00:31.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 -- 172.21.15.43:0/788672436 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eec146f20 con 0x7f4eec0b6130 2024-04-24T23:00:31.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ed37fe640 1 -- 172.21.15.43:0/788672436 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee000bae0 con 0x7f4eec0b6130 2024-04-24T23:00:31.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.011+0000 7f4ef1721640 1 -- 172.21.15.43:0/788672436 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eec139f40 con 0x7f4eec0b6130 2024-04-24T23:00:31.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.015+0000 7f4ef1721640 1 -- 172.21.15.43:0/788672436 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eec13abb0 con 0x7f4eec0b6130 2024-04-24T23:00:31.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.015+0000 7f4ed37fe640 1 -- 172.21.15.43:0/788672436 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4ee000bc80 con 0x7f4eec0b6130 2024-04-24T23:00:31.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.015+0000 7f4ed37fe640 1 --2- 172.21.15.43:0/788672436 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4ed80678c0 0x7f4ed8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.015+0000 7f4ed37fe640 1 -- 172.21.15.43:0/788672436 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4ee00864a0 con 0x7f4eec0b6130 2024-04-24T23:00:31.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.015+0000 7f4eeaffd640 1 --2- 172.21.15.43:0/788672436 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4ed80678c0 0x7f4ed8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.015+0000 7f4eeaffd640 1 --2- 172.21.15.43:0/788672436 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4ed80678c0 0x7f4ed8069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4edc005890 tx=0x7f4edc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:31.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.019+0000 7f4ed37fe640 1 -- 172.21.15.43:0/788672436 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f4ee0056d30 con 0x7f4eec0b6130 2024-04-24T23:00:31.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.175+0000 7f4ef1721640 1 -- 172.21.15.43:0/788672436 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4eec04f580 con 0x7f4eec0b6130 2024-04-24T23:00:31.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.175+0000 7f4ed37fe640 1 -- 172.21.15.43:0/788672436 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18518 (secure 0 0 0) 0x7f4ee0056630 con 0x7f4eec0b6130 2024-04-24T23:00:31.182 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:31.182 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:20.863941+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:31.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.179+0000 7f4ef1721640 1 -- 172.21.15.43:0/788672436 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4ed80678c0 msgr2=0x7f4ed8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.179+0000 7f4ef1721640 1 --2- 172.21.15.43:0/788672436 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4ed80678c0 0x7f4ed8069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4edc005890 tx=0x7f4edc009040 comp rx=0 tx=0).stop 2024-04-24T23:00:31.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.179+0000 7f4ef1721640 1 -- 172.21.15.43:0/788672436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec0b6130 msgr2=0x7f4eec145930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.179+0000 7f4ef1721640 1 --2- 172.21.15.43:0/788672436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec0b6130 0x7f4eec145930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000d830 tx=0x7f4ee000dcf0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.179+0000 7f4ef1721640 1 -- 172.21.15.43:0/788672436 shutdown_connections 2024-04-24T23:00:31.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.179+0000 7f4ef1721640 1 --2- 172.21.15.43:0/788672436 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4ed80678c0 0x7f4ed8069d80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.179+0000 7f4ef1721640 1 --2- 172.21.15.43:0/788672436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4eec0b6cb0 0x7f4eec1e34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.179+0000 7f4ef1721640 1 --2- 172.21.15.43:0/788672436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec0b6130 0x7f4eec145930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.179+0000 7f4ef1721640 1 --2- 172.21.15.43:0/788672436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eec070f00 0x7f4eec136df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.179+0000 7f4ef1721640 1 -- 172.21.15.43:0/788672436 >> 172.21.15.43:0/788672436 conn(0x7f4eec06c4d0 msgr2=0x7f4eec13bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:31.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.179+0000 7f4ef1721640 1 -- 172.21.15.43:0/788672436 shutdown_connections 2024-04-24T23:00:31.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.179+0000 7f4ef1721640 1 -- 172.21.15.43:0/788672436 wait complete. 2024-04-24T23:00:31.201 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:31.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.307+0000 7f21684b2640 1 Processor -- start 2024-04-24T23:00:31.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.307+0000 7f21684b2640 1 -- start start 2024-04-24T23:00:31.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.307+0000 7f21684b2640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f216014b360 0x7f21600b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.307+0000 7f21684b2640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21600bdc50 con 0x7f21600b9590 2024-04-24T23:00:31.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.307+0000 7f21684b2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21600b5740 con 0x7f21600bd870 2024-04-24T23:00:31.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.307+0000 7f21684b2640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f21600b5a20 con 0x7f216014b360 2024-04-24T23:00:31.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.307+0000 7f2166a4f640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f216014b360 0x7f21600b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.307+0000 7f2165a4d640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f21600b9590 0x7f21601411c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54434/0 (socket says 172.21.15.43:54434) 2024-04-24T23:00:31.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.307+0000 7f2165a4d640 1 -- 172.21.15.43:0/2989077255 learned_addr learned my addr 172.21.15.43:0/2989077255 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:31.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.307+0000 7f2166a4f640 1 -- 172.21.15.43:0/2989077255 >> v1:172.21.15.162:6789/0 conn(0x7f21600bd870 legacy=0x7f216014ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:31.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.307+0000 7f2166a4f640 1 -- 172.21.15.43:0/2989077255 >> v1:172.21.15.43:6789/0 conn(0x7f21600b9590 legacy=0x7f21601411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.307+0000 7f216524c640 1 -- 172.21.15.43:0/2989077255 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3185158120 0 0) 0x7f21600bdc50 con 0x7f21600b9590 2024-04-24T23:00:31.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.307+0000 7f2166a4f640 1 -- 172.21.15.43:0/2989077255 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21600b5d00 con 0x7f216014b360 2024-04-24T23:00:31.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.311+0000 7f2166a4f640 1 --2- 172.21.15.43:0/2989077255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f216014b360 0x7f21600b49d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f21580097c0 tx=0x7f215801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256f76505bc3ccd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:31.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.311+0000 7f216524c640 1 -- 172.21.15.43:0/2989077255 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21580b0070 con 0x7f216014b360 2024-04-24T23:00:31.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.311+0000 7f216524c640 1 -- 172.21.15.43:0/2989077255 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21580ab600 con 0x7f216014b360 2024-04-24T23:00:31.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.311+0000 7f216524c640 1 -- 172.21.15.43:0/2989077255 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21580ab9d0 con 0x7f216014b360 2024-04-24T23:00:31.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.311+0000 7f21684b2640 1 -- 172.21.15.43:0/2989077255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f216014b360 msgr2=0x7f21600b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.311+0000 7f21684b2640 1 --2- 172.21.15.43:0/2989077255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f216014b360 0x7f21600b49d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f21580097c0 tx=0x7f215801c3d0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.311+0000 7f21684b2640 1 -- 172.21.15.43:0/2989077255 shutdown_connections 2024-04-24T23:00:31.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.311+0000 7f21684b2640 1 --2- 172.21.15.43:0/2989077255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f216014b360 0x7f21600b49d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.311+0000 7f21684b2640 1 -- 172.21.15.43:0/2989077255 >> 172.21.15.43:0/2989077255 conn(0x7f2160072f20 msgr2=0x7f21600bcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:31.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.311+0000 7f21684b2640 1 -- 172.21.15.43:0/2989077255 shutdown_connections 2024-04-24T23:00:31.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.311+0000 7f21684b2640 1 -- 172.21.15.43:0/2989077255 wait complete. 2024-04-24T23:00:31.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.311+0000 7f21684b2640 1 Processor -- start 2024-04-24T23:00:31.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.311+0000 7f21684b2640 1 -- start start 2024-04-24T23:00:31.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f21684b2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21600bd870 0x7f2160142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f21684b2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f216014b360 0x7f21601434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f21684b2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2160149870 0x7f2160148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f21684b2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2160155d10 con 0x7f2160149870 2024-04-24T23:00:31.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f21684b2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2160155b90 con 0x7f216014b360 2024-04-24T23:00:31.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f21684b2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2160155e90 con 0x7f21600bd870 2024-04-24T23:00:31.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2166a4f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2160149870 0x7f2160148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2166a4f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2160149870 0x7f2160148770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42710/0 (socket says 172.21.15.43:42710) 2024-04-24T23:00:31.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2166a4f640 1 -- 172.21.15.43:0/564480314 learned_addr learned my addr 172.21.15.43:0/564480314 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:31.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f216624e640 1 --2- 172.21.15.43:0/564480314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21600bd870 0x7f2160142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2165a4d640 1 --2- 172.21.15.43:0/564480314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f216014b360 0x7f21601434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2166a4f640 1 -- 172.21.15.43:0/564480314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21600bd870 msgr2=0x7f2160142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2166a4f640 1 --2- 172.21.15.43:0/564480314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21600bd870 0x7f2160142920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2166a4f640 1 -- 172.21.15.43:0/564480314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f216014b360 msgr2=0x7f21601434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2166a4f640 1 --2- 172.21.15.43:0/564480314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f216014b360 0x7f21601434a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2166a4f640 1 -- 172.21.15.43:0/564480314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21601439e0 con 0x7f2160149870 2024-04-24T23:00:31.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2166a4f640 1 --2- 172.21.15.43:0/564480314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2160149870 0x7f2160148770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f215801aa80 tx=0x7f215801ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:31.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2156ffd640 1 -- 172.21.15.43:0/564480314 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21580b0050 con 0x7f2160149870 2024-04-24T23:00:31.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2156ffd640 1 -- 172.21.15.43:0/564480314 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21580bc070 con 0x7f2160149870 2024-04-24T23:00:31.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2156ffd640 1 -- 172.21.15.43:0/564480314 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21580b5830 con 0x7f2160149870 2024-04-24T23:00:31.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f21684b2640 1 -- 172.21.15.43:0/564480314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2160143c70 con 0x7f2160149870 2024-04-24T23:00:31.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f21684b2640 1 -- 172.21.15.43:0/564480314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2160144230 con 0x7f2160149870 2024-04-24T23:00:31.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f21684b2640 1 -- 172.21.15.43:0/564480314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2160137de0 con 0x7f2160149870 2024-04-24T23:00:31.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2156ffd640 1 -- 172.21.15.43:0/564480314 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f21580b59d0 con 0x7f2160149870 2024-04-24T23:00:31.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2156ffd640 1 --2- 172.21.15.43:0/564480314 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f21440678c0 0x7f2144069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f2156ffd640 1 -- 172.21.15.43:0/564480314 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2158120750 con 0x7f2160149870 2024-04-24T23:00:31.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f216624e640 1 --2- 172.21.15.43:0/564480314 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f21440678c0 0x7f2144069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.315+0000 7f216624e640 1 --2- 172.21.15.43:0/564480314 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f21440678c0 0x7f2144069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f215c0012f0 tx=0x7f215c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:31.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.319+0000 7f2156ffd640 1 -- 172.21.15.43:0/564480314 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f2160137de0 con 0x7f2160149870 2024-04-24T23:00:31.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.487+0000 7f21684b2640 1 -- 172.21.15.43:0/564480314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f216004f580 con 0x7f2160149870 2024-04-24T23:00:31.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.491+0000 7f2156ffd640 1 -- 172.21.15.43:0/564480314 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18518 (secure 0 0 0) 0x7f21580f5e20 con 0x7f2160149870 2024-04-24T23:00:31.495 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:31.495 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:20.863941+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.491+0000 7f21684b2640 1 -- 172.21.15.43:0/564480314 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f21440678c0 msgr2=0x7f2144069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.491+0000 7f21684b2640 1 --2- 172.21.15.43:0/564480314 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f21440678c0 0x7f2144069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f215c0012f0 tx=0x7f215c009040 comp rx=0 tx=0).stop 2024-04-24T23:00:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.491+0000 7f21684b2640 1 -- 172.21.15.43:0/564480314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2160149870 msgr2=0x7f2160148770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.491+0000 7f21684b2640 1 --2- 172.21.15.43:0/564480314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2160149870 0x7f2160148770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f215801aa80 tx=0x7f215801ac10 comp rx=0 tx=0).stop 2024-04-24T23:00:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.491+0000 7f21684b2640 1 -- 172.21.15.43:0/564480314 shutdown_connections 2024-04-24T23:00:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.491+0000 7f21684b2640 1 --2- 172.21.15.43:0/564480314 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f21440678c0 0x7f2144069d80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.491+0000 7f21684b2640 1 --2- 172.21.15.43:0/564480314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2160149870 0x7f2160148770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.491+0000 7f21684b2640 1 --2- 172.21.15.43:0/564480314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f216014b360 0x7f21601434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.491+0000 7f21684b2640 1 --2- 172.21.15.43:0/564480314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21600bd870 0x7f2160142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.491+0000 7f21684b2640 1 -- 172.21.15.43:0/564480314 >> 172.21.15.43:0/564480314 conn(0x7f2160072f20 msgr2=0x7f21600b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:31.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.491+0000 7f21684b2640 1 -- 172.21.15.43:0/564480314 shutdown_connections 2024-04-24T23:00:31.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.491+0000 7f21684b2640 1 -- 172.21.15.43:0/564480314 wait complete. 2024-04-24T23:00:31.515 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-24T23:00:31.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.635+0000 7f304e7f5640 1 Processor -- start 2024-04-24T23:00:31.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.635+0000 7f304e7f5640 1 -- start start 2024-04-24T23:00:31.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.635+0000 7f304e7f5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f30480b9590 0x7f30480b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.635+0000 7f304e7f5640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f304814b360 0x7f30481411c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.635+0000 7f304e7f5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30480bdc50 con 0x7f30480bd870 2024-04-24T23:00:31.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.635+0000 7f304e7f5640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f30480b5740 con 0x7f304814b360 2024-04-24T23:00:31.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.635+0000 7f304e7f5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f30480b5a20 con 0x7f30480b9590 2024-04-24T23:00:31.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.635+0000 7f304cd92640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f304814b360 0x7f30481411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.635+0000 7f304cd92640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f304814b360 0x7f30481411c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42712/0 (socket says 172.21.15.43:42712) 2024-04-24T23:00:31.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.635+0000 7f304cd92640 1 -- 172.21.15.43:0/4130115588 learned_addr learned my addr 172.21.15.43:0/4130115588 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:31.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.635+0000 7f30477fe640 1 --2- 172.21.15.43:0/4130115588 >> v2:172.21.15.162:3300/0 conn(0x7f30480b9590 0x7f30480b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.635+0000 7f304cd92640 1 -- 172.21.15.43:0/4130115588 >> v2:172.21.15.162:3300/0 conn(0x7f30480b9590 msgr2=0x7f30480b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:31.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.635+0000 7f304cd92640 1 --2- 172.21.15.43:0/4130115588 >> v2:172.21.15.162:3300/0 conn(0x7f30480b9590 0x7f30480b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.635+0000 7f304cd92640 1 -- 172.21.15.43:0/4130115588 >> v1:172.21.15.162:6789/0 conn(0x7f30480bd870 legacy=0x7f304814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.635+0000 7f304cd92640 1 -- 172.21.15.43:0/4130115588 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30480b5d00 con 0x7f304814b360 2024-04-24T23:00:31.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.639+0000 7f304cd92640 1 --2- 172.21.15.43:0/4130115588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304814b360 0x7f30481411c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f30480b41d0 tx=0x7f304001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987a1aec0f14f42a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:31.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.639+0000 7f3046ffd640 1 -- 172.21.15.43:0/4130115588 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30400a57c0 con 0x7f304814b360 2024-04-24T23:00:31.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.639+0000 7f3046ffd640 1 -- 172.21.15.43:0/4130115588 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30400a5960 con 0x7f304814b360 2024-04-24T23:00:31.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.639+0000 7f3046ffd640 1 -- 172.21.15.43:0/4130115588 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30400a5d30 con 0x7f304814b360 2024-04-24T23:00:31.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.639+0000 7f304e7f5640 1 -- 172.21.15.43:0/4130115588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304814b360 msgr2=0x7f30481411c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.639+0000 7f304e7f5640 1 --2- 172.21.15.43:0/4130115588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304814b360 0x7f30481411c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f30480b41d0 tx=0x7f304001c920 comp rx=0 tx=0).stop 2024-04-24T23:00:31.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.639+0000 7f304e7f5640 1 -- 172.21.15.43:0/4130115588 shutdown_connections 2024-04-24T23:00:31.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.639+0000 7f304e7f5640 1 --2- 172.21.15.43:0/4130115588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304814b360 0x7f30481411c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.639+0000 7f304e7f5640 1 --2- 172.21.15.43:0/4130115588 >> v2:172.21.15.162:3300/0 conn(0x7f30480b9590 0x7f30480b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.639+0000 7f304e7f5640 1 -- 172.21.15.43:0/4130115588 >> 172.21.15.43:0/4130115588 conn(0x7f3048072f20 msgr2=0x7f30480bcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:31.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.639+0000 7f304e7f5640 1 -- 172.21.15.43:0/4130115588 shutdown_connections 2024-04-24T23:00:31.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.639+0000 7f304e7f5640 1 -- 172.21.15.43:0/4130115588 wait complete. 2024-04-24T23:00:31.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304e7f5640 1 Processor -- start 2024-04-24T23:00:31.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304e7f5640 1 -- start start 2024-04-24T23:00:31.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304e7f5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30480bd870 0x7f304813d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304e7f5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f304814b360 0x7f3048139a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304e7f5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30481dff20 0x7f30481e03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304e7f5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30481549e0 con 0x7f30481dff20 2024-04-24T23:00:31.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304e7f5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3048154860 con 0x7f30480bd870 2024-04-24T23:00:31.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304e7f5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3048154b60 con 0x7f304814b360 2024-04-24T23:00:31.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304cd92640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30481dff20 0x7f30481e03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304cd92640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30481dff20 0x7f30481e03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42720/0 (socket says 172.21.15.43:42720) 2024-04-24T23:00:31.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304cd92640 1 -- 172.21.15.43:0/3194212454 learned_addr learned my addr 172.21.15.43:0/3194212454 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:31.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f3047fff640 1 --2- 172.21.15.43:0/3194212454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30480bd870 0x7f304813d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f30477fe640 1 --2- 172.21.15.43:0/3194212454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f304814b360 0x7f3048139a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304cd92640 1 -- 172.21.15.43:0/3194212454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f304814b360 msgr2=0x7f3048139a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304cd92640 1 --2- 172.21.15.43:0/3194212454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f304814b360 0x7f3048139a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304cd92640 1 -- 172.21.15.43:0/3194212454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30480bd870 msgr2=0x7f304813d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:31.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304cd92640 1 --2- 172.21.15.43:0/3194212454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30480bd870 0x7f304813d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:31.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304cd92640 1 -- 172.21.15.43:0/3194212454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f304813ec80 con 0x7f30481dff20 2024-04-24T23:00:31.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304cd92640 1 --2- 172.21.15.43:0/3194212454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30481dff20 0x7f30481e03d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f30400af040 tx=0x7f30400196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:31.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f3044ff9640 1 -- 172.21.15.43:0/3194212454 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30400bc020 con 0x7f30481dff20 2024-04-24T23:00:31.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f3044ff9640 1 -- 172.21.15.43:0/3194212454 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30400b8670 con 0x7f30481dff20 2024-04-24T23:00:31.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f3044ff9640 1 -- 172.21.15.43:0/3194212454 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30400b8a60 con 0x7f30481dff20 2024-04-24T23:00:31.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304e7f5640 1 -- 172.21.15.43:0/3194212454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30480bb8f0 con 0x7f30481dff20 2024-04-24T23:00:31.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304e7f5640 1 -- 172.21.15.43:0/3194212454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3048135fa0 con 0x7f30481dff20 2024-04-24T23:00:31.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f304e7f5640 1 -- 172.21.15.43:0/3194212454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f304804f580 con 0x7f30481dff20 2024-04-24T23:00:31.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f3044ff9640 1 -- 172.21.15.43:0/3194212454 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f30400bf020 con 0x7f30481dff20 2024-04-24T23:00:31.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.643+0000 7f3044ff9640 1 --2- 172.21.15.43:0/3194212454 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f30340678c0 0x7f3034069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:31.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.647+0000 7f3044ff9640 1 -- 172.21.15.43:0/3194212454 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3040120f30 con 0x7f30481dff20 2024-04-24T23:00:31.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.647+0000 7f3047fff640 1 --2- 172.21.15.43:0/3194212454 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f30340678c0 0x7f3034069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:31.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.647+0000 7f3047fff640 1 --2- 172.21.15.43:0/3194212454 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f30340678c0 0x7f3034069d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3038001650 tx=0x7f3038009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:31.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.651+0000 7f3044ff9640 1 -- 172.21.15.43:0/3194212454 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f30400c6030 con 0x7f30481dff20 2024-04-24T23:00:31.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:31.847+0000 7f304e7f5640 1 -- 172.21.15.43:0/3194212454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f304813ee50 con 0x7f30481dff20 2024-04-24T23:00:32.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.523+0000 7f3044ff9640 1 -- 172.21.15.43:0/3194212454 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f30400165a0 con 0x7f30481dff20 2024-04-24T23:00:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.527+0000 7f304e7f5640 1 -- 172.21.15.43:0/3194212454 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f30340678c0 msgr2=0x7f3034069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.527+0000 7f304e7f5640 1 --2- 172.21.15.43:0/3194212454 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f30340678c0 0x7f3034069d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3038001650 tx=0x7f3038009040 comp rx=0 tx=0).stop 2024-04-24T23:00:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.527+0000 7f304e7f5640 1 -- 172.21.15.43:0/3194212454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30481dff20 msgr2=0x7f30481e03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.527+0000 7f304e7f5640 1 --2- 172.21.15.43:0/3194212454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30481dff20 0x7f30481e03d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f30400af040 tx=0x7f30400196c0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.527+0000 7f304e7f5640 1 -- 172.21.15.43:0/3194212454 shutdown_connections 2024-04-24T23:00:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.527+0000 7f304e7f5640 1 --2- 172.21.15.43:0/3194212454 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f30340678c0 0x7f3034069d80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.527+0000 7f304e7f5640 1 --2- 172.21.15.43:0/3194212454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30481dff20 0x7f30481e03d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.527+0000 7f304e7f5640 1 --2- 172.21.15.43:0/3194212454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f304814b360 0x7f3048139a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.527+0000 7f304e7f5640 1 --2- 172.21.15.43:0/3194212454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30480bd870 0x7f304813d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.527+0000 7f304e7f5640 1 -- 172.21.15.43:0/3194212454 >> 172.21.15.43:0/3194212454 conn(0x7f3048072f20 msgr2=0x7f3048145420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.527+0000 7f304e7f5640 1 -- 172.21.15.43:0/3194212454 shutdown_connections 2024-04-24T23:00:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.527+0000 7f304e7f5640 1 -- 172.21.15.43:0/3194212454 wait complete. 2024-04-24T23:00:32.556 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-24T23:00:32.557 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-24T23:00:32.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.687+0000 7f42b8012640 1 Processor -- start 2024-04-24T23:00:32.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.687+0000 7f42b8012640 1 -- start start 2024-04-24T23:00:32.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.687+0000 7f42b8012640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b00b2500 0x7f42b0145450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.687+0000 7f42b8012640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f42b013f900 0x7f42b014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.687+0000 7f42b8012640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42b0070060 con 0x7f42b0145990 2024-04-24T23:00:32.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.687+0000 7f42b8012640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f42b00b28e0 con 0x7f42b013f900 2024-04-24T23:00:32.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.687+0000 7f42b8012640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f42b00af8f0 con 0x7f42b00b2500 2024-04-24T23:00:32.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.687+0000 7f42b65af640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f42b013f900 0x7f42b014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.687+0000 7f42b55ad640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f42b0145990 0x7f42b013f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54446/0 (socket says 172.21.15.43:54446) 2024-04-24T23:00:32.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.687+0000 7f42b55ad640 1 -- 172.21.15.43:0/848886922 learned_addr learned my addr 172.21.15.43:0/848886922 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:32.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.687+0000 7f42b5dae640 1 --2- 172.21.15.43:0/848886922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b00b2500 0x7f42b0145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b65af640 1 -- 172.21.15.43:0/848886922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b00b2500 msgr2=0x7f42b0145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:32.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b65af640 1 --2- 172.21.15.43:0/848886922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b00b2500 0x7f42b0145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b65af640 1 -- 172.21.15.43:0/848886922 >> v1:172.21.15.43:6789/0 conn(0x7f42b0145990 legacy=0x7f42b013f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b65af640 1 -- 172.21.15.43:0/848886922 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b006fb40 con 0x7f42b013f900 2024-04-24T23:00:32.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b4dac640 1 -- 172.21.15.43:0/848886922 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793508720 0 0) 0x7f42b0070060 con 0x7f42b0145990 2024-04-24T23:00:32.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b65af640 1 --2- 172.21.15.43:0/848886922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b013f900 0x7f42b014fcf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009d90 tx=0x7f42a801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ce4048368616be server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:32.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b4dac640 1 -- 172.21.15.43:0/848886922 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a80b2070 con 0x7f42b013f900 2024-04-24T23:00:32.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b4dac640 1 -- 172.21.15.43:0/848886922 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a80a5830 con 0x7f42b013f900 2024-04-24T23:00:32.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b4dac640 1 -- 172.21.15.43:0/848886922 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a80a5c00 con 0x7f42b013f900 2024-04-24T23:00:32.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b8012640 1 -- 172.21.15.43:0/848886922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b013f900 msgr2=0x7f42b014fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b8012640 1 --2- 172.21.15.43:0/848886922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b013f900 0x7f42b014fcf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009d90 tx=0x7f42a801c970 comp rx=0 tx=0).stop 2024-04-24T23:00:32.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b8012640 1 -- 172.21.15.43:0/848886922 shutdown_connections 2024-04-24T23:00:32.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b8012640 1 --2- 172.21.15.43:0/848886922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b013f900 0x7f42b014fcf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b8012640 1 --2- 172.21.15.43:0/848886922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b00b2500 0x7f42b0145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b8012640 1 -- 172.21.15.43:0/848886922 >> 172.21.15.43:0/848886922 conn(0x7f42b00b5690 msgr2=0x7f42b00b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:32.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b8012640 1 -- 172.21.15.43:0/848886922 shutdown_connections 2024-04-24T23:00:32.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.691+0000 7f42b8012640 1 -- 172.21.15.43:0/848886922 wait complete. 2024-04-24T23:00:32.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b8012640 1 Processor -- start 2024-04-24T23:00:32.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b8012640 1 -- start start 2024-04-24T23:00:32.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b8012640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b00b2500 0x7f42b0136b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b8012640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42b013f900 0x7f42b01dde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b8012640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b0145990 0x7f42b01de3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b8012640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f42b00b54a0 con 0x7f42b00b2500 2024-04-24T23:00:32.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b8012640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42b00b4d40 con 0x7f42b013f900 2024-04-24T23:00:32.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b8012640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f42b0152a50 con 0x7f42b0145990 2024-04-24T23:00:32.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b5dae640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b00b2500 0x7f42b0136b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b5dae640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b00b2500 0x7f42b0136b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42748/0 (socket says 172.21.15.43:42748) 2024-04-24T23:00:32.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b5dae640 1 -- 172.21.15.43:0/820533865 learned_addr learned my addr 172.21.15.43:0/820533865 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:32.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b5dae640 1 -- 172.21.15.43:0/820533865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b0145990 msgr2=0x7f42b01de3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b5dae640 1 --2- 172.21.15.43:0/820533865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b0145990 0x7f42b01de3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b5dae640 1 -- 172.21.15.43:0/820533865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42b013f900 msgr2=0x7f42b01dde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:32.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b5dae640 1 --2- 172.21.15.43:0/820533865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42b013f900 0x7f42b01dde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:32.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b5dae640 1 -- 172.21.15.43:0/820533865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b01370a0 con 0x7f42b00b2500 2024-04-24T23:00:32.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b5dae640 1 --2- 172.21.15.43:0/820533865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b00b2500 0x7f42b0136b60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00e8a0 tx=0x7f42ac00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:32.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42a67fc640 1 -- 172.21.15.43:0/820533865 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac017070 con 0x7f42b00b2500 2024-04-24T23:00:32.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42a67fc640 1 -- 172.21.15.43:0/820533865 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac00c940 con 0x7f42b00b2500 2024-04-24T23:00:32.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b8012640 1 -- 172.21.15.43:0/820533865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b0139ab0 con 0x7f42b00b2500 2024-04-24T23:00:32.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42a67fc640 1 -- 172.21.15.43:0/820533865 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac00cd10 con 0x7f42b00b2500 2024-04-24T23:00:32.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b8012640 1 -- 172.21.15.43:0/820533865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b0137340 con 0x7f42b00b2500 2024-04-24T23:00:32.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b8012640 1 -- 172.21.15.43:0/820533865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b004f580 con 0x7f42b00b2500 2024-04-24T23:00:32.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42a67fc640 1 -- 172.21.15.43:0/820533865 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f42ac01a070 con 0x7f42b00b2500 2024-04-24T23:00:32.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42a67fc640 1 --2- 172.21.15.43:0/820533865 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f42940678c0 0x7f4294069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:32.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42a67fc640 1 -- 172.21.15.43:0/820533865 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f42ac085df0 con 0x7f42b00b2500 2024-04-24T23:00:32.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.695+0000 7f42b55ad640 1 --2- 172.21.15.43:0/820533865 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f42940678c0 0x7f4294069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:32.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.699+0000 7f42b55ad640 1 --2- 172.21.15.43:0/820533865 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f42940678c0 0x7f4294069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f42a0000c10 tx=0x7f42a0007910 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:32.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.703+0000 7f42a67fc640 1 -- 172.21.15.43:0/820533865 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f42ac056680 con 0x7f42b00b2500 2024-04-24T23:00:32.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:32.903+0000 7f42b8012640 1 -- 172.21.15.43:0/820533865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f42b0073410 con 0x7f42b00b2500 2024-04-24T23:00:33.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.523+0000 7f42a67fc640 1 -- 172.21.15.43:0/820533865 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f42ac055f80 con 0x7f42b00b2500 2024-04-24T23:00:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.527+0000 7f42b8012640 1 -- 172.21.15.43:0/820533865 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f42940678c0 msgr2=0x7f4294069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.527+0000 7f42b8012640 1 --2- 172.21.15.43:0/820533865 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f42940678c0 0x7f4294069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f42a0000c10 tx=0x7f42a0007910 comp rx=0 tx=0).stop 2024-04-24T23:00:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.527+0000 7f42b8012640 1 -- 172.21.15.43:0/820533865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b00b2500 msgr2=0x7f42b0136b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.527+0000 7f42b8012640 1 --2- 172.21.15.43:0/820533865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b00b2500 0x7f42b0136b60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00e8a0 tx=0x7f42ac00ed60 comp rx=0 tx=0).stop 2024-04-24T23:00:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.527+0000 7f42b8012640 1 -- 172.21.15.43:0/820533865 shutdown_connections 2024-04-24T23:00:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.527+0000 7f42b8012640 1 --2- 172.21.15.43:0/820533865 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f42940678c0 0x7f4294069d80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.527+0000 7f42b8012640 1 --2- 172.21.15.43:0/820533865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42b0145990 0x7f42b01de3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.527+0000 7f42b8012640 1 --2- 172.21.15.43:0/820533865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42b013f900 0x7f42b01dde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.527+0000 7f42b8012640 1 --2- 172.21.15.43:0/820533865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b00b2500 0x7f42b0136b60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.527+0000 7f42b8012640 1 -- 172.21.15.43:0/820533865 >> 172.21.15.43:0/820533865 conn(0x7f42b00b5690 msgr2=0x7f42b0143850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.527+0000 7f42b8012640 1 -- 172.21.15.43:0/820533865 shutdown_connections 2024-04-24T23:00:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.527+0000 7f42b8012640 1 -- 172.21.15.43:0/820533865 wait complete. 2024-04-24T23:00:33.556 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-24T23:00:33.556 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:00:33.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.675+0000 7f6447bd4640 1 Processor -- start 2024-04-24T23:00:33.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f6447bd4640 1 -- start start 2024-04-24T23:00:33.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f6447bd4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f64401475d0 0x7f64400b5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f6447bd4640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64400b5770 con 0x7f64400b94a0 2024-04-24T23:00:33.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f6447bd4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64400b5a50 con 0x7f64400b9e30 2024-04-24T23:00:33.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f6447bd4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f64400b7450 con 0x7f64401475d0 2024-04-24T23:00:33.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644516f640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f64400b94a0 0x7f64400b2f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54454/0 (socket says 172.21.15.43:54454) 2024-04-24T23:00:33.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644516f640 1 -- 172.21.15.43:0/3075532261 learned_addr learned my addr 172.21.15.43:0/3075532261 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:33.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f6446171640 1 --2- 172.21.15.43:0/3075532261 >> v2:172.21.15.162:3300/0 conn(0x7f64401475d0 0x7f64400b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644496e640 1 -- 172.21.15.43:0/3075532261 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 835163241 0 0) 0x7f64400b5770 con 0x7f64400b94a0 2024-04-24T23:00:33.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644496e640 1 -- 172.21.15.43:0/3075532261 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f642c003530 con 0x7f64400b94a0 2024-04-24T23:00:33.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644496e640 1 -- 172.21.15.43:0/3075532261 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2875595399 0 0) 0x7f642c003530 con 0x7f64400b94a0 2024-04-24T23:00:33.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644496e640 1 -- 172.21.15.43:0/3075532261 >> v2:172.21.15.162:3300/0 conn(0x7f64401475d0 msgr2=0x7f64400b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:33.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644496e640 1 --2- 172.21.15.43:0/3075532261 >> v2:172.21.15.162:3300/0 conn(0x7f64401475d0 0x7f64400b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644496e640 1 -- 172.21.15.43:0/3075532261 >> v1:172.21.15.162:6789/0 conn(0x7f64400b9e30 legacy=0x7f64400b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644496e640 1 -- 172.21.15.43:0/3075532261 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64400b5d30 con 0x7f64400b94a0 2024-04-24T23:00:33.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644496e640 1 -- 172.21.15.43:0/3075532261 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f6430001680 con 0x7f64400b94a0 2024-04-24T23:00:33.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644496e640 1 -- 172.21.15.43:0/3075532261 >> v1:172.21.15.43:6789/0 conn(0x7f64400b94a0 legacy=0x7f64400b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644496e640 1 --2- 172.21.15.43:0/3075532261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c003a10 0x7f642c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644496e640 1 --2- 172.21.15.43:0/3075532261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f642c004810 0x7f642c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644496e640 1 --2- 172.21.15.43:0/3075532261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f642c0052f0 0x7f642c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644496e640 1 -- 172.21.15.43:0/3075532261 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f64400b7450 con 0x7f642c003a10 2024-04-24T23:00:33.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644496e640 1 -- 172.21.15.43:0/3075532261 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f642c00c1f0 con 0x7f642c004810 2024-04-24T23:00:33.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644496e640 1 -- 172.21.15.43:0/3075532261 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f642c00c3f0 con 0x7f642c0052f0 2024-04-24T23:00:33.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f6445970640 1 --2- 172.21.15.43:0/3075532261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c003a10 0x7f642c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f644516f640 1 --2- 172.21.15.43:0/3075532261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f642c004810 0x7f642c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f6446171640 1 --2- 172.21.15.43:0/3075532261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f642c0052f0 0x7f642c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f6445970640 1 -- 172.21.15.43:0/3075532261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f642c0052f0 msgr2=0x7f642c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:33.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f6445970640 1 --2- 172.21.15.43:0/3075532261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f642c0052f0 0x7f642c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f6445970640 1 -- 172.21.15.43:0/3075532261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f642c004810 msgr2=0x7f642c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:33.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f6445970640 1 --2- 172.21.15.43:0/3075532261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f642c004810 0x7f642c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f6445970640 1 -- 172.21.15.43:0/3075532261 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642c003530 con 0x7f642c003a10 2024-04-24T23:00:33.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.679+0000 7f6446171640 1 -- 172.21.15.43:0/3075532261 reap_dead start 2024-04-24T23:00:33.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6445970640 1 --2- 172.21.15.43:0/3075532261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c003a10 0x7f642c003e30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f643c001780 tx=0x7f643c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30482c16e394331 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:33.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f644496e640 1 -- 172.21.15.43:0/3075532261 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c0013a0 con 0x7f642c003a10 2024-04-24T23:00:33.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f644496e640 1 -- 172.21.15.43:0/3075532261 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f643c0052f0 con 0x7f642c003a10 2024-04-24T23:00:33.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f644496e640 1 -- 172.21.15.43:0/3075532261 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c003840 con 0x7f642c003a10 2024-04-24T23:00:33.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6447bd4640 1 -- 172.21.15.43:0/3075532261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c003a10 msgr2=0x7f642c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6447bd4640 1 --2- 172.21.15.43:0/3075532261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c003a10 0x7f642c003e30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f643c001780 tx=0x7f643c01c400 comp rx=0 tx=0).stop 2024-04-24T23:00:33.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6447bd4640 1 -- 172.21.15.43:0/3075532261 shutdown_connections 2024-04-24T23:00:33.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6447bd4640 1 --2- 172.21.15.43:0/3075532261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c003a10 0x7f642c003e30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6447bd4640 1 -- 172.21.15.43:0/3075532261 >> 172.21.15.43:0/3075532261 conn(0x7f6440072b20 msgr2=0x7f6440072f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:33.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6447bd4640 1 -- 172.21.15.43:0/3075532261 shutdown_connections 2024-04-24T23:00:33.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6447bd4640 1 -- 172.21.15.43:0/3075532261 wait complete. 2024-04-24T23:00:33.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6447bd4640 1 Processor -- start 2024-04-24T23:00:33.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6447bd4640 1 -- start start 2024-04-24T23:00:33.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6447bd4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c003a10 0x7f64400b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6447bd4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6440149dc0 0x7f64401e39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6447bd4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f644013b210 0x7f644013b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6447bd4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f644014acc0 con 0x7f642c003a10 2024-04-24T23:00:33.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6447bd4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f644014ab40 con 0x7f6440149dc0 2024-04-24T23:00:33.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.683+0000 7f6447bd4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f644014ae40 con 0x7f644013b210 2024-04-24T23:00:33.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f6445970640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c003a10 0x7f64400b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f6445970640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c003a10 0x7f64400b1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42764/0 (socket says 172.21.15.43:42764) 2024-04-24T23:00:33.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f6445970640 1 -- 172.21.15.43:0/3297680035 learned_addr learned my addr 172.21.15.43:0/3297680035 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:33.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f6446171640 1 --2- 172.21.15.43:0/3297680035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f644013b210 0x7f644013b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f644516f640 1 --2- 172.21.15.43:0/3297680035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6440149dc0 0x7f64401e39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f6445970640 1 -- 172.21.15.43:0/3297680035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f644013b210 msgr2=0x7f644013b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f6445970640 1 --2- 172.21.15.43:0/3297680035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f644013b210 0x7f644013b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f6445970640 1 -- 172.21.15.43:0/3297680035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6440149dc0 msgr2=0x7f64401e39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f6445970640 1 --2- 172.21.15.43:0/3297680035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6440149dc0 0x7f64401e39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f6445970640 1 -- 172.21.15.43:0/3297680035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64401e3f30 con 0x7f642c003a10 2024-04-24T23:00:33.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f6445970640 1 --2- 172.21.15.43:0/3297680035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c003a10 0x7f64400b1930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f643c000c10 tx=0x7f642c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:33.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f64367fc640 1 -- 172.21.15.43:0/3297680035 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c007a40 con 0x7f642c003a10 2024-04-24T23:00:33.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f64367fc640 1 -- 172.21.15.43:0/3297680035 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f643c0ba070 con 0x7f642c003a10 2024-04-24T23:00:33.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f64367fc640 1 -- 172.21.15.43:0/3297680035 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c007250 con 0x7f642c003a10 2024-04-24T23:00:33.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f6447bd4640 1 -- 172.21.15.43:0/3297680035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64401492e0 con 0x7f642c003a10 2024-04-24T23:00:33.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f6447bd4640 1 -- 172.21.15.43:0/3297680035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64401498a0 con 0x7f642c003a10 2024-04-24T23:00:33.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f6447bd4640 1 -- 172.21.15.43:0/3297680035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644004f580 con 0x7f642c003a10 2024-04-24T23:00:33.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f64367fc640 1 -- 172.21.15.43:0/3297680035 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f643c0052f0 con 0x7f642c003a10 2024-04-24T23:00:33.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f64367fc640 1 --2- 172.21.15.43:0/3297680035 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f64240678c0 0x7f6424069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:33.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f64367fc640 1 -- 172.21.15.43:0/3297680035 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f643c120210 con 0x7f642c003a10 2024-04-24T23:00:33.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f644516f640 1 --2- 172.21.15.43:0/3297680035 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f64240678c0 0x7f6424069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:33.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.687+0000 7f644516f640 1 --2- 172.21.15.43:0/3297680035 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f64240678c0 0x7f6424069d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f64400b8c80 tx=0x7f6430009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:33.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.691+0000 7f64367fc640 1 -- 172.21.15.43:0/3297680035 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f643c016110 con 0x7f642c003a10 2024-04-24T23:00:33.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.891+0000 7f6447bd4640 1 -- 172.21.15.43:0/3297680035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6440140520 con 0x7f642c003a10 2024-04-24T23:00:33.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.891+0000 7f64367fc640 1 -- 172.21.15.43:0/3297680035 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3529 (secure 0 0 0) 0x7f643c0f0970 con 0x7f642c003a10 2024-04-24T23:00:33.897 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:33.897 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/2236776475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2236776475},{"type":"v1","addr":"172.21.15.162:6833","nonce":2236776475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:00:15.762941+0000","modified":"2024-04-24T23:00:32.909117+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6835/152091432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":152091432},{"type":"v1","addr":"172.21.15.43:6835","nonce":152091432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-04-24T23:00:33.897 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-04-24T23:00:33.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.895+0000 7f6447bd4640 1 -- 172.21.15.43:0/3297680035 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f64240678c0 msgr2=0x7f6424069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.895+0000 7f6447bd4640 1 --2- 172.21.15.43:0/3297680035 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f64240678c0 0x7f6424069d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f64400b8c80 tx=0x7f6430009040 comp rx=0 tx=0).stop 2024-04-24T23:00:33.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.895+0000 7f6447bd4640 1 -- 172.21.15.43:0/3297680035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c003a10 msgr2=0x7f64400b1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:33.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.895+0000 7f6447bd4640 1 --2- 172.21.15.43:0/3297680035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c003a10 0x7f64400b1930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f643c000c10 tx=0x7f642c005840 comp rx=0 tx=0).stop 2024-04-24T23:00:33.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.895+0000 7f6447bd4640 1 -- 172.21.15.43:0/3297680035 shutdown_connections 2024-04-24T23:00:33.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.895+0000 7f6447bd4640 1 --2- 172.21.15.43:0/3297680035 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f64240678c0 0x7f6424069d80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.895+0000 7f6447bd4640 1 --2- 172.21.15.43:0/3297680035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f644013b210 0x7f644013b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.895+0000 7f6447bd4640 1 --2- 172.21.15.43:0/3297680035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6440149dc0 0x7f64401e39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.895+0000 7f6447bd4640 1 --2- 172.21.15.43:0/3297680035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f642c003a10 0x7f64400b1930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:33.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.895+0000 7f6447bd4640 1 -- 172.21.15.43:0/3297680035 >> 172.21.15.43:0/3297680035 conn(0x7f6440072b20 msgr2=0x7f644013e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:33.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.895+0000 7f6447bd4640 1 -- 172.21.15.43:0/3297680035 shutdown_connections 2024-04-24T23:00:33.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:33.895+0000 7f6447bd4640 1 -- 172.21.15.43:0/3297680035 wait complete. 2024-04-24T23:00:33.917 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:34.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.035+0000 7f47885c8640 1 Processor -- start 2024-04-24T23:00:34.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.035+0000 7f47885c8640 1 -- start start 2024-04-24T23:00:34.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f47885c8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47800b2500 0x7f4780145450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f47885c8640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4780070060 con 0x7f478013f900 2024-04-24T23:00:34.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f47885c8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47800b28e0 con 0x7f4780145990 2024-04-24T23:00:34.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f47885c8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f47800af8f0 con 0x7f47800b2500 2024-04-24T23:00:34.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4786b65640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f478013f900 0x7f478014fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54464/0 (socket says 172.21.15.43:54464) 2024-04-24T23:00:34.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4786b65640 1 -- 172.21.15.43:0/434674979 learned_addr learned my addr 172.21.15.43:0/434674979 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:34.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4786364640 1 --2- 172.21.15.43:0/434674979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47800b2500 0x7f4780145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785362640 1 -- 172.21.15.43:0/434674979 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1293468211 0 0) 0x7f4780070060 con 0x7f478013f900 2024-04-24T23:00:34.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785362640 1 -- 172.21.15.43:0/434674979 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f476c003530 con 0x7f478013f900 2024-04-24T23:00:34.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785362640 1 -- 172.21.15.43:0/434674979 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 882679747 0 0) 0x7f476c003530 con 0x7f478013f900 2024-04-24T23:00:34.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785362640 1 -- 172.21.15.43:0/434674979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47800b2500 msgr2=0x7f4780145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:34.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785362640 1 --2- 172.21.15.43:0/434674979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47800b2500 0x7f4780145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785362640 1 -- 172.21.15.43:0/434674979 >> v1:172.21.15.162:6789/0 conn(0x7f4780145990 legacy=0x7f478013f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785362640 1 -- 172.21.15.43:0/434674979 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478006fb40 con 0x7f478013f900 2024-04-24T23:00:34.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785362640 1 -- 172.21.15.43:0/434674979 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f4778001a00 con 0x7f478013f900 2024-04-24T23:00:34.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785362640 1 -- 172.21.15.43:0/434674979 >> v1:172.21.15.43:6789/0 conn(0x7f478013f900 legacy=0x7f478014fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785362640 1 --2- 172.21.15.43:0/434674979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47800b2500 0x7f476c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785362640 1 --2- 172.21.15.43:0/434674979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c003f70 0x7f476c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785362640 1 --2- 172.21.15.43:0/434674979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f476c004d50 0x7f476c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785362640 1 -- 172.21.15.43:0/434674979 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f47800af8f0 con 0x7f476c004d50 2024-04-24T23:00:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785362640 1 -- 172.21.15.43:0/434674979 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f476c00bab0 con 0x7f476c003f70 2024-04-24T23:00:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785362640 1 -- 172.21.15.43:0/434674979 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f476c00bcb0 con 0x7f47800b2500 2024-04-24T23:00:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4786b65640 1 --2- 172.21.15.43:0/434674979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f476c004d50 0x7f476c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4786364640 1 --2- 172.21.15.43:0/434674979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47800b2500 0x7f476c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785b63640 1 --2- 172.21.15.43:0/434674979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c003f70 0x7f476c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4786b65640 1 -- 172.21.15.43:0/434674979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47800b2500 msgr2=0x7f476c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4786b65640 1 --2- 172.21.15.43:0/434674979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47800b2500 0x7f476c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4786b65640 1 -- 172.21.15.43:0/434674979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c003f70 msgr2=0x7f476c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4786b65640 1 --2- 172.21.15.43:0/434674979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c003f70 0x7f476c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4786b65640 1 -- 172.21.15.43:0/434674979 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c003530 con 0x7f476c004d50 2024-04-24T23:00:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.039+0000 7f4785b63640 1 --2- 172.21.15.43:0/434674979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c003f70 0x7f476c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:34.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4786b65640 1 --2- 172.21.15.43:0/434674979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f476c004d50 0x7f476c0051d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f477800a850 tx=0x7f477801d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6aef56b562bbc27 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4785362640 1 -- 172.21.15.43:0/434674979 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477800a4a0 con 0x7f476c004d50 2024-04-24T23:00:34.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4785362640 1 -- 172.21.15.43:0/434674979 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47780ad650 con 0x7f476c004d50 2024-04-24T23:00:34.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4785362640 1 -- 172.21.15.43:0/434674979 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47780ada80 con 0x7f476c004d50 2024-04-24T23:00:34.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f47885c8640 1 -- 172.21.15.43:0/434674979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f476c004d50 msgr2=0x7f476c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f47885c8640 1 --2- 172.21.15.43:0/434674979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f476c004d50 0x7f476c0051d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f477800a850 tx=0x7f477801d3a0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4786b65640 1 -- 172.21.15.43:0/434674979 reap_dead start 2024-04-24T23:00:34.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f47885c8640 1 -- 172.21.15.43:0/434674979 shutdown_connections 2024-04-24T23:00:34.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f47885c8640 1 -- 172.21.15.43:0/434674979 >> 172.21.15.43:0/434674979 conn(0x7f47800b5690 msgr2=0x7f47800b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:34.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f47885c8640 1 -- 172.21.15.43:0/434674979 shutdown_connections 2024-04-24T23:00:34.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f47885c8640 1 -- 172.21.15.43:0/434674979 wait complete. 2024-04-24T23:00:34.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f47885c8640 1 Processor -- start 2024-04-24T23:00:34.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f47885c8640 1 -- start start 2024-04-24T23:00:34.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f47885c8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c004d50 0x7f47800b7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f47885c8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47801ce4d0 0x7f47801dce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f47885c8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47801dd350 0x7f47800b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f47885c8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f47800b5410 con 0x7f47801ce4d0 2024-04-24T23:00:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f47885c8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f47800b5290 con 0x7f476c004d50 2024-04-24T23:00:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f47885c8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f47800b4af0 con 0x7f47801dd350 2024-04-24T23:00:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4785b63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47801ce4d0 0x7f47801dce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4785b63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47801ce4d0 0x7f47801dce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42782/0 (socket says 172.21.15.43:42782) 2024-04-24T23:00:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4785b63640 1 -- 172.21.15.43:0/2102257204 learned_addr learned my addr 172.21.15.43:0/2102257204 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4786b65640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47801dd350 0x7f47800b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4786364640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c004d50 0x7f47800b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4785b63640 1 -- 172.21.15.43:0/2102257204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47801dd350 msgr2=0x7f47800b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4785b63640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47801dd350 0x7f47800b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4785b63640 1 -- 172.21.15.43:0/2102257204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c004d50 msgr2=0x7f47800b7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4785b63640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c004d50 0x7f47800b7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4785b63640 1 -- 172.21.15.43:0/2102257204 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47800b4610 con 0x7f47801ce4d0 2024-04-24T23:00:34.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4786b65640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47801dd350 0x7f47800b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:34.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4786364640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c004d50 0x7f47800b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:34.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.043+0000 7f4785b63640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47801ce4d0 0x7f47801dce10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f477000e580 tx=0x7f477000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.047+0000 7f4776ffd640 1 -- 172.21.15.43:0/2102257204 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47700052e0 con 0x7f47801ce4d0 2024-04-24T23:00:34.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.047+0000 7f4776ffd640 1 -- 172.21.15.43:0/2102257204 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4770018070 con 0x7f47801ce4d0 2024-04-24T23:00:34.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.047+0000 7f4776ffd640 1 -- 172.21.15.43:0/2102257204 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4770005480 con 0x7f47801ce4d0 2024-04-24T23:00:34.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.047+0000 7f47885c8640 1 -- 172.21.15.43:0/2102257204 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47800aedd0 con 0x7f47801ce4d0 2024-04-24T23:00:34.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.047+0000 7f47885c8640 1 -- 172.21.15.43:0/2102257204 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47801cf840 con 0x7f47801ce4d0 2024-04-24T23:00:34.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.047+0000 7f47885c8640 1 -- 172.21.15.43:0/2102257204 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f478004f580 con 0x7f47801ce4d0 2024-04-24T23:00:34.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.047+0000 7f4776ffd640 1 -- 172.21.15.43:0/2102257204 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4770003840 con 0x7f47801ce4d0 2024-04-24T23:00:34.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.047+0000 7f4776ffd640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f47640678f0 0x7f4764069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.047+0000 7f4776ffd640 1 -- 172.21.15.43:0/2102257204 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4770085dd0 con 0x7f47801ce4d0 2024-04-24T23:00:34.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.047+0000 7f4786364640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f47640678f0 0x7f4764069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.047+0000 7f4786364640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f47640678f0 0x7f4764069db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f477c009ad0 tx=0x7f477c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.051+0000 7f4776ffd640 1 -- 172.21.15.43:0/2102257204 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f4770056540 con 0x7f47801ce4d0 2024-04-24T23:00:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.211+0000 7f47885c8640 1 -- 172.21.15.43:0/2102257204 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47800728f0 con 0x7f47801ce4d0 2024-04-24T23:00:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.215+0000 7f4776ffd640 1 -- 172.21.15.43:0/2102257204 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18518 (secure 0 0 0) 0x7f4770055e40 con 0x7f47801ce4d0 2024-04-24T23:00:34.219 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:34.220 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:20.863941+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:34.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.215+0000 7f47885c8640 1 -- 172.21.15.43:0/2102257204 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f47640678f0 msgr2=0x7f4764069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.215+0000 7f47885c8640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f47640678f0 0x7f4764069db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f477c009ad0 tx=0x7f477c008040 comp rx=0 tx=0).stop 2024-04-24T23:00:34.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.215+0000 7f47885c8640 1 -- 172.21.15.43:0/2102257204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47801ce4d0 msgr2=0x7f47801dce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.215+0000 7f47885c8640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47801ce4d0 0x7f47801dce10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f477000e580 tx=0x7f477000ea40 comp rx=0 tx=0).stop 2024-04-24T23:00:34.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.215+0000 7f47885c8640 1 -- 172.21.15.43:0/2102257204 shutdown_connections 2024-04-24T23:00:34.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.215+0000 7f47885c8640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f47640678f0 0x7f4764069db0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.215+0000 7f47885c8640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47801dd350 0x7f47800b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.215+0000 7f47885c8640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47801ce4d0 0x7f47801dce10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.215+0000 7f47885c8640 1 --2- 172.21.15.43:0/2102257204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f476c004d50 0x7f47800b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.215+0000 7f47885c8640 1 -- 172.21.15.43:0/2102257204 >> 172.21.15.43:0/2102257204 conn(0x7f47800b5690 msgr2=0x7f478013b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:34.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.215+0000 7f47885c8640 1 -- 172.21.15.43:0/2102257204 shutdown_connections 2024-04-24T23:00:34.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.215+0000 7f47885c8640 1 -- 172.21.15.43:0/2102257204 wait complete. 2024-04-24T23:00:34.237 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-24T23:00:34.238 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:00:34.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.355+0000 7f4d090a5640 1 Processor -- start 2024-04-24T23:00:34.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.355+0000 7f4d090a5640 1 -- start start 2024-04-24T23:00:34.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d090a5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4d041443b0 0x7f4d041434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d090a5640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d040b2ed0 con 0x7f4d040b4080 2024-04-24T23:00:34.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d090a5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d040b4460 con 0x7f4d040afa00 2024-04-24T23:00:34.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d090a5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4d040b1a10 con 0x7f4d041443b0 2024-04-24T23:00:34.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d02d9d640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4d040b4080 0x7f4d04143ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54472/0 (socket says 172.21.15.43:54472) 2024-04-24T23:00:34.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d02d9d640 1 -- 172.21.15.43:0/1607606984 learned_addr learned my addr 172.21.15.43:0/1607606984 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:34.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d0359e640 1 --2- 172.21.15.43:0/1607606984 >> v2:172.21.15.162:3300/0 conn(0x7f4d041443b0 0x7f4d041434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d01d9b640 1 -- 172.21.15.43:0/1607606984 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 784515606 0 0) 0x7f4d040b2ed0 con 0x7f4d040b4080 2024-04-24T23:00:34.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d01d9b640 1 -- 172.21.15.43:0/1607606984 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cec003530 con 0x7f4d040b4080 2024-04-24T23:00:34.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d01d9b640 1 -- 172.21.15.43:0/1607606984 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3075481099 0 0) 0x7f4cec003530 con 0x7f4d040b4080 2024-04-24T23:00:34.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d01d9b640 1 -- 172.21.15.43:0/1607606984 >> v2:172.21.15.162:3300/0 conn(0x7f4d041443b0 msgr2=0x7f4d041434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:34.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d01d9b640 1 --2- 172.21.15.43:0/1607606984 >> v2:172.21.15.162:3300/0 conn(0x7f4d041443b0 0x7f4d041434f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d01d9b640 1 -- 172.21.15.43:0/1607606984 >> v1:172.21.15.162:6789/0 conn(0x7f4d040afa00 legacy=0x7f4d04142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d01d9b640 1 -- 172.21.15.43:0/1607606984 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d040b1c60 con 0x7f4d040b4080 2024-04-24T23:00:34.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d01d9b640 1 -- 172.21.15.43:0/1607606984 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f4cf4001680 con 0x7f4d040b4080 2024-04-24T23:00:34.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d01d9b640 1 -- 172.21.15.43:0/1607606984 >> v1:172.21.15.43:6789/0 conn(0x7f4d040b4080 legacy=0x7f4d04143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d01d9b640 1 --2- 172.21.15.43:0/1607606984 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cec0039c0 0x7f4cec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d01d9b640 1 --2- 172.21.15.43:0/1607606984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cec004810 0x7f4cec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d01d9b640 1 --2- 172.21.15.43:0/1607606984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cec0051d0 0x7f4cec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d01d9b640 1 -- 172.21.15.43:0/1607606984 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4d040b1a10 con 0x7f4cec0039c0 2024-04-24T23:00:34.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d01d9b640 1 -- 172.21.15.43:0/1607606984 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4cec00c170 con 0x7f4cec004810 2024-04-24T23:00:34.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d01d9b640 1 -- 172.21.15.43:0/1607606984 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4cec00c370 con 0x7f4cec0051d0 2024-04-24T23:00:34.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d02d9d640 1 --2- 172.21.15.43:0/1607606984 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cec0039c0 0x7f4cec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d0259c640 1 --2- 172.21.15.43:0/1607606984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cec004810 0x7f4cec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d02d9d640 1 -- 172.21.15.43:0/1607606984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cec0051d0 msgr2=0x7f4cec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:34.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d02d9d640 1 --2- 172.21.15.43:0/1607606984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cec0051d0 0x7f4cec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d02d9d640 1 -- 172.21.15.43:0/1607606984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cec004810 msgr2=0x7f4cec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:34.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d02d9d640 1 --2- 172.21.15.43:0/1607606984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cec004810 0x7f4cec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d02d9d640 1 -- 172.21.15.43:0/1607606984 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cec003530 con 0x7f4cec0039c0 2024-04-24T23:00:34.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d0359e640 1 -- 172.21.15.43:0/1607606984 reap_dead start 2024-04-24T23:00:34.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.359+0000 7f4d0259c640 1 --2- 172.21.15.43:0/1607606984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cec004810 0x7f4cec004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:34.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d02d9d640 1 --2- 172.21.15.43:0/1607606984 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cec0039c0 0x7f4cec003de0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400c210 tx=0x7f4cf401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be56f235831989e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d01d9b640 1 -- 172.21.15.43:0/1607606984 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4007d40 con 0x7f4cec0039c0 2024-04-24T23:00:34.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d01d9b640 1 -- 172.21.15.43:0/1607606984 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf40a9070 con 0x7f4cec0039c0 2024-04-24T23:00:34.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d01d9b640 1 -- 172.21.15.43:0/1607606984 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4005d80 con 0x7f4cec0039c0 2024-04-24T23:00:34.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 -- 172.21.15.43:0/1607606984 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cec0039c0 msgr2=0x7f4cec003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 --2- 172.21.15.43:0/1607606984 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cec0039c0 0x7f4cec003de0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400c210 tx=0x7f4cf401cc60 comp rx=0 tx=0).stop 2024-04-24T23:00:34.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 -- 172.21.15.43:0/1607606984 shutdown_connections 2024-04-24T23:00:34.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 --2- 172.21.15.43:0/1607606984 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cec0039c0 0x7f4cec003de0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 -- 172.21.15.43:0/1607606984 >> 172.21.15.43:0/1607606984 conn(0x7f4d040b5690 msgr2=0x7f4d040b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:34.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 -- 172.21.15.43:0/1607606984 shutdown_connections 2024-04-24T23:00:34.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 -- 172.21.15.43:0/1607606984 wait complete. 2024-04-24T23:00:34.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 Processor -- start 2024-04-24T23:00:34.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 -- start start 2024-04-24T23:00:34.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cec0039c0 0x7f4d04071be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d041cfd30 0x7f4d041d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d041cf4e0 0x7f4d0413e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4d040b6330 con 0x7f4cec0039c0 2024-04-24T23:00:34.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d040b61b0 con 0x7f4d041cf4e0 2024-04-24T23:00:34.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4d04142de0 con 0x7f4d041cfd30 2024-04-24T23:00:34.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d02d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cec0039c0 0x7f4d04071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d02d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cec0039c0 0x7f4d04071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42814/0 (socket says 172.21.15.43:42814) 2024-04-24T23:00:34.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d02d9d640 1 -- 172.21.15.43:0/3827198494 learned_addr learned my addr 172.21.15.43:0/3827198494 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:34.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d0259c640 1 --2- 172.21.15.43:0/3827198494 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d041cfd30 0x7f4d041d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d0359e640 1 --2- 172.21.15.43:0/3827198494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d041cf4e0 0x7f4d0413e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d02d9d640 1 -- 172.21.15.43:0/3827198494 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d041cfd30 msgr2=0x7f4d041d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d02d9d640 1 --2- 172.21.15.43:0/3827198494 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d041cfd30 0x7f4d041d13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d02d9d640 1 -- 172.21.15.43:0/3827198494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d041cf4e0 msgr2=0x7f4d0413e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d02d9d640 1 --2- 172.21.15.43:0/3827198494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d041cf4e0 0x7f4d0413e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d02d9d640 1 -- 172.21.15.43:0/3827198494 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d041d1c00 con 0x7f4cec0039c0 2024-04-24T23:00:34.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d02d9d640 1 --2- 172.21.15.43:0/3827198494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cec0039c0 0x7f4d04071be0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4cf401ca90 tx=0x7f4cec005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4ceb7fe640 1 -- 172.21.15.43:0/3827198494 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4007d40 con 0x7f4cec0039c0 2024-04-24T23:00:34.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4ceb7fe640 1 -- 172.21.15.43:0/3827198494 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf4000ee0 con 0x7f4cec0039c0 2024-04-24T23:00:34.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4d090a5640 1 -- 172.21.15.43:0/3827198494 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d041d01b0 con 0x7f4cec0039c0 2024-04-24T23:00:34.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.363+0000 7f4ceb7fe640 1 -- 172.21.15.43:0/3827198494 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4007180 con 0x7f4cec0039c0 2024-04-24T23:00:34.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.367+0000 7f4d090a5640 1 -- 172.21.15.43:0/3827198494 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d041d1910 con 0x7f4cec0039c0 2024-04-24T23:00:34.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.367+0000 7f4d090a5640 1 -- 172.21.15.43:0/3827198494 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0404f580 con 0x7f4cec0039c0 2024-04-24T23:00:34.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.367+0000 7f4ceb7fe640 1 -- 172.21.15.43:0/3827198494 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4cf4007320 con 0x7f4cec0039c0 2024-04-24T23:00:34.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.367+0000 7f4ceb7fe640 1 --2- 172.21.15.43:0/3827198494 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4cf00678c0 0x7f4cf0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.367+0000 7f4ceb7fe640 1 -- 172.21.15.43:0/3827198494 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4cf411fcb0 con 0x7f4cec0039c0 2024-04-24T23:00:34.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.367+0000 7f4d0259c640 1 --2- 172.21.15.43:0/3827198494 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4cf00678c0 0x7f4cf0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.367+0000 7f4d0259c640 1 --2- 172.21.15.43:0/3827198494 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4cf00678c0 0x7f4cf0069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d04147ef0 tx=0x7f4cf8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.371+0000 7f4ceb7fe640 1 -- 172.21.15.43:0/3827198494 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f4cf4016970 con 0x7f4cec0039c0 2024-04-24T23:00:34.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.531+0000 7f4d090a5640 1 -- 172.21.15.43:0/3827198494 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d040b6560 con 0x7f4cf00678c0 2024-04-24T23:00:34.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.539+0000 7f4ceb7fe640 1 -- 172.21.15.43:0/3827198494 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332631 (secure 0 0 0) 0x7f4d040b6560 con 0x7f4cf00678c0 2024-04-24T23:00:34.549 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:34.552 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-24T23:00:34.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.547+0000 7f4d090a5640 1 -- 172.21.15.43:0/3827198494 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4cf00678c0 msgr2=0x7f4cf0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.547+0000 7f4d090a5640 1 --2- 172.21.15.43:0/3827198494 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4cf00678c0 0x7f4cf0069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d04147ef0 tx=0x7f4cf8009040 comp rx=0 tx=0).stop 2024-04-24T23:00:34.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.547+0000 7f4d090a5640 1 -- 172.21.15.43:0/3827198494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cec0039c0 msgr2=0x7f4d04071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.547+0000 7f4d090a5640 1 --2- 172.21.15.43:0/3827198494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cec0039c0 0x7f4d04071be0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4cf401ca90 tx=0x7f4cec005840 comp rx=0 tx=0).stop 2024-04-24T23:00:34.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.547+0000 7f4d090a5640 1 -- 172.21.15.43:0/3827198494 shutdown_connections 2024-04-24T23:00:34.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.547+0000 7f4d090a5640 1 --2- 172.21.15.43:0/3827198494 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4cf00678c0 0x7f4cf0069d80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.547+0000 7f4d090a5640 1 --2- 172.21.15.43:0/3827198494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d041cf4e0 0x7f4d0413e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.547+0000 7f4d090a5640 1 --2- 172.21.15.43:0/3827198494 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d041cfd30 0x7f4d041d13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.547+0000 7f4d090a5640 1 --2- 172.21.15.43:0/3827198494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cec0039c0 0x7f4d04071be0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.547+0000 7f4d090a5640 1 -- 172.21.15.43:0/3827198494 >> 172.21.15.43:0/3827198494 conn(0x7f4d040b5690 msgr2=0x7f4d0406d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:34.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.547+0000 7f4d090a5640 1 -- 172.21.15.43:0/3827198494 shutdown_connections 2024-04-24T23:00:34.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.547+0000 7f4d090a5640 1 -- 172.21.15.43:0/3827198494 wait complete. 2024-04-24T23:00:34.570 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-24T23:00:34.266849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235020,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739700,"statfs":{"total":773094113280,"available":772853452800,"internally_reserved":0,"allocated":2260992,"data_stored":2002040,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004109"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492662+0000","last_change":"2024-04-24T23:00:15.425241+0000","last_active":"2024-04-24T23:00:21.492662+0000","last_peered":"2024-04-24T23:00:21.492662+0000","last_clean":"2024-04-24T23:00:21.492662+0000","last_became_active":"2024-04-24T23:00:15.417152+0000","last_became_peered":"2024-04-24T23:00:15.417152+0000","last_unstale":"2024-04-24T23:00:21.492662+0000","last_undegraded":"2024-04-24T23:00:21.492662+0000","last_fullsized":"2024-04-24T23:00:21.492662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492334+0000","last_change":"2024-04-24T23:00:16.450360+0000","last_active":"2024-04-24T23:00:21.492334+0000","last_peered":"2024-04-24T23:00:21.492334+0000","last_clean":"2024-04-24T23:00:21.492334+0000","last_became_active":"2024-04-24T23:00:16.449631+0000","last_became_peered":"2024-04-24T23:00:16.449631+0000","last_unstale":"2024-04-24T23:00:21.492334+0000","last_undegraded":"2024-04-24T23:00:21.492334+0000","last_fullsized":"2024-04-24T23:00:21.492334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:03:09.773642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363750+0000","last_change":"2024-04-24T23:00:20.537107+0000","last_active":"2024-04-24T23:00:22.363750+0000","last_peered":"2024-04-24T23:00:22.363750+0000","last_clean":"2024-04-24T23:00:22.363750+0000","last_became_active":"2024-04-24T23:00:20.535916+0000","last_became_peered":"2024-04-24T23:00:20.535916+0000","last_unstale":"2024-04-24T23:00:22.363750+0000","last_undegraded":"2024-04-24T23:00:22.363750+0000","last_fullsized":"2024-04-24T23:00:22.363750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.364772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492571+0000","last_change":"2024-04-24T23:00:15.418251+0000","last_active":"2024-04-24T23:00:21.492571+0000","last_peered":"2024-04-24T23:00:21.492571+0000","last_clean":"2024-04-24T23:00:21.492571+0000","last_became_active":"2024-04-24T23:00:15.417502+0000","last_became_peered":"2024-04-24T23:00:15.417502+0000","last_unstale":"2024-04-24T23:00:21.492571+0000","last_undegraded":"2024-04-24T23:00:21.492571+0000","last_fullsized":"2024-04-24T23:00:21.492571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:50:53.490837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491649+0000","last_change":"2024-04-24T23:00:16.452960+0000","last_active":"2024-04-24T23:00:21.491649+0000","last_peered":"2024-04-24T23:00:21.491649+0000","last_clean":"2024-04-24T23:00:21.491649+0000","last_became_active":"2024-04-24T23:00:16.452212+0000","last_became_peered":"2024-04-24T23:00:16.452212+0000","last_unstale":"2024-04-24T23:00:21.491649+0000","last_undegraded":"2024-04-24T23:00:21.491649+0000","last_fullsized":"2024-04-24T23:00:21.491649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:26.361607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361169+0000","last_change":"2024-04-24T23:00:20.518435+0000","last_active":"2024-04-24T23:00:22.361169+0000","last_peered":"2024-04-24T23:00:22.361169+0000","last_clean":"2024-04-24T23:00:22.361169+0000","last_became_active":"2024-04-24T23:00:20.517975+0000","last_became_peered":"2024-04-24T23:00:20.517975+0000","last_unstale":"2024-04-24T23:00:22.361169+0000","last_undegraded":"2024-04-24T23:00:22.361169+0000","last_fullsized":"2024-04-24T23:00:22.361169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:36.410688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361368+0000","last_change":"2024-04-24T23:00:15.401804+0000","last_active":"2024-04-24T23:00:22.361368+0000","last_peered":"2024-04-24T23:00:22.361368+0000","last_clean":"2024-04-24T23:00:22.361368+0000","last_became_active":"2024-04-24T23:00:15.400064+0000","last_became_peered":"2024-04-24T23:00:15.400064+0000","last_unstale":"2024-04-24T23:00:22.361368+0000","last_undegraded":"2024-04-24T23:00:22.361368+0000","last_fullsized":"2024-04-24T23:00:22.361368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:26.588514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.748494+0000","last_change":"2024-04-24T23:00:16.451873+0000","last_active":"2024-04-24T23:00:21.748494+0000","last_peered":"2024-04-24T23:00:21.748494+0000","last_clean":"2024-04-24T23:00:21.748494+0000","last_became_active":"2024-04-24T23:00:16.451601+0000","last_became_peered":"2024-04-24T23:00:16.451601+0000","last_unstale":"2024-04-24T23:00:21.748494+0000","last_undegraded":"2024-04-24T23:00:21.748494+0000","last_fullsized":"2024-04-24T23:00:21.748494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:14.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361787+0000","last_change":"2024-04-24T23:00:20.518757+0000","last_active":"2024-04-24T23:00:22.361787+0000","last_peered":"2024-04-24T23:00:22.361787+0000","last_clean":"2024-04-24T23:00:22.361787+0000","last_became_active":"2024-04-24T23:00:20.518002+0000","last_became_peered":"2024-04-24T23:00:20.518002+0000","last_unstale":"2024-04-24T23:00:22.361787+0000","last_undegraded":"2024-04-24T23:00:22.361787+0000","last_fullsized":"2024-04-24T23:00:22.361787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361059+0000","last_change":"2024-04-24T23:00:15.398338+0000","last_active":"2024-04-24T23:00:22.361059+0000","last_peered":"2024-04-24T23:00:22.361059+0000","last_clean":"2024-04-24T23:00:22.361059+0000","last_became_active":"2024-04-24T23:00:15.395766+0000","last_became_peered":"2024-04-24T23:00:15.395766+0000","last_unstale":"2024-04-24T23:00:22.361059+0000","last_undegraded":"2024-04-24T23:00:22.361059+0000","last_fullsized":"2024-04-24T23:00:22.361059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:30.228280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487678+0000","last_change":"2024-04-24T23:00:16.458641+0000","last_active":"2024-04-24T23:00:21.487678+0000","last_peered":"2024-04-24T23:00:21.487678+0000","last_clean":"2024-04-24T23:00:21.487678+0000","last_became_active":"2024-04-24T23:00:16.458237+0000","last_became_peered":"2024-04-24T23:00:16.458237+0000","last_unstale":"2024-04-24T23:00:21.487678+0000","last_undegraded":"2024-04-24T23:00:21.487678+0000","last_fullsized":"2024-04-24T23:00:21.487678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:22:17.631542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361245+0000","last_change":"2024-04-24T23:00:20.518742+0000","last_active":"2024-04-24T23:00:22.361245+0000","last_peered":"2024-04-24T23:00:22.361245+0000","last_clean":"2024-04-24T23:00:22.361245+0000","last_became_active":"2024-04-24T23:00:20.518163+0000","last_became_peered":"2024-04-24T23:00:20.518163+0000","last_unstale":"2024-04-24T23:00:22.361245+0000","last_undegraded":"2024-04-24T23:00:22.361245+0000","last_fullsized":"2024-04-24T23:00:22.361245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:35.156511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486896+0000","last_change":"2024-04-24T23:00:16.448014+0000","last_active":"2024-04-24T23:00:21.486896+0000","last_peered":"2024-04-24T23:00:21.486896+0000","last_clean":"2024-04-24T23:00:21.486896+0000","last_became_active":"2024-04-24T23:00:16.447488+0000","last_became_peered":"2024-04-24T23:00:16.447488+0000","last_unstale":"2024-04-24T23:00:21.486896+0000","last_undegraded":"2024-04-24T23:00:21.486896+0000","last_fullsized":"2024-04-24T23:00:21.486896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:29.852278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487660+0000","last_change":"2024-04-24T23:00:15.408781+0000","last_active":"2024-04-24T23:00:21.487660+0000","last_peered":"2024-04-24T23:00:21.487660+0000","last_clean":"2024-04-24T23:00:21.487660+0000","last_became_active":"2024-04-24T23:00:15.408120+0000","last_became_peered":"2024-04-24T23:00:15.408120+0000","last_unstale":"2024-04-24T23:00:21.487660+0000","last_undegraded":"2024-04-24T23:00:21.487660+0000","last_fullsized":"2024-04-24T23:00:21.487660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:38.560562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487495+0000","last_change":"2024-04-24T23:00:20.503964+0000","last_active":"2024-04-24T23:00:21.487495+0000","last_peered":"2024-04-24T23:00:21.487495+0000","last_clean":"2024-04-24T23:00:21.487495+0000","last_became_active":"2024-04-24T23:00:20.501703+0000","last_became_peered":"2024-04-24T23:00:20.501703+0000","last_unstale":"2024-04-24T23:00:21.487495+0000","last_undegraded":"2024-04-24T23:00:21.487495+0000","last_fullsized":"2024-04-24T23:00:21.487495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:40.258673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365366+0000","last_change":"2024-04-24T23:00:16.472987+0000","last_active":"2024-04-24T23:00:22.365366+0000","last_peered":"2024-04-24T23:00:22.365366+0000","last_clean":"2024-04-24T23:00:22.365366+0000","last_became_active":"2024-04-24T23:00:16.472226+0000","last_became_peered":"2024-04-24T23:00:16.472226+0000","last_unstale":"2024-04-24T23:00:22.365366+0000","last_undegraded":"2024-04-24T23:00:22.365366+0000","last_fullsized":"2024-04-24T23:00:22.365366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364010+0000","last_change":"2024-04-24T23:00:15.422963+0000","last_active":"2024-04-24T23:00:22.364010+0000","last_peered":"2024-04-24T23:00:22.364010+0000","last_clean":"2024-04-24T23:00:22.364010+0000","last_became_active":"2024-04-24T23:00:15.422121+0000","last_became_peered":"2024-04-24T23:00:15.422121+0000","last_unstale":"2024-04-24T23:00:22.364010+0000","last_undegraded":"2024-04-24T23:00:22.364010+0000","last_fullsized":"2024-04-24T23:00:22.364010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360721+0000","last_change":"2024-04-24T23:00:20.540688+0000","last_active":"2024-04-24T23:00:22.360721+0000","last_peered":"2024-04-24T23:00:22.360721+0000","last_clean":"2024-04-24T23:00:22.360721+0000","last_became_active":"2024-04-24T23:00:20.540220+0000","last_became_peered":"2024-04-24T23:00:20.540220+0000","last_unstale":"2024-04-24T23:00:22.360721+0000","last_undegraded":"2024-04-24T23:00:22.360721+0000","last_fullsized":"2024-04-24T23:00:22.360721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:33.931661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489044+0000","last_change":"2024-04-24T23:00:16.488633+0000","last_active":"2024-04-24T23:00:21.489044+0000","last_peered":"2024-04-24T23:00:21.489044+0000","last_clean":"2024-04-24T23:00:21.489044+0000","last_became_active":"2024-04-24T23:00:16.487476+0000","last_became_peered":"2024-04-24T23:00:16.487476+0000","last_unstale":"2024-04-24T23:00:21.489044+0000","last_undegraded":"2024-04-24T23:00:21.489044+0000","last_fullsized":"2024-04-24T23:00:21.489044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:06.907656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489774+0000","last_change":"2024-04-24T23:00:15.397973+0000","last_active":"2024-04-24T23:00:21.489774+0000","last_peered":"2024-04-24T23:00:21.489774+0000","last_clean":"2024-04-24T23:00:21.489774+0000","last_became_active":"2024-04-24T23:00:15.396600+0000","last_became_peered":"2024-04-24T23:00:15.396600+0000","last_unstale":"2024-04-24T23:00:21.489774+0000","last_undegraded":"2024-04-24T23:00:21.489774+0000","last_fullsized":"2024-04-24T23:00:21.489774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:22.932046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364875+0000","last_change":"2024-04-24T23:00:20.511547+0000","last_active":"2024-04-24T23:00:22.364875+0000","last_peered":"2024-04-24T23:00:22.364875+0000","last_clean":"2024-04-24T23:00:22.364875+0000","last_became_active":"2024-04-24T23:00:20.510602+0000","last_became_peered":"2024-04-24T23:00:20.510602+0000","last_unstale":"2024-04-24T23:00:22.364875+0000","last_undegraded":"2024-04-24T23:00:22.364875+0000","last_fullsized":"2024-04-24T23:00:22.364875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:17.847434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486773+0000","last_change":"2024-04-24T23:00:16.483393+0000","last_active":"2024-04-24T23:00:21.486773+0000","last_peered":"2024-04-24T23:00:21.486773+0000","last_clean":"2024-04-24T23:00:21.486773+0000","last_became_active":"2024-04-24T23:00:16.483092+0000","last_became_peered":"2024-04-24T23:00:16.483092+0000","last_unstale":"2024-04-24T23:00:21.486773+0000","last_undegraded":"2024-04-24T23:00:21.486773+0000","last_fullsized":"2024-04-24T23:00:21.486773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:38.429072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360305+0000","last_change":"2024-04-24T23:00:15.398005+0000","last_active":"2024-04-24T23:00:22.360305+0000","last_peered":"2024-04-24T23:00:22.360305+0000","last_clean":"2024-04-24T23:00:22.360305+0000","last_became_active":"2024-04-24T23:00:15.397638+0000","last_became_peered":"2024-04-24T23:00:15.397638+0000","last_unstale":"2024-04-24T23:00:22.360305+0000","last_undegraded":"2024-04-24T23:00:22.360305+0000","last_fullsized":"2024-04-24T23:00:22.360305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362139+0000","last_change":"2024-04-24T23:00:20.505995+0000","last_active":"2024-04-24T23:00:22.362139+0000","last_peered":"2024-04-24T23:00:22.362139+0000","last_clean":"2024-04-24T23:00:22.362139+0000","last_became_active":"2024-04-24T23:00:20.505532+0000","last_became_peered":"2024-04-24T23:00:20.505532+0000","last_unstale":"2024-04-24T23:00:22.362139+0000","last_undegraded":"2024-04-24T23:00:22.362139+0000","last_fullsized":"2024-04-24T23:00:22.362139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:42.508455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491149+0000","last_change":"2024-04-24T23:00:16.484306+0000","last_active":"2024-04-24T23:00:21.491149+0000","last_peered":"2024-04-24T23:00:21.491149+0000","last_clean":"2024-04-24T23:00:21.491149+0000","last_became_active":"2024-04-24T23:00:16.483585+0000","last_became_peered":"2024-04-24T23:00:16.483585+0000","last_unstale":"2024-04-24T23:00:21.491149+0000","last_undegraded":"2024-04-24T23:00:21.491149+0000","last_fullsized":"2024-04-24T23:00:21.491149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:53.051451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488704+0000","last_change":"2024-04-24T23:00:15.421158+0000","last_active":"2024-04-24T23:00:21.488704+0000","last_peered":"2024-04-24T23:00:21.488704+0000","last_clean":"2024-04-24T23:00:21.488704+0000","last_became_active":"2024-04-24T23:00:15.420839+0000","last_became_peered":"2024-04-24T23:00:15.420839+0000","last_unstale":"2024-04-24T23:00:21.488704+0000","last_undegraded":"2024-04-24T23:00:21.488704+0000","last_fullsized":"2024-04-24T23:00:21.488704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:03.276247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361402+0000","last_change":"2024-04-24T23:00:20.519755+0000","last_active":"2024-04-24T23:00:22.361402+0000","last_peered":"2024-04-24T23:00:22.361402+0000","last_clean":"2024-04-24T23:00:22.361402+0000","last_became_active":"2024-04-24T23:00:20.518470+0000","last_became_peered":"2024-04-24T23:00:20.518470+0000","last_unstale":"2024-04-24T23:00:22.361402+0000","last_undegraded":"2024-04-24T23:00:22.361402+0000","last_fullsized":"2024-04-24T23:00:22.361402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:14.639189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492639+0000","last_change":"2024-04-24T23:00:16.464487+0000","last_active":"2024-04-24T23:00:21.492639+0000","last_peered":"2024-04-24T23:00:21.492639+0000","last_clean":"2024-04-24T23:00:21.492639+0000","last_became_active":"2024-04-24T23:00:16.463565+0000","last_became_peered":"2024-04-24T23:00:16.463565+0000","last_unstale":"2024-04-24T23:00:21.492639+0000","last_undegraded":"2024-04-24T23:00:21.492639+0000","last_fullsized":"2024-04-24T23:00:21.492639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491680+0000","last_change":"2024-04-24T23:00:15.400228+0000","last_active":"2024-04-24T23:00:21.491680+0000","last_peered":"2024-04-24T23:00:21.491680+0000","last_clean":"2024-04-24T23:00:21.491680+0000","last_became_active":"2024-04-24T23:00:15.397465+0000","last_became_peered":"2024-04-24T23:00:15.397465+0000","last_unstale":"2024-04-24T23:00:21.491680+0000","last_undegraded":"2024-04-24T23:00:21.491680+0000","last_fullsized":"2024-04-24T23:00:21.491680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488900+0000","last_change":"2024-04-24T23:00:20.516766+0000","last_active":"2024-04-24T23:00:21.488900+0000","last_peered":"2024-04-24T23:00:21.488900+0000","last_clean":"2024-04-24T23:00:21.488900+0000","last_became_active":"2024-04-24T23:00:20.515972+0000","last_became_peered":"2024-04-24T23:00:20.515972+0000","last_unstale":"2024-04-24T23:00:21.488900+0000","last_undegraded":"2024-04-24T23:00:21.488900+0000","last_fullsized":"2024-04-24T23:00:21.488900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365547+0000","last_change":"2024-04-24T23:00:16.480627+0000","last_active":"2024-04-24T23:00:22.365547+0000","last_peered":"2024-04-24T23:00:22.365547+0000","last_clean":"2024-04-24T23:00:22.365547+0000","last_became_active":"2024-04-24T23:00:16.480021+0000","last_became_peered":"2024-04-24T23:00:16.480021+0000","last_unstale":"2024-04-24T23:00:22.365547+0000","last_undegraded":"2024-04-24T23:00:22.365547+0000","last_fullsized":"2024-04-24T23:00:22.365547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:04.285389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488322+0000","last_change":"2024-04-24T23:00:15.428375+0000","last_active":"2024-04-24T23:00:21.488322+0000","last_peered":"2024-04-24T23:00:21.488322+0000","last_clean":"2024-04-24T23:00:21.488322+0000","last_became_active":"2024-04-24T23:00:15.428016+0000","last_became_peered":"2024-04-24T23:00:15.428016+0000","last_unstale":"2024-04-24T23:00:21.488322+0000","last_undegraded":"2024-04-24T23:00:21.488322+0000","last_fullsized":"2024-04-24T23:00:21.488322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:24.759195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363541+0000","last_change":"2024-04-24T23:00:20.535274+0000","last_active":"2024-04-24T23:00:22.363541+0000","last_peered":"2024-04-24T23:00:22.363541+0000","last_clean":"2024-04-24T23:00:22.363541+0000","last_became_active":"2024-04-24T23:00:20.524747+0000","last_became_peered":"2024-04-24T23:00:20.524747+0000","last_unstale":"2024-04-24T23:00:22.363541+0000","last_undegraded":"2024-04-24T23:00:22.363541+0000","last_fullsized":"2024-04-24T23:00:22.363541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.814128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361971+0000","last_change":"2024-04-24T23:00:16.456641+0000","last_active":"2024-04-24T23:00:22.361971+0000","last_peered":"2024-04-24T23:00:22.361971+0000","last_clean":"2024-04-24T23:00:22.361971+0000","last_became_active":"2024-04-24T23:00:16.456268+0000","last_became_peered":"2024-04-24T23:00:16.456268+0000","last_unstale":"2024-04-24T23:00:22.361971+0000","last_undegraded":"2024-04-24T23:00:22.361971+0000","last_fullsized":"2024-04-24T23:00:22.361971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491288+0000","last_change":"2024-04-24T23:00:15.429119+0000","last_active":"2024-04-24T23:00:21.491288+0000","last_peered":"2024-04-24T23:00:21.491288+0000","last_clean":"2024-04-24T23:00:21.491288+0000","last_became_active":"2024-04-24T23:00:15.428374+0000","last_became_peered":"2024-04-24T23:00:15.428374+0000","last_unstale":"2024-04-24T23:00:21.491288+0000","last_undegraded":"2024-04-24T23:00:21.491288+0000","last_fullsized":"2024-04-24T23:00:21.491288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:13:30.412685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363356+0000","last_change":"2024-04-24T23:00:20.535730+0000","last_active":"2024-04-24T23:00:22.363356+0000","last_peered":"2024-04-24T23:00:22.363356+0000","last_clean":"2024-04-24T23:00:22.363356+0000","last_became_active":"2024-04-24T23:00:20.534430+0000","last_became_peered":"2024-04-24T23:00:20.534430+0000","last_unstale":"2024-04-24T23:00:22.363356+0000","last_undegraded":"2024-04-24T23:00:22.363356+0000","last_fullsized":"2024-04-24T23:00:22.363356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:35.156511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360697+0000","last_change":"2024-04-24T23:00:16.444070+0000","last_active":"2024-04-24T23:00:22.360697+0000","last_peered":"2024-04-24T23:00:22.360697+0000","last_clean":"2024-04-24T23:00:22.360697+0000","last_became_active":"2024-04-24T23:00:16.443620+0000","last_became_peered":"2024-04-24T23:00:16.443620+0000","last_unstale":"2024-04-24T23:00:22.360697+0000","last_undegraded":"2024-04-24T23:00:22.360697+0000","last_fullsized":"2024-04-24T23:00:22.360697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:31.077128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487637+0000","last_change":"2024-04-24T23:00:15.422571+0000","last_active":"2024-04-24T23:00:21.487637+0000","last_peered":"2024-04-24T23:00:21.487637+0000","last_clean":"2024-04-24T23:00:21.487637+0000","last_became_active":"2024-04-24T23:00:15.422167+0000","last_became_peered":"2024-04-24T23:00:15.422167+0000","last_unstale":"2024-04-24T23:00:21.487637+0000","last_undegraded":"2024-04-24T23:00:21.487637+0000","last_fullsized":"2024-04-24T23:00:21.487637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:29.417228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365058+0000","last_change":"2024-04-24T23:00:20.540587+0000","last_active":"2024-04-24T23:00:22.365058+0000","last_peered":"2024-04-24T23:00:22.365058+0000","last_clean":"2024-04-24T23:00:22.365058+0000","last_became_active":"2024-04-24T23:00:20.524719+0000","last_became_peered":"2024-04-24T23:00:20.524719+0000","last_unstale":"2024-04-24T23:00:22.365058+0000","last_undegraded":"2024-04-24T23:00:22.365058+0000","last_fullsized":"2024-04-24T23:00:22.365058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488063+0000","last_change":"2024-04-24T23:00:16.471678+0000","last_active":"2024-04-24T23:00:21.488063+0000","last_peered":"2024-04-24T23:00:21.488063+0000","last_clean":"2024-04-24T23:00:21.488063+0000","last_became_active":"2024-04-24T23:00:16.469390+0000","last_became_peered":"2024-04-24T23:00:16.469390+0000","last_unstale":"2024-04-24T23:00:21.488063+0000","last_undegraded":"2024-04-24T23:00:21.488063+0000","last_fullsized":"2024-04-24T23:00:21.488063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:31:59.778549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363883+0000","last_change":"2024-04-24T23:00:15.423024+0000","last_active":"2024-04-24T23:00:22.363883+0000","last_peered":"2024-04-24T23:00:22.363883+0000","last_clean":"2024-04-24T23:00:22.363883+0000","last_became_active":"2024-04-24T23:00:15.422275+0000","last_became_peered":"2024-04-24T23:00:15.422275+0000","last_unstale":"2024-04-24T23:00:22.363883+0000","last_undegraded":"2024-04-24T23:00:22.363883+0000","last_fullsized":"2024-04-24T23:00:22.363883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365241+0000","last_change":"2024-04-24T23:00:20.535131+0000","last_active":"2024-04-24T23:00:22.365241+0000","last_peered":"2024-04-24T23:00:22.365241+0000","last_clean":"2024-04-24T23:00:22.365241+0000","last_became_active":"2024-04-24T23:00:20.534325+0000","last_became_peered":"2024-04-24T23:00:20.534325+0000","last_unstale":"2024-04-24T23:00:22.365241+0000","last_undegraded":"2024-04-24T23:00:22.365241+0000","last_fullsized":"2024-04-24T23:00:22.365241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363140+0000","last_change":"2024-04-24T23:00:16.451991+0000","last_active":"2024-04-24T23:00:22.363140+0000","last_peered":"2024-04-24T23:00:22.363140+0000","last_clean":"2024-04-24T23:00:22.363140+0000","last_became_active":"2024-04-24T23:00:16.451226+0000","last_became_peered":"2024-04-24T23:00:16.451226+0000","last_unstale":"2024-04-24T23:00:22.363140+0000","last_undegraded":"2024-04-24T23:00:22.363140+0000","last_fullsized":"2024-04-24T23:00:22.363140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:30.426371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487107+0000","last_change":"2024-04-24T23:00:15.414535+0000","last_active":"2024-04-24T23:00:21.487107+0000","last_peered":"2024-04-24T23:00:21.487107+0000","last_clean":"2024-04-24T23:00:21.487107+0000","last_became_active":"2024-04-24T23:00:15.414224+0000","last_became_peered":"2024-04-24T23:00:15.414224+0000","last_unstale":"2024-04-24T23:00:21.487107+0000","last_undegraded":"2024-04-24T23:00:21.487107+0000","last_fullsized":"2024-04-24T23:00:21.487107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:30.228280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491178+0000","last_change":"2024-04-24T23:00:20.531159+0000","last_active":"2024-04-24T23:00:21.491178+0000","last_peered":"2024-04-24T23:00:21.491178+0000","last_clean":"2024-04-24T23:00:21.491178+0000","last_became_active":"2024-04-24T23:00:20.530682+0000","last_became_peered":"2024-04-24T23:00:20.530682+0000","last_unstale":"2024-04-24T23:00:21.491178+0000","last_undegraded":"2024-04-24T23:00:21.491178+0000","last_fullsized":"2024-04-24T23:00:21.491178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:45.629364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490334+0000","last_change":"2024-04-24T23:00:16.481649+0000","last_active":"2024-04-24T23:00:21.490334+0000","last_peered":"2024-04-24T23:00:21.490334+0000","last_clean":"2024-04-24T23:00:21.490334+0000","last_became_active":"2024-04-24T23:00:16.477192+0000","last_became_peered":"2024-04-24T23:00:16.477192+0000","last_unstale":"2024-04-24T23:00:21.490334+0000","last_undegraded":"2024-04-24T23:00:21.490334+0000","last_fullsized":"2024-04-24T23:00:21.490334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:13.768051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487760+0000","last_change":"2024-04-24T23:00:15.407927+0000","last_active":"2024-04-24T23:00:21.487760+0000","last_peered":"2024-04-24T23:00:21.487760+0000","last_clean":"2024-04-24T23:00:21.487760+0000","last_became_active":"2024-04-24T23:00:15.407609+0000","last_became_peered":"2024-04-24T23:00:15.407609+0000","last_unstale":"2024-04-24T23:00:21.487760+0000","last_undegraded":"2024-04-24T23:00:21.487760+0000","last_fullsized":"2024-04-24T23:00:21.487760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:13.689340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.747953+0000","last_change":"2024-04-24T23:00:03.344529+0000","last_active":"2024-04-24T23:00:21.747953+0000","last_peered":"2024-04-24T23:00:21.747953+0000","last_clean":"2024-04-24T23:00:21.747953+0000","last_became_active":"2024-04-24T23:00:03.344074+0000","last_became_peered":"2024-04-24T23:00:03.344074+0000","last_unstale":"2024-04-24T23:00:21.747953+0000","last_undegraded":"2024-04-24T23:00:21.747953+0000","last_fullsized":"2024-04-24T23:00:21.747953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:02.322380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:02.322380+0000","last_clean_scrub_stamp":"2024-04-24T23:00:02.322380+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:40.550881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488278+0000","last_change":"2024-04-24T23:00:20.492015+0000","last_active":"2024-04-24T23:00:21.488278+0000","last_peered":"2024-04-24T23:00:21.488278+0000","last_clean":"2024-04-24T23:00:21.488278+0000","last_became_active":"2024-04-24T23:00:20.491092+0000","last_became_peered":"2024-04-24T23:00:20.491092+0000","last_unstale":"2024-04-24T23:00:21.488278+0000","last_undegraded":"2024-04-24T23:00:21.488278+0000","last_fullsized":"2024-04-24T23:00:21.488278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:49:22.306663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487732+0000","last_change":"2024-04-24T23:00:16.448759+0000","last_active":"2024-04-24T23:00:21.487732+0000","last_peered":"2024-04-24T23:00:21.487732+0000","last_clean":"2024-04-24T23:00:21.487732+0000","last_became_active":"2024-04-24T23:00:16.448187+0000","last_became_peered":"2024-04-24T23:00:16.448187+0000","last_unstale":"2024-04-24T23:00:21.487732+0000","last_undegraded":"2024-04-24T23:00:21.487732+0000","last_fullsized":"2024-04-24T23:00:21.487732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:08:59.708506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365797+0000","last_change":"2024-04-24T23:00:15.436270+0000","last_active":"2024-04-24T23:00:22.365797+0000","last_peered":"2024-04-24T23:00:22.365797+0000","last_clean":"2024-04-24T23:00:22.365797+0000","last_became_active":"2024-04-24T23:00:15.425134+0000","last_became_peered":"2024-04-24T23:00:15.425134+0000","last_unstale":"2024-04-24T23:00:22.365797+0000","last_undegraded":"2024-04-24T23:00:22.365797+0000","last_fullsized":"2024-04-24T23:00:22.365797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361374+0000","last_change":"2024-04-24T23:00:20.500617+0000","last_active":"2024-04-24T23:00:22.361374+0000","last_peered":"2024-04-24T23:00:22.361374+0000","last_clean":"2024-04-24T23:00:22.361374+0000","last_became_active":"2024-04-24T23:00:20.500158+0000","last_became_peered":"2024-04-24T23:00:20.500158+0000","last_unstale":"2024-04-24T23:00:22.361374+0000","last_undegraded":"2024-04-24T23:00:22.361374+0000","last_fullsized":"2024-04-24T23:00:22.361374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.814128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360974+0000","last_change":"2024-04-24T23:00:16.471754+0000","last_active":"2024-04-24T23:00:22.360974+0000","last_peered":"2024-04-24T23:00:22.360974+0000","last_clean":"2024-04-24T23:00:22.360974+0000","last_became_active":"2024-04-24T23:00:16.471497+0000","last_became_peered":"2024-04-24T23:00:16.471497+0000","last_unstale":"2024-04-24T23:00:22.360974+0000","last_undegraded":"2024-04-24T23:00:22.360974+0000","last_fullsized":"2024-04-24T23:00:22.360974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:27.760709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491588+0000","last_change":"2024-04-24T23:00:15.406401+0000","last_active":"2024-04-24T23:00:21.491588+0000","last_peered":"2024-04-24T23:00:21.491588+0000","last_clean":"2024-04-24T23:00:21.491588+0000","last_became_active":"2024-04-24T23:00:15.405636+0000","last_became_peered":"2024-04-24T23:00:15.405636+0000","last_unstale":"2024-04-24T23:00:21.491588+0000","last_undegraded":"2024-04-24T23:00:21.491588+0000","last_fullsized":"2024-04-24T23:00:21.491588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:02.654515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491774+0000","last_change":"2024-04-24T23:00:20.502050+0000","last_active":"2024-04-24T23:00:21.491774+0000","last_peered":"2024-04-24T23:00:21.491774+0000","last_clean":"2024-04-24T23:00:21.491774+0000","last_became_active":"2024-04-24T23:00:20.500153+0000","last_became_peered":"2024-04-24T23:00:20.500153+0000","last_unstale":"2024-04-24T23:00:21.491774+0000","last_undegraded":"2024-04-24T23:00:21.491774+0000","last_fullsized":"2024-04-24T23:00:21.491774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:51.285256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361451+0000","last_change":"2024-04-24T23:00:16.446762+0000","last_active":"2024-04-24T23:00:22.361451+0000","last_peered":"2024-04-24T23:00:22.361451+0000","last_clean":"2024-04-24T23:00:22.361451+0000","last_became_active":"2024-04-24T23:00:16.446170+0000","last_became_peered":"2024-04-24T23:00:16.446170+0000","last_unstale":"2024-04-24T23:00:22.361451+0000","last_undegraded":"2024-04-24T23:00:22.361451+0000","last_fullsized":"2024-04-24T23:00:22.361451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.801913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491407+0000","last_change":"2024-04-24T23:00:15.423703+0000","last_active":"2024-04-24T23:00:21.491407+0000","last_peered":"2024-04-24T23:00:21.491407+0000","last_clean":"2024-04-24T23:00:21.491407+0000","last_became_active":"2024-04-24T23:00:15.414863+0000","last_became_peered":"2024-04-24T23:00:15.414863+0000","last_unstale":"2024-04-24T23:00:21.491407+0000","last_undegraded":"2024-04-24T23:00:21.491407+0000","last_fullsized":"2024-04-24T23:00:21.491407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:26.588514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486409+0000","last_change":"2024-04-24T23:00:20.499277+0000","last_active":"2024-04-24T23:00:21.486409+0000","last_peered":"2024-04-24T23:00:21.486409+0000","last_clean":"2024-04-24T23:00:21.486409+0000","last_became_active":"2024-04-24T23:00:20.498802+0000","last_became_peered":"2024-04-24T23:00:20.498802+0000","last_unstale":"2024-04-24T23:00:21.486409+0000","last_undegraded":"2024-04-24T23:00:21.486409+0000","last_fullsized":"2024-04-24T23:00:21.486409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:32.166063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362253+0000","last_change":"2024-04-24T23:00:16.448112+0000","last_active":"2024-04-24T23:00:22.362253+0000","last_peered":"2024-04-24T23:00:22.362253+0000","last_clean":"2024-04-24T23:00:22.362253+0000","last_became_active":"2024-04-24T23:00:16.447838+0000","last_became_peered":"2024-04-24T23:00:16.447838+0000","last_unstale":"2024-04-24T23:00:22.362253+0000","last_undegraded":"2024-04-24T23:00:22.362253+0000","last_fullsized":"2024-04-24T23:00:22.362253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:24.143678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361996+0000","last_change":"2024-04-24T23:00:15.420914+0000","last_active":"2024-04-24T23:00:22.361996+0000","last_peered":"2024-04-24T23:00:22.361996+0000","last_clean":"2024-04-24T23:00:22.361996+0000","last_became_active":"2024-04-24T23:00:15.420590+0000","last_became_peered":"2024-04-24T23:00:15.420590+0000","last_unstale":"2024-04-24T23:00:22.361996+0000","last_undegraded":"2024-04-24T23:00:22.361996+0000","last_fullsized":"2024-04-24T23:00:22.361996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:53.443962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.748466+0000","last_change":"2024-04-24T23:00:20.494192+0000","last_active":"2024-04-24T23:00:21.748466+0000","last_peered":"2024-04-24T23:00:21.748466+0000","last_clean":"2024-04-24T23:00:21.748466+0000","last_became_active":"2024-04-24T23:00:20.493784+0000","last_became_peered":"2024-04-24T23:00:20.493784+0000","last_unstale":"2024-04-24T23:00:21.748466+0000","last_undegraded":"2024-04-24T23:00:21.748466+0000","last_fullsized":"2024-04-24T23:00:21.748466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:10.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486486+0000","last_change":"2024-04-24T23:00:16.452682+0000","last_active":"2024-04-24T23:00:21.486486+0000","last_peered":"2024-04-24T23:00:21.486486+0000","last_clean":"2024-04-24T23:00:21.486486+0000","last_became_active":"2024-04-24T23:00:16.447742+0000","last_became_peered":"2024-04-24T23:00:16.447742+0000","last_unstale":"2024-04-24T23:00:21.486486+0000","last_undegraded":"2024-04-24T23:00:21.486486+0000","last_fullsized":"2024-04-24T23:00:21.486486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.801913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489312+0000","last_change":"2024-04-24T23:00:15.416986+0000","last_active":"2024-04-24T23:00:21.489312+0000","last_peered":"2024-04-24T23:00:21.489312+0000","last_clean":"2024-04-24T23:00:21.489312+0000","last_became_active":"2024-04-24T23:00:15.416198+0000","last_became_peered":"2024-04-24T23:00:15.416198+0000","last_unstale":"2024-04-24T23:00:21.489312+0000","last_undegraded":"2024-04-24T23:00:21.489312+0000","last_fullsized":"2024-04-24T23:00:21.489312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:27.810443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492094+0000","last_change":"2024-04-24T23:00:20.526621+0000","last_active":"2024-04-24T23:00:21.492094+0000","last_peered":"2024-04-24T23:00:21.492094+0000","last_clean":"2024-04-24T23:00:21.492094+0000","last_became_active":"2024-04-24T23:00:20.525782+0000","last_became_peered":"2024-04-24T23:00:20.525782+0000","last_unstale":"2024-04-24T23:00:21.492094+0000","last_undegraded":"2024-04-24T23:00:21.492094+0000","last_fullsized":"2024-04-24T23:00:21.492094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:38:28.209697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.747735+0000","last_change":"2024-04-24T23:00:16.454748+0000","last_active":"2024-04-24T23:00:21.747735+0000","last_peered":"2024-04-24T23:00:21.747735+0000","last_clean":"2024-04-24T23:00:21.747735+0000","last_became_active":"2024-04-24T23:00:16.454031+0000","last_became_peered":"2024-04-24T23:00:16.454031+0000","last_unstale":"2024-04-24T23:00:21.747735+0000","last_undegraded":"2024-04-24T23:00:21.747735+0000","last_fullsized":"2024-04-24T23:00:21.747735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:31.237423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360689+0000","last_change":"2024-04-24T23:00:15.420149+0000","last_active":"2024-04-24T23:00:22.360689+0000","last_peered":"2024-04-24T23:00:22.360689+0000","last_clean":"2024-04-24T23:00:22.360689+0000","last_became_active":"2024-04-24T23:00:15.416688+0000","last_became_peered":"2024-04-24T23:00:15.416688+0000","last_unstale":"2024-04-24T23:00:22.360689+0000","last_undegraded":"2024-04-24T23:00:22.360689+0000","last_fullsized":"2024-04-24T23:00:22.360689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:27.810443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491371+0000","last_change":"2024-04-24T23:00:20.517137+0000","last_active":"2024-04-24T23:00:21.491371+0000","last_peered":"2024-04-24T23:00:21.491371+0000","last_clean":"2024-04-24T23:00:21.491371+0000","last_became_active":"2024-04-24T23:00:20.516152+0000","last_became_peered":"2024-04-24T23:00:20.516152+0000","last_unstale":"2024-04-24T23:00:21.491371+0000","last_undegraded":"2024-04-24T23:00:21.491371+0000","last_fullsized":"2024-04-24T23:00:21.491371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:29.452352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487144+0000","last_change":"2024-04-24T23:00:16.458939+0000","last_active":"2024-04-24T23:00:21.487144+0000","last_peered":"2024-04-24T23:00:21.487144+0000","last_clean":"2024-04-24T23:00:21.487144+0000","last_became_active":"2024-04-24T23:00:16.458081+0000","last_became_peered":"2024-04-24T23:00:16.458081+0000","last_unstale":"2024-04-24T23:00:21.487144+0000","last_undegraded":"2024-04-24T23:00:21.487144+0000","last_fullsized":"2024-04-24T23:00:21.487144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:27.760709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487474+0000","last_change":"2024-04-24T23:00:15.413409+0000","last_active":"2024-04-24T23:00:21.487474+0000","last_peered":"2024-04-24T23:00:21.487474+0000","last_clean":"2024-04-24T23:00:21.487474+0000","last_became_active":"2024-04-24T23:00:15.412847+0000","last_became_peered":"2024-04-24T23:00:15.412847+0000","last_unstale":"2024-04-24T23:00:21.487474+0000","last_undegraded":"2024-04-24T23:00:21.487474+0000","last_fullsized":"2024-04-24T23:00:21.487474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:35.114960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364628+0000","last_change":"2024-04-24T23:00:20.536112+0000","last_active":"2024-04-24T23:00:22.364628+0000","last_peered":"2024-04-24T23:00:22.364628+0000","last_clean":"2024-04-24T23:00:22.364628+0000","last_became_active":"2024-04-24T23:00:20.529427+0000","last_became_peered":"2024-04-24T23:00:20.529427+0000","last_unstale":"2024-04-24T23:00:22.364628+0000","last_undegraded":"2024-04-24T23:00:22.364628+0000","last_fullsized":"2024-04-24T23:00:22.364628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:14.639189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363813+0000","last_change":"2024-04-24T23:00:16.465373+0000","last_active":"2024-04-24T23:00:22.363813+0000","last_peered":"2024-04-24T23:00:22.363813+0000","last_clean":"2024-04-24T23:00:22.363813+0000","last_became_active":"2024-04-24T23:00:16.464653+0000","last_became_peered":"2024-04-24T23:00:16.464653+0000","last_unstale":"2024-04-24T23:00:22.363813+0000","last_undegraded":"2024-04-24T23:00:22.363813+0000","last_fullsized":"2024-04-24T23:00:22.363813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:24.143678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365627+0000","last_change":"2024-04-24T23:00:15.427483+0000","last_active":"2024-04-24T23:00:22.365627+0000","last_peered":"2024-04-24T23:00:22.365627+0000","last_clean":"2024-04-24T23:00:22.365627+0000","last_became_active":"2024-04-24T23:00:15.426641+0000","last_became_peered":"2024-04-24T23:00:15.426641+0000","last_unstale":"2024-04-24T23:00:22.365627+0000","last_undegraded":"2024-04-24T23:00:22.365627+0000","last_fullsized":"2024-04-24T23:00:22.365627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487531+0000","last_change":"2024-04-24T23:00:20.518479+0000","last_active":"2024-04-24T23:00:21.487531+0000","last_peered":"2024-04-24T23:00:21.487531+0000","last_clean":"2024-04-24T23:00:21.487531+0000","last_became_active":"2024-04-24T23:00:20.517950+0000","last_became_peered":"2024-04-24T23:00:20.517950+0000","last_unstale":"2024-04-24T23:00:21.487531+0000","last_undegraded":"2024-04-24T23:00:21.487531+0000","last_fullsized":"2024-04-24T23:00:21.487531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:37:10.220625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361194+0000","last_change":"2024-04-24T23:00:16.456931+0000","last_active":"2024-04-24T23:00:22.361194+0000","last_peered":"2024-04-24T23:00:22.361194+0000","last_clean":"2024-04-24T23:00:22.361194+0000","last_became_active":"2024-04-24T23:00:16.456636+0000","last_became_peered":"2024-04-24T23:00:16.456636+0000","last_unstale":"2024-04-24T23:00:22.361194+0000","last_undegraded":"2024-04-24T23:00:22.361194+0000","last_fullsized":"2024-04-24T23:00:22.361194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:10.559806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:26.746469+0000","last_change":"2024-04-24T23:00:15.428189+0000","last_active":"2024-04-24T23:00:26.746469+0000","last_peered":"2024-04-24T23:00:26.746469+0000","last_clean":"2024-04-24T23:00:26.746469+0000","last_became_active":"2024-04-24T23:00:15.427837+0000","last_became_peered":"2024-04-24T23:00:15.427837+0000","last_unstale":"2024-04-24T23:00:26.746469+0000","last_undegraded":"2024-04-24T23:00:26.746469+0000","last_fullsized":"2024-04-24T23:00:26.746469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490499+0000","last_change":"2024-04-24T23:00:20.501448+0000","last_active":"2024-04-24T23:00:21.490499+0000","last_peered":"2024-04-24T23:00:21.490499+0000","last_clean":"2024-04-24T23:00:21.490499+0000","last_became_active":"2024-04-24T23:00:20.499677+0000","last_became_peered":"2024-04-24T23:00:20.499677+0000","last_unstale":"2024-04-24T23:00:21.490499+0000","last_undegraded":"2024-04-24T23:00:21.490499+0000","last_fullsized":"2024-04-24T23:00:21.490499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:42.508455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487010+0000","last_change":"2024-04-24T23:00:16.453438+0000","last_active":"2024-04-24T23:00:21.487010+0000","last_peered":"2024-04-24T23:00:21.487010+0000","last_clean":"2024-04-24T23:00:21.487010+0000","last_became_active":"2024-04-24T23:00:16.453033+0000","last_became_peered":"2024-04-24T23:00:16.453033+0000","last_unstale":"2024-04-24T23:00:21.487010+0000","last_undegraded":"2024-04-24T23:00:21.487010+0000","last_fullsized":"2024-04-24T23:00:21.487010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:52:36.324979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364820+0000","last_change":"2024-04-24T23:00:15.431369+0000","last_active":"2024-04-24T23:00:22.364820+0000","last_peered":"2024-04-24T23:00:22.364820+0000","last_clean":"2024-04-24T23:00:22.364820+0000","last_became_active":"2024-04-24T23:00:15.430254+0000","last_became_peered":"2024-04-24T23:00:15.430254+0000","last_unstale":"2024-04-24T23:00:22.364820+0000","last_undegraded":"2024-04-24T23:00:22.364820+0000","last_fullsized":"2024-04-24T23:00:22.364820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361853+0000","last_change":"2024-04-24T23:00:20.503369+0000","last_active":"2024-04-24T23:00:22.361853+0000","last_peered":"2024-04-24T23:00:22.361853+0000","last_clean":"2024-04-24T23:00:22.361853+0000","last_became_active":"2024-04-24T23:00:20.502285+0000","last_became_peered":"2024-04-24T23:00:20.502285+0000","last_unstale":"2024-04-24T23:00:22.361853+0000","last_undegraded":"2024-04-24T23:00:22.361853+0000","last_fullsized":"2024-04-24T23:00:22.361853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491903+0000","last_change":"2024-04-24T23:00:16.452958+0000","last_active":"2024-04-24T23:00:21.491903+0000","last_peered":"2024-04-24T23:00:21.491903+0000","last_clean":"2024-04-24T23:00:21.491903+0000","last_became_active":"2024-04-24T23:00:16.451611+0000","last_became_peered":"2024-04-24T23:00:16.451611+0000","last_unstale":"2024-04-24T23:00:21.491903+0000","last_undegraded":"2024-04-24T23:00:21.491903+0000","last_fullsized":"2024-04-24T23:00:21.491903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:06.283705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361667+0000","last_change":"2024-04-24T23:00:15.397614+0000","last_active":"2024-04-24T23:00:22.361667+0000","last_peered":"2024-04-24T23:00:22.361667+0000","last_clean":"2024-04-24T23:00:22.361667+0000","last_became_active":"2024-04-24T23:00:15.397253+0000","last_became_peered":"2024-04-24T23:00:15.397253+0000","last_unstale":"2024-04-24T23:00:22.361667+0000","last_undegraded":"2024-04-24T23:00:22.361667+0000","last_fullsized":"2024-04-24T23:00:22.361667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:38.560562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363337+0000","last_change":"2024-04-24T23:00:20.506736+0000","last_active":"2024-04-24T23:00:22.363337+0000","last_peered":"2024-04-24T23:00:22.363337+0000","last_clean":"2024-04-24T23:00:22.363337+0000","last_became_active":"2024-04-24T23:00:20.505504+0000","last_became_peered":"2024-04-24T23:00:20.505504+0000","last_unstale":"2024-04-24T23:00:22.363337+0000","last_undegraded":"2024-04-24T23:00:22.363337+0000","last_fullsized":"2024-04-24T23:00:22.363337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:10.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362210+0000","last_change":"2024-04-24T23:00:16.451217+0000","last_active":"2024-04-24T23:00:22.362210+0000","last_peered":"2024-04-24T23:00:22.362210+0000","last_clean":"2024-04-24T23:00:22.362210+0000","last_became_active":"2024-04-24T23:00:16.450149+0000","last_became_peered":"2024-04-24T23:00:16.450149+0000","last_unstale":"2024-04-24T23:00:22.362210+0000","last_undegraded":"2024-04-24T23:00:22.362210+0000","last_fullsized":"2024-04-24T23:00:22.362210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:36.124103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.749533+0000","last_change":"2024-04-24T23:00:15.428164+0000","last_active":"2024-04-24T23:00:21.749533+0000","last_peered":"2024-04-24T23:00:21.749533+0000","last_clean":"2024-04-24T23:00:21.749533+0000","last_became_active":"2024-04-24T23:00:15.427857+0000","last_became_peered":"2024-04-24T23:00:15.427857+0000","last_unstale":"2024-04-24T23:00:21.749533+0000","last_undegraded":"2024-04-24T23:00:21.749533+0000","last_fullsized":"2024-04-24T23:00:21.749533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489396+0000","last_change":"2024-04-24T23:00:20.507135+0000","last_active":"2024-04-24T23:00:21.489396+0000","last_peered":"2024-04-24T23:00:21.489396+0000","last_clean":"2024-04-24T23:00:21.489396+0000","last_became_active":"2024-04-24T23:00:20.506257+0000","last_became_peered":"2024-04-24T23:00:20.506257+0000","last_unstale":"2024-04-24T23:00:21.489396+0000","last_undegraded":"2024-04-24T23:00:21.489396+0000","last_fullsized":"2024-04-24T23:00:21.489396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491003+0000","last_change":"2024-04-24T23:00:20.497645+0000","last_active":"2024-04-24T23:00:21.491003+0000","last_peered":"2024-04-24T23:00:21.491003+0000","last_clean":"2024-04-24T23:00:21.491003+0000","last_became_active":"2024-04-24T23:00:20.496598+0000","last_became_peered":"2024-04-24T23:00:20.496598+0000","last_unstale":"2024-04-24T23:00:21.491003+0000","last_undegraded":"2024-04-24T23:00:21.491003+0000","last_fullsized":"2024-04-24T23:00:21.491003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:59.881296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489530+0000","last_change":"2024-04-24T23:00:16.478734+0000","last_active":"2024-04-24T23:00:21.489530+0000","last_peered":"2024-04-24T23:00:21.489530+0000","last_clean":"2024-04-24T23:00:21.489530+0000","last_became_active":"2024-04-24T23:00:16.477474+0000","last_became_peered":"2024-04-24T23:00:16.477474+0000","last_unstale":"2024-04-24T23:00:21.489530+0000","last_undegraded":"2024-04-24T23:00:21.489530+0000","last_fullsized":"2024-04-24T23:00:21.489530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.178504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486799+0000","last_change":"2024-04-24T23:00:15.405948+0000","last_active":"2024-04-24T23:00:21.486799+0000","last_peered":"2024-04-24T23:00:21.486799+0000","last_clean":"2024-04-24T23:00:21.486799+0000","last_became_active":"2024-04-24T23:00:15.405608+0000","last_became_peered":"2024-04-24T23:00:15.405608+0000","last_unstale":"2024-04-24T23:00:21.486799+0000","last_undegraded":"2024-04-24T23:00:21.486799+0000","last_fullsized":"2024-04-24T23:00:21.486799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488596+0000","last_change":"2024-04-24T23:00:20.493810+0000","last_active":"2024-04-24T23:00:21.488596+0000","last_peered":"2024-04-24T23:00:21.488596+0000","last_clean":"2024-04-24T23:00:21.488596+0000","last_became_active":"2024-04-24T23:00:20.492303+0000","last_became_peered":"2024-04-24T23:00:20.492303+0000","last_unstale":"2024-04-24T23:00:21.488596+0000","last_undegraded":"2024-04-24T23:00:21.488596+0000","last_fullsized":"2024-04-24T23:00:21.488596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:58:38.649805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489593+0000","last_change":"2024-04-24T23:00:16.465460+0000","last_active":"2024-04-24T23:00:21.489593+0000","last_peered":"2024-04-24T23:00:21.489593+0000","last_clean":"2024-04-24T23:00:21.489593+0000","last_became_active":"2024-04-24T23:00:16.457311+0000","last_became_peered":"2024-04-24T23:00:16.457311+0000","last_unstale":"2024-04-24T23:00:21.489593+0000","last_undegraded":"2024-04-24T23:00:21.489593+0000","last_fullsized":"2024-04-24T23:00:21.489593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:43:08.876496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363401+0000","last_change":"2024-04-24T23:00:15.436608+0000","last_active":"2024-04-24T23:00:22.363401+0000","last_peered":"2024-04-24T23:00:22.363401+0000","last_clean":"2024-04-24T23:00:22.363401+0000","last_became_active":"2024-04-24T23:00:15.435730+0000","last_became_peered":"2024-04-24T23:00:15.435730+0000","last_unstale":"2024-04-24T23:00:22.363401+0000","last_undegraded":"2024-04-24T23:00:22.363401+0000","last_fullsized":"2024-04-24T23:00:22.363401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487390+0000","last_change":"2024-04-24T23:00:15.417533+0000","last_active":"2024-04-24T23:00:21.487390+0000","last_peered":"2024-04-24T23:00:21.487390+0000","last_clean":"2024-04-24T23:00:21.487390+0000","last_became_active":"2024-04-24T23:00:15.417226+0000","last_became_peered":"2024-04-24T23:00:15.417226+0000","last_unstale":"2024-04-24T23:00:21.487390+0000","last_undegraded":"2024-04-24T23:00:21.487390+0000","last_fullsized":"2024-04-24T23:00:21.487390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:05.898513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490640+0000","last_change":"2024-04-24T23:00:16.483374+0000","last_active":"2024-04-24T23:00:21.490640+0000","last_peered":"2024-04-24T23:00:21.490640+0000","last_clean":"2024-04-24T23:00:21.490640+0000","last_became_active":"2024-04-24T23:00:16.482676+0000","last_became_peered":"2024-04-24T23:00:16.482676+0000","last_unstale":"2024-04-24T23:00:21.490640+0000","last_undegraded":"2024-04-24T23:00:21.490640+0000","last_fullsized":"2024-04-24T23:00:21.490640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:05.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491288+0000","last_change":"2024-04-24T23:00:20.542916+0000","last_active":"2024-04-24T23:00:21.491288+0000","last_peered":"2024-04-24T23:00:21.491288+0000","last_clean":"2024-04-24T23:00:21.491288+0000","last_became_active":"2024-04-24T23:00:20.541822+0000","last_became_peered":"2024-04-24T23:00:20.541822+0000","last_unstale":"2024-04-24T23:00:21.491288+0000","last_undegraded":"2024-04-24T23:00:21.491288+0000","last_fullsized":"2024-04-24T23:00:21.491288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:31.840092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492280+0000","last_change":"2024-04-24T23:00:15.425495+0000","last_active":"2024-04-24T23:00:21.492280+0000","last_peered":"2024-04-24T23:00:21.492280+0000","last_clean":"2024-04-24T23:00:21.492280+0000","last_became_active":"2024-04-24T23:00:15.424739+0000","last_became_peered":"2024-04-24T23:00:15.424739+0000","last_unstale":"2024-04-24T23:00:21.492280+0000","last_undegraded":"2024-04-24T23:00:21.492280+0000","last_fullsized":"2024-04-24T23:00:21.492280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:49.740745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.748176+0000","last_change":"2024-04-24T23:00:16.454250+0000","last_active":"2024-04-24T23:00:21.748176+0000","last_peered":"2024-04-24T23:00:21.748176+0000","last_clean":"2024-04-24T23:00:21.748176+0000","last_became_active":"2024-04-24T23:00:16.453965+0000","last_became_peered":"2024-04-24T23:00:16.453965+0000","last_unstale":"2024-04-24T23:00:21.748176+0000","last_undegraded":"2024-04-24T23:00:21.748176+0000","last_fullsized":"2024-04-24T23:00:21.748176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364268+0000","last_change":"2024-04-24T23:00:20.510475+0000","last_active":"2024-04-24T23:00:22.364268+0000","last_peered":"2024-04-24T23:00:22.364268+0000","last_clean":"2024-04-24T23:00:22.364268+0000","last_became_active":"2024-04-24T23:00:20.509269+0000","last_became_peered":"2024-04-24T23:00:20.509269+0000","last_unstale":"2024-04-24T23:00:22.364268+0000","last_undegraded":"2024-04-24T23:00:22.364268+0000","last_fullsized":"2024-04-24T23:00:22.364268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:09.596902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361286+0000","last_change":"2024-04-24T23:00:16.456976+0000","last_active":"2024-04-24T23:00:22.361286+0000","last_peered":"2024-04-24T23:00:22.361286+0000","last_clean":"2024-04-24T23:00:22.361286+0000","last_became_active":"2024-04-24T23:00:16.456289+0000","last_became_peered":"2024-04-24T23:00:16.456289+0000","last_unstale":"2024-04-24T23:00:22.361286+0000","last_undegraded":"2024-04-24T23:00:22.361286+0000","last_fullsized":"2024-04-24T23:00:22.361286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363709+0000","last_change":"2024-04-24T23:00:16.471774+0000","last_active":"2024-04-24T23:00:22.363709+0000","last_peered":"2024-04-24T23:00:22.363709+0000","last_clean":"2024-04-24T23:00:22.363709+0000","last_became_active":"2024-04-24T23:00:16.466134+0000","last_became_peered":"2024-04-24T23:00:16.466134+0000","last_unstale":"2024-04-24T23:00:22.363709+0000","last_undegraded":"2024-04-24T23:00:22.363709+0000","last_fullsized":"2024-04-24T23:00:22.363709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:31.237423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486774+0000","last_change":"2024-04-24T23:00:16.465926+0000","last_active":"2024-04-24T23:00:21.486774+0000","last_peered":"2024-04-24T23:00:21.486774+0000","last_clean":"2024-04-24T23:00:21.486774+0000","last_became_active":"2024-04-24T23:00:16.465659+0000","last_became_peered":"2024-04-24T23:00:16.465659+0000","last_unstale":"2024-04-24T23:00:21.486774+0000","last_undegraded":"2024-04-24T23:00:21.486774+0000","last_fullsized":"2024-04-24T23:00:21.486774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:09:47.001195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492033+0000","last_change":"2024-04-24T23:00:16.474929+0000","last_active":"2024-04-24T23:00:21.492033+0000","last_peered":"2024-04-24T23:00:21.492033+0000","last_clean":"2024-04-24T23:00:21.492033+0000","last_became_active":"2024-04-24T23:00:16.474181+0000","last_became_peered":"2024-04-24T23:00:16.474181+0000","last_unstale":"2024-04-24T23:00:21.492033+0000","last_undegraded":"2024-04-24T23:00:21.492033+0000","last_fullsized":"2024-04-24T23:00:21.492033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:56.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365315+0000","last_change":"2024-04-24T23:00:16.458411+0000","last_active":"2024-04-24T23:00:22.365315+0000","last_peered":"2024-04-24T23:00:22.365315+0000","last_clean":"2024-04-24T23:00:22.365315+0000","last_became_active":"2024-04-24T23:00:16.457641+0000","last_became_peered":"2024-04-24T23:00:16.457641+0000","last_unstale":"2024-04-24T23:00:22.365315+0000","last_undegraded":"2024-04-24T23:00:22.365315+0000","last_fullsized":"2024-04-24T23:00:22.365315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:06.907656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364328+0000","last_change":"2024-04-24T23:00:16.470324+0000","last_active":"2024-04-24T23:00:22.364328+0000","last_peered":"2024-04-24T23:00:22.364328+0000","last_clean":"2024-04-24T23:00:22.364328+0000","last_became_active":"2024-04-24T23:00:16.469614+0000","last_became_peered":"2024-04-24T23:00:16.469614+0000","last_unstale":"2024-04-24T23:00:22.364328+0000","last_undegraded":"2024-04-24T23:00:22.364328+0000","last_fullsized":"2024-04-24T23:00:22.364328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:05.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362165+0000","last_change":"2024-04-24T23:00:16.450764+0000","last_active":"2024-04-24T23:00:22.362165+0000","last_peered":"2024-04-24T23:00:22.362165+0000","last_clean":"2024-04-24T23:00:22.362165+0000","last_became_active":"2024-04-24T23:00:16.450561+0000","last_became_peered":"2024-04-24T23:00:16.450561+0000","last_unstale":"2024-04-24T23:00:22.362165+0000","last_undegraded":"2024-04-24T23:00:22.362165+0000","last_fullsized":"2024-04-24T23:00:22.362165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:30.426371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490926+0000","last_change":"2024-04-24T23:00:16.453953+0000","last_active":"2024-04-24T23:00:21.490926+0000","last_peered":"2024-04-24T23:00:21.490926+0000","last_clean":"2024-04-24T23:00:21.490926+0000","last_became_active":"2024-04-24T23:00:16.452345+0000","last_became_peered":"2024-04-24T23:00:16.452345+0000","last_unstale":"2024-04-24T23:00:21.490926+0000","last_undegraded":"2024-04-24T23:00:21.490926+0000","last_fullsized":"2024-04-24T23:00:21.490926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:58.273719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486575+0000","last_change":"2024-04-24T23:00:16.459030+0000","last_active":"2024-04-24T23:00:21.486575+0000","last_peered":"2024-04-24T23:00:21.486575+0000","last_clean":"2024-04-24T23:00:21.486575+0000","last_became_active":"2024-04-24T23:00:16.458402+0000","last_became_peered":"2024-04-24T23:00:16.458402+0000","last_unstale":"2024-04-24T23:00:21.486575+0000","last_undegraded":"2024-04-24T23:00:21.486575+0000","last_fullsized":"2024-04-24T23:00:21.486575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:33.558529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488396+0000","last_change":"2024-04-24T23:00:16.456818+0000","last_active":"2024-04-24T23:00:21.488396+0000","last_peered":"2024-04-24T23:00:21.488396+0000","last_clean":"2024-04-24T23:00:21.488396+0000","last_became_active":"2024-04-24T23:00:16.453065+0000","last_became_peered":"2024-04-24T23:00:16.453065+0000","last_unstale":"2024-04-24T23:00:21.488396+0000","last_undegraded":"2024-04-24T23:00:21.488396+0000","last_fullsized":"2024-04-24T23:00:21.488396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:02.728439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.747938+0000","last_change":"2024-04-24T23:00:16.447668+0000","last_active":"2024-04-24T23:00:21.747938+0000","last_peered":"2024-04-24T23:00:21.747938+0000","last_clean":"2024-04-24T23:00:21.747938+0000","last_became_active":"2024-04-24T23:00:16.447370+0000","last_became_peered":"2024-04-24T23:00:16.447370+0000","last_unstale":"2024-04-24T23:00:21.747938+0000","last_undegraded":"2024-04-24T23:00:21.747938+0000","last_fullsized":"2024-04-24T23:00:21.747938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490570+0000","last_change":"2024-04-24T23:00:16.478716+0000","last_active":"2024-04-24T23:00:21.490570+0000","last_peered":"2024-04-24T23:00:21.490570+0000","last_clean":"2024-04-24T23:00:21.490570+0000","last_became_active":"2024-04-24T23:00:16.477982+0000","last_became_peered":"2024-04-24T23:00:16.477982+0000","last_unstale":"2024-04-24T23:00:21.490570+0000","last_undegraded":"2024-04-24T23:00:21.490570+0000","last_fullsized":"2024-04-24T23:00:21.490570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:04.285389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360946+0000","last_change":"2024-04-24T23:00:16.449265+0000","last_active":"2024-04-24T23:00:22.360946+0000","last_peered":"2024-04-24T23:00:22.360946+0000","last_clean":"2024-04-24T23:00:22.360946+0000","last_became_active":"2024-04-24T23:00:16.446583+0000","last_became_peered":"2024-04-24T23:00:16.446583+0000","last_unstale":"2024-04-24T23:00:22.360946+0000","last_undegraded":"2024-04-24T23:00:22.360946+0000","last_fullsized":"2024-04-24T23:00:22.360946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:38.429072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488019+0000","last_change":"2024-04-24T23:00:16.483354+0000","last_active":"2024-04-24T23:00:21.488019+0000","last_peered":"2024-04-24T23:00:21.488019+0000","last_clean":"2024-04-24T23:00:21.488019+0000","last_became_active":"2024-04-24T23:00:16.483079+0000","last_became_peered":"2024-04-24T23:00:16.483079+0000","last_unstale":"2024-04-24T23:00:21.488019+0000","last_undegraded":"2024-04-24T23:00:21.488019+0000","last_fullsized":"2024-04-24T23:00:21.488019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:57:02.861698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364543+0000","last_change":"2024-04-24T23:00:16.472605+0000","last_active":"2024-04-24T23:00:22.364543+0000","last_peered":"2024-04-24T23:00:22.364543+0000","last_clean":"2024-04-24T23:00:22.364543+0000","last_became_active":"2024-04-24T23:00:16.466076+0000","last_became_peered":"2024-04-24T23:00:16.466076+0000","last_unstale":"2024-04-24T23:00:22.364543+0000","last_undegraded":"2024-04-24T23:00:22.364543+0000","last_fullsized":"2024-04-24T23:00:22.364543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488702+0000","last_change":"2024-04-24T23:00:16.457737+0000","last_active":"2024-04-24T23:00:21.488702+0000","last_peered":"2024-04-24T23:00:21.488702+0000","last_clean":"2024-04-24T23:00:21.488702+0000","last_became_active":"2024-04-24T23:00:16.453949+0000","last_became_peered":"2024-04-24T23:00:16.453949+0000","last_unstale":"2024-04-24T23:00:21.488702+0000","last_undegraded":"2024-04-24T23:00:21.488702+0000","last_fullsized":"2024-04-24T23:00:21.488702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:08.928463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486501+0000","last_change":"2024-04-24T23:00:16.452839+0000","last_active":"2024-04-24T23:00:21.486501+0000","last_peered":"2024-04-24T23:00:21.486501+0000","last_clean":"2024-04-24T23:00:21.486501+0000","last_became_active":"2024-04-24T23:00:16.445253+0000","last_became_peered":"2024-04-24T23:00:16.445253+0000","last_unstale":"2024-04-24T23:00:21.486501+0000","last_undegraded":"2024-04-24T23:00:21.486501+0000","last_fullsized":"2024-04-24T23:00:21.486501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:23.938299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488118+0000","last_change":"2024-04-24T23:00:16.455784+0000","last_active":"2024-04-24T23:00:21.488118+0000","last_peered":"2024-04-24T23:00:21.488118+0000","last_clean":"2024-04-24T23:00:21.488118+0000","last_became_active":"2024-04-24T23:00:16.454953+0000","last_became_peered":"2024-04-24T23:00:16.454953+0000","last_unstale":"2024-04-24T23:00:21.488118+0000","last_undegraded":"2024-04-24T23:00:21.488118+0000","last_fullsized":"2024-04-24T23:00:21.488118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:32.545524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363621+0000","last_change":"2024-04-24T23:00:16.468365+0000","last_active":"2024-04-24T23:00:22.363621+0000","last_peered":"2024-04-24T23:00:22.363621+0000","last_clean":"2024-04-24T23:00:22.363621+0000","last_became_active":"2024-04-24T23:00:16.467630+0000","last_became_peered":"2024-04-24T23:00:16.467630+0000","last_unstale":"2024-04-24T23:00:22.363621+0000","last_undegraded":"2024-04-24T23:00:22.363621+0000","last_fullsized":"2024-04-24T23:00:22.363621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363514+0000","last_change":"2024-04-24T23:00:16.456188+0000","last_active":"2024-04-24T23:00:22.363514+0000","last_peered":"2024-04-24T23:00:22.363514+0000","last_clean":"2024-04-24T23:00:22.363514+0000","last_became_active":"2024-04-24T23:00:16.455114+0000","last_became_peered":"2024-04-24T23:00:16.455114+0000","last_unstale":"2024-04-24T23:00:22.363514+0000","last_undegraded":"2024-04-24T23:00:22.363514+0000","last_fullsized":"2024-04-24T23:00:22.363514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:36.124103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360885+0000","last_change":"2024-04-24T23:00:16.450776+0000","last_active":"2024-04-24T23:00:22.360885+0000","last_peered":"2024-04-24T23:00:22.360885+0000","last_clean":"2024-04-24T23:00:22.360885+0000","last_became_active":"2024-04-24T23:00:16.450466+0000","last_became_peered":"2024-04-24T23:00:16.450466+0000","last_unstale":"2024-04-24T23:00:22.360885+0000","last_undegraded":"2024-04-24T23:00:22.360885+0000","last_fullsized":"2024-04-24T23:00:22.360885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:32.331306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361100+0000","last_change":"2024-04-24T23:00:16.450743+0000","last_active":"2024-04-24T23:00:22.361100+0000","last_peered":"2024-04-24T23:00:22.361100+0000","last_clean":"2024-04-24T23:00:22.361100+0000","last_became_active":"2024-04-24T23:00:16.450279+0000","last_became_peered":"2024-04-24T23:00:16.450279+0000","last_unstale":"2024-04-24T23:00:22.361100+0000","last_undegraded":"2024-04-24T23:00:22.361100+0000","last_fullsized":"2024-04-24T23:00:22.361100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:00.869015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361531+0000","last_change":"2024-04-24T23:00:16.446745+0000","last_active":"2024-04-24T23:00:22.361531+0000","last_peered":"2024-04-24T23:00:22.361531+0000","last_clean":"2024-04-24T23:00:22.361531+0000","last_became_active":"2024-04-24T23:00:16.446317+0000","last_became_peered":"2024-04-24T23:00:16.446317+0000","last_unstale":"2024-04-24T23:00:22.361531+0000","last_undegraded":"2024-04-24T23:00:22.361531+0000","last_fullsized":"2024-04-24T23:00:22.361531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:47.110869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.749496+0000","last_change":"2024-04-24T23:00:16.446352+0000","last_active":"2024-04-24T23:00:21.749496+0000","last_peered":"2024-04-24T23:00:21.749496+0000","last_clean":"2024-04-24T23:00:21.749496+0000","last_became_active":"2024-04-24T23:00:16.445839+0000","last_became_peered":"2024-04-24T23:00:16.445839+0000","last_unstale":"2024-04-24T23:00:21.749496+0000","last_undegraded":"2024-04-24T23:00:21.749496+0000","last_fullsized":"2024-04-24T23:00:21.749496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487985+0000","last_change":"2024-04-24T23:00:16.451439+0000","last_active":"2024-04-24T23:00:21.487985+0000","last_peered":"2024-04-24T23:00:21.487985+0000","last_clean":"2024-04-24T23:00:21.487985+0000","last_became_active":"2024-04-24T23:00:16.450293+0000","last_became_peered":"2024-04-24T23:00:16.450293+0000","last_unstale":"2024-04-24T23:00:21.487985+0000","last_undegraded":"2024-04-24T23:00:21.487985+0000","last_fullsized":"2024-04-24T23:00:21.487985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:19.586817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360593+0000","last_change":"2024-04-24T23:00:16.482222+0000","last_active":"2024-04-24T23:00:22.360593+0000","last_peered":"2024-04-24T23:00:22.360593+0000","last_clean":"2024-04-24T23:00:22.360593+0000","last_became_active":"2024-04-24T23:00:16.481897+0000","last_became_peered":"2024-04-24T23:00:16.481897+0000","last_unstale":"2024-04-24T23:00:22.360593+0000","last_undegraded":"2024-04-24T23:00:22.360593+0000","last_fullsized":"2024-04-24T23:00:22.360593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361442+0000","last_change":"2024-04-24T23:00:16.482100+0000","last_active":"2024-04-24T23:00:22.361442+0000","last_peered":"2024-04-24T23:00:22.361442+0000","last_clean":"2024-04-24T23:00:22.361442+0000","last_became_active":"2024-04-24T23:00:16.481832+0000","last_became_peered":"2024-04-24T23:00:16.481832+0000","last_unstale":"2024-04-24T23:00:22.361442+0000","last_undegraded":"2024-04-24T23:00:22.361442+0000","last_fullsized":"2024-04-24T23:00:22.361442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360651+0000","last_change":"2024-04-24T23:00:16.466121+0000","last_active":"2024-04-24T23:00:22.360651+0000","last_peered":"2024-04-24T23:00:22.360651+0000","last_clean":"2024-04-24T23:00:22.360651+0000","last_became_active":"2024-04-24T23:00:16.465749+0000","last_became_peered":"2024-04-24T23:00:16.465749+0000","last_unstale":"2024-04-24T23:00:22.360651+0000","last_undegraded":"2024-04-24T23:00:22.360651+0000","last_fullsized":"2024-04-24T23:00:22.360651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:05.734745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361597+0000","last_change":"2024-04-24T23:00:16.481682+0000","last_active":"2024-04-24T23:00:22.361597+0000","last_peered":"2024-04-24T23:00:22.361597+0000","last_clean":"2024-04-24T23:00:22.361597+0000","last_became_active":"2024-04-24T23:00:16.481381+0000","last_became_peered":"2024-04-24T23:00:16.481381+0000","last_unstale":"2024-04-24T23:00:22.361597+0000","last_undegraded":"2024-04-24T23:00:22.361597+0000","last_fullsized":"2024-04-24T23:00:22.361597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:14.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491105+0000","last_change":"2024-04-24T23:00:16.461984+0000","last_active":"2024-04-24T23:00:21.491105+0000","last_peered":"2024-04-24T23:00:21.491105+0000","last_clean":"2024-04-24T23:00:21.491105+0000","last_became_active":"2024-04-24T23:00:16.461267+0000","last_became_peered":"2024-04-24T23:00:16.461267+0000","last_unstale":"2024-04-24T23:00:21.491105+0000","last_undegraded":"2024-04-24T23:00:21.491105+0000","last_fullsized":"2024-04-24T23:00:21.491105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:53:00.776972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491640+0000","last_change":"2024-04-24T23:00:16.460191+0000","last_active":"2024-04-24T23:00:21.491640+0000","last_peered":"2024-04-24T23:00:21.491640+0000","last_clean":"2024-04-24T23:00:21.491640+0000","last_became_active":"2024-04-24T23:00:16.459445+0000","last_became_peered":"2024-04-24T23:00:16.459445+0000","last_unstale":"2024-04-24T23:00:21.491640+0000","last_undegraded":"2024-04-24T23:00:21.491640+0000","last_fullsized":"2024-04-24T23:00:21.491640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:12.313822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361195+0000","last_change":"2024-04-24T23:00:16.450409+0000","last_active":"2024-04-24T23:00:22.361195+0000","last_peered":"2024-04-24T23:00:22.361195+0000","last_clean":"2024-04-24T23:00:22.361195+0000","last_became_active":"2024-04-24T23:00:16.450061+0000","last_became_peered":"2024-04-24T23:00:16.450061+0000","last_unstale":"2024-04-24T23:00:22.361195+0000","last_undegraded":"2024-04-24T23:00:22.361195+0000","last_fullsized":"2024-04-24T23:00:22.361195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:23.938299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":101627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":102085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":327680,"data_stored":691941,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":101559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":101503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":691963,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:00:34.575 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:00:34.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4f5a62640 1 Processor -- start 2024-04-24T23:00:34.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4f5a62640 1 -- start start 2024-04-24T23:00:34.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4f5a62640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4f00b2500 0x7fc4f0145450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4f5a62640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4f0070060 con 0x7fc4f013f900 2024-04-24T23:00:34.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4f5a62640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4f00b28e0 con 0x7fc4f0145990 2024-04-24T23:00:34.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4f5a62640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f00af8f0 con 0x7fc4f00b2500 2024-04-24T23:00:34.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4effff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc4f013f900 0x7fc4f014fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54474/0 (socket says 172.21.15.43:54474) 2024-04-24T23:00:34.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4effff640 1 -- 172.21.15.43:0/4029742005 learned_addr learned my addr 172.21.15.43:0/4029742005 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:34.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ef7fe640 1 --2- 172.21.15.43:0/4029742005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4f00b2500 0x7fc4f0145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ee7fc640 1 -- 172.21.15.43:0/4029742005 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3350480506 0 0) 0x7fc4f0070060 con 0x7fc4f013f900 2024-04-24T23:00:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ee7fc640 1 -- 172.21.15.43:0/4029742005 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4dc003530 con 0x7fc4f013f900 2024-04-24T23:00:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ee7fc640 1 -- 172.21.15.43:0/4029742005 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3005057294 0 0) 0x7fc4dc003530 con 0x7fc4f013f900 2024-04-24T23:00:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ee7fc640 1 -- 172.21.15.43:0/4029742005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4f00b2500 msgr2=0x7fc4f0145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ee7fc640 1 --2- 172.21.15.43:0/4029742005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4f00b2500 0x7fc4f0145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ee7fc640 1 -- 172.21.15.43:0/4029742005 >> v1:172.21.15.162:6789/0 conn(0x7fc4f0145990 legacy=0x7fc4f013f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ee7fc640 1 -- 172.21.15.43:0/4029742005 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f006fb40 con 0x7fc4f013f900 2024-04-24T23:00:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ee7fc640 1 -- 172.21.15.43:0/4029742005 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7fc4e8001a00 con 0x7fc4f013f900 2024-04-24T23:00:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ee7fc640 1 -- 172.21.15.43:0/4029742005 >> v1:172.21.15.43:6789/0 conn(0x7fc4f013f900 legacy=0x7fc4f014fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ee7fc640 1 --2- 172.21.15.43:0/4029742005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4dc0039f0 0x7fc4dc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ee7fc640 1 --2- 172.21.15.43:0/4029742005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4dc004810 0x7fc4dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ee7fc640 1 --2- 172.21.15.43:0/4029742005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4f00b2500 0x7fc4dc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ee7fc640 1 -- 172.21.15.43:0/4029742005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f00af8f0 con 0x7fc4dc0039f0 2024-04-24T23:00:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ee7fc640 1 -- 172.21.15.43:0/4029742005 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc00ba80 con 0x7fc4dc004810 2024-04-24T23:00:34.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ee7fc640 1 -- 172.21.15.43:0/4029742005 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4dc00bc80 con 0x7fc4f00b2500 2024-04-24T23:00:34.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ef7fe640 1 --2- 172.21.15.43:0/4029742005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4dc0039f0 0x7fc4dc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4effff640 1 --2- 172.21.15.43:0/4029742005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4f00b2500 0x7fc4dc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4eeffd640 1 --2- 172.21.15.43:0/4029742005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4dc004810 0x7fc4dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ef7fe640 1 -- 172.21.15.43:0/4029742005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4f00b2500 msgr2=0x7fc4dc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:34.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ef7fe640 1 --2- 172.21.15.43:0/4029742005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4f00b2500 0x7fc4dc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ef7fe640 1 -- 172.21.15.43:0/4029742005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4dc004810 msgr2=0x7fc4dc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:34.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ef7fe640 1 --2- 172.21.15.43:0/4029742005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4dc004810 0x7fc4dc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4ef7fe640 1 -- 172.21.15.43:0/4029742005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4dc003530 con 0x7fc4dc0039f0 2024-04-24T23:00:34.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.731+0000 7fc4effff640 1 --2- 172.21.15.43:0/4029742005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4f00b2500 0x7fc4dc0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:34.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.735+0000 7fc4ef7fe640 1 --2- 172.21.15.43:0/4029742005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4dc0039f0 0x7fc4dc003e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009ab0 tx=0x7fc4e001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0f759305a293ed server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.735+0000 7fc4ee7fc640 1 -- 172.21.15.43:0/4029742005 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e00096b0 con 0x7fc4dc0039f0 2024-04-24T23:00:34.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.735+0000 7fc4ee7fc640 1 -- 172.21.15.43:0/4029742005 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e00a6410 con 0x7fc4dc0039f0 2024-04-24T23:00:34.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.735+0000 7fc4ee7fc640 1 -- 172.21.15.43:0/4029742005 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e00a6800 con 0x7fc4dc0039f0 2024-04-24T23:00:34.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.735+0000 7fc4f5a62640 1 -- 172.21.15.43:0/4029742005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4dc0039f0 msgr2=0x7fc4dc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.735+0000 7fc4f5a62640 1 --2- 172.21.15.43:0/4029742005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4dc0039f0 0x7fc4dc003e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009ab0 tx=0x7fc4e001ca30 comp rx=0 tx=0).stop 2024-04-24T23:00:34.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.735+0000 7fc4effff640 1 -- 172.21.15.43:0/4029742005 reap_dead start 2024-04-24T23:00:34.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.735+0000 7fc4f5a62640 1 -- 172.21.15.43:0/4029742005 shutdown_connections 2024-04-24T23:00:34.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.735+0000 7fc4f5a62640 1 -- 172.21.15.43:0/4029742005 >> 172.21.15.43:0/4029742005 conn(0x7fc4f00b5690 msgr2=0x7fc4f00b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:34.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.735+0000 7fc4f5a62640 1 -- 172.21.15.43:0/4029742005 shutdown_connections 2024-04-24T23:00:34.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.735+0000 7fc4f5a62640 1 -- 172.21.15.43:0/4029742005 wait complete. 2024-04-24T23:00:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4f5a62640 1 Processor -- start 2024-04-24T23:00:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4f5a62640 1 -- start start 2024-04-24T23:00:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4f5a62640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4dc0039f0 0x7fc4f013fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4f5a62640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4f01e1db0 0x7fc4f01e13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4f5a62640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4f0148480 0x7fc4f0139900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4f5a62640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f00b54a0 con 0x7fc4f01e1db0 2024-04-24T23:00:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4f5a62640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f00b63c0 con 0x7fc4dc0039f0 2024-04-24T23:00:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4f5a62640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f0151c20 con 0x7fc4f0148480 2024-04-24T23:00:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4eeffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4f01e1db0 0x7fc4f01e13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4eeffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4f01e1db0 0x7fc4f01e13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42840/0 (socket says 172.21.15.43:42840) 2024-04-24T23:00:34.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4eeffd640 1 -- 172.21.15.43:0/12974287 learned_addr learned my addr 172.21.15.43:0/12974287 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:34.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4effff640 1 --2- 172.21.15.43:0/12974287 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4f0148480 0x7fc4f0139900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4ef7fe640 1 --2- 172.21.15.43:0/12974287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4dc0039f0 0x7fc4f013fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4eeffd640 1 -- 172.21.15.43:0/12974287 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4f0148480 msgr2=0x7fc4f0139900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4eeffd640 1 --2- 172.21.15.43:0/12974287 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4f0148480 0x7fc4f0139900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4eeffd640 1 -- 172.21.15.43:0/12974287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4dc0039f0 msgr2=0x7fc4f013fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4eeffd640 1 --2- 172.21.15.43:0/12974287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4dc0039f0 0x7fc4f013fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4eeffd640 1 -- 172.21.15.43:0/12974287 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f01493e0 con 0x7fc4f01e1db0 2024-04-24T23:00:34.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4eeffd640 1 --2- 172.21.15.43:0/12974287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4f01e1db0 0x7fc4f01e13f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800e500 tx=0x7fc4d800e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4e7fff640 1 -- 172.21.15.43:0/12974287 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d80053a0 con 0x7fc4f01e1db0 2024-04-24T23:00:34.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4e7fff640 1 -- 172.21.15.43:0/12974287 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d8018070 con 0x7fc4f01e1db0 2024-04-24T23:00:34.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4e7fff640 1 -- 172.21.15.43:0/12974287 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8003820 con 0x7fc4f01e1db0 2024-04-24T23:00:34.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4f5a62640 1 -- 172.21.15.43:0/12974287 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f0148c70 con 0x7fc4f01e1db0 2024-04-24T23:00:34.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4f5a62640 1 -- 172.21.15.43:0/12974287 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f0141b70 con 0x7fc4f01e1db0 2024-04-24T23:00:34.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4f5a62640 1 -- 172.21.15.43:0/12974287 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f004f580 con 0x7fc4f01e1db0 2024-04-24T23:00:34.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4e7fff640 1 -- 172.21.15.43:0/12974287 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc4d80039c0 con 0x7fc4f01e1db0 2024-04-24T23:00:34.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4e7fff640 1 --2- 172.21.15.43:0/12974287 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc4d00678c0 0x7fc4d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:34.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4e7fff640 1 -- 172.21.15.43:0/12974287 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc4d8085c60 con 0x7fc4f01e1db0 2024-04-24T23:00:34.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.739+0000 7fc4ef7fe640 1 --2- 172.21.15.43:0/12974287 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc4d00678c0 0x7fc4d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:34.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.743+0000 7fc4ef7fe640 1 --2- 172.21.15.43:0/12974287 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc4d00678c0 0x7fc4d0069d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00ad000 tx=0x7fc4e00046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:34.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.747+0000 7fc4e7fff640 1 -- 172.21.15.43:0/12974287 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc4d8056470 con 0x7fc4f01e1db0 2024-04-24T23:00:34.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.903+0000 7fc4f5a62640 1 -- 172.21.15.43:0/12974287 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4f006e1e0 con 0x7fc4d00678c0 2024-04-24T23:00:34.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.919+0000 7fc4e7fff640 1 -- 172.21.15.43:0/12974287 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332631 (secure 0 0 0) 0x7fc4f006e1e0 con 0x7fc4d00678c0 2024-04-24T23:00:34.926 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:34.928 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-24T23:00:34.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.923+0000 7fc4f5a62640 1 -- 172.21.15.43:0/12974287 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc4d00678c0 msgr2=0x7fc4d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.923+0000 7fc4f5a62640 1 --2- 172.21.15.43:0/12974287 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc4d00678c0 0x7fc4d0069d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00ad000 tx=0x7fc4e00046d0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.923+0000 7fc4f5a62640 1 -- 172.21.15.43:0/12974287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4f01e1db0 msgr2=0x7fc4f01e13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.923+0000 7fc4f5a62640 1 --2- 172.21.15.43:0/12974287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4f01e1db0 0x7fc4f01e13f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800e500 tx=0x7fc4d800e9c0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.923+0000 7fc4f5a62640 1 -- 172.21.15.43:0/12974287 shutdown_connections 2024-04-24T23:00:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.923+0000 7fc4f5a62640 1 --2- 172.21.15.43:0/12974287 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc4d00678c0 0x7fc4d0069d80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.923+0000 7fc4f5a62640 1 --2- 172.21.15.43:0/12974287 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4f0148480 0x7fc4f0139900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.923+0000 7fc4f5a62640 1 --2- 172.21.15.43:0/12974287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4f01e1db0 0x7fc4f01e13f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.923+0000 7fc4f5a62640 1 --2- 172.21.15.43:0/12974287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4dc0039f0 0x7fc4f013fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.923+0000 7fc4f5a62640 1 -- 172.21.15.43:0/12974287 >> 172.21.15.43:0/12974287 conn(0x7fc4f00b5690 msgr2=0x7fc4f0072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.923+0000 7fc4f5a62640 1 -- 172.21.15.43:0/12974287 shutdown_connections 2024-04-24T23:00:34.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:34.923+0000 7fc4f5a62640 1 -- 172.21.15.43:0/12974287 wait complete. 2024-04-24T23:00:34.944 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-24T23:00:34.266849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235020,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739700,"statfs":{"total":773094113280,"available":772853452800,"internally_reserved":0,"allocated":2260992,"data_stored":2002040,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004109"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492662+0000","last_change":"2024-04-24T23:00:15.425241+0000","last_active":"2024-04-24T23:00:21.492662+0000","last_peered":"2024-04-24T23:00:21.492662+0000","last_clean":"2024-04-24T23:00:21.492662+0000","last_became_active":"2024-04-24T23:00:15.417152+0000","last_became_peered":"2024-04-24T23:00:15.417152+0000","last_unstale":"2024-04-24T23:00:21.492662+0000","last_undegraded":"2024-04-24T23:00:21.492662+0000","last_fullsized":"2024-04-24T23:00:21.492662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492334+0000","last_change":"2024-04-24T23:00:16.450360+0000","last_active":"2024-04-24T23:00:21.492334+0000","last_peered":"2024-04-24T23:00:21.492334+0000","last_clean":"2024-04-24T23:00:21.492334+0000","last_became_active":"2024-04-24T23:00:16.449631+0000","last_became_peered":"2024-04-24T23:00:16.449631+0000","last_unstale":"2024-04-24T23:00:21.492334+0000","last_undegraded":"2024-04-24T23:00:21.492334+0000","last_fullsized":"2024-04-24T23:00:21.492334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:03:09.773642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363750+0000","last_change":"2024-04-24T23:00:20.537107+0000","last_active":"2024-04-24T23:00:22.363750+0000","last_peered":"2024-04-24T23:00:22.363750+0000","last_clean":"2024-04-24T23:00:22.363750+0000","last_became_active":"2024-04-24T23:00:20.535916+0000","last_became_peered":"2024-04-24T23:00:20.535916+0000","last_unstale":"2024-04-24T23:00:22.363750+0000","last_undegraded":"2024-04-24T23:00:22.363750+0000","last_fullsized":"2024-04-24T23:00:22.363750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.364772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492571+0000","last_change":"2024-04-24T23:00:15.418251+0000","last_active":"2024-04-24T23:00:21.492571+0000","last_peered":"2024-04-24T23:00:21.492571+0000","last_clean":"2024-04-24T23:00:21.492571+0000","last_became_active":"2024-04-24T23:00:15.417502+0000","last_became_peered":"2024-04-24T23:00:15.417502+0000","last_unstale":"2024-04-24T23:00:21.492571+0000","last_undegraded":"2024-04-24T23:00:21.492571+0000","last_fullsized":"2024-04-24T23:00:21.492571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:50:53.490837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491649+0000","last_change":"2024-04-24T23:00:16.452960+0000","last_active":"2024-04-24T23:00:21.491649+0000","last_peered":"2024-04-24T23:00:21.491649+0000","last_clean":"2024-04-24T23:00:21.491649+0000","last_became_active":"2024-04-24T23:00:16.452212+0000","last_became_peered":"2024-04-24T23:00:16.452212+0000","last_unstale":"2024-04-24T23:00:21.491649+0000","last_undegraded":"2024-04-24T23:00:21.491649+0000","last_fullsized":"2024-04-24T23:00:21.491649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:26.361607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361169+0000","last_change":"2024-04-24T23:00:20.518435+0000","last_active":"2024-04-24T23:00:22.361169+0000","last_peered":"2024-04-24T23:00:22.361169+0000","last_clean":"2024-04-24T23:00:22.361169+0000","last_became_active":"2024-04-24T23:00:20.517975+0000","last_became_peered":"2024-04-24T23:00:20.517975+0000","last_unstale":"2024-04-24T23:00:22.361169+0000","last_undegraded":"2024-04-24T23:00:22.361169+0000","last_fullsized":"2024-04-24T23:00:22.361169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:36.410688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361368+0000","last_change":"2024-04-24T23:00:15.401804+0000","last_active":"2024-04-24T23:00:22.361368+0000","last_peered":"2024-04-24T23:00:22.361368+0000","last_clean":"2024-04-24T23:00:22.361368+0000","last_became_active":"2024-04-24T23:00:15.400064+0000","last_became_peered":"2024-04-24T23:00:15.400064+0000","last_unstale":"2024-04-24T23:00:22.361368+0000","last_undegraded":"2024-04-24T23:00:22.361368+0000","last_fullsized":"2024-04-24T23:00:22.361368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:26.588514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.748494+0000","last_change":"2024-04-24T23:00:16.451873+0000","last_active":"2024-04-24T23:00:21.748494+0000","last_peered":"2024-04-24T23:00:21.748494+0000","last_clean":"2024-04-24T23:00:21.748494+0000","last_became_active":"2024-04-24T23:00:16.451601+0000","last_became_peered":"2024-04-24T23:00:16.451601+0000","last_unstale":"2024-04-24T23:00:21.748494+0000","last_undegraded":"2024-04-24T23:00:21.748494+0000","last_fullsized":"2024-04-24T23:00:21.748494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:14.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361787+0000","last_change":"2024-04-24T23:00:20.518757+0000","last_active":"2024-04-24T23:00:22.361787+0000","last_peered":"2024-04-24T23:00:22.361787+0000","last_clean":"2024-04-24T23:00:22.361787+0000","last_became_active":"2024-04-24T23:00:20.518002+0000","last_became_peered":"2024-04-24T23:00:20.518002+0000","last_unstale":"2024-04-24T23:00:22.361787+0000","last_undegraded":"2024-04-24T23:00:22.361787+0000","last_fullsized":"2024-04-24T23:00:22.361787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361059+0000","last_change":"2024-04-24T23:00:15.398338+0000","last_active":"2024-04-24T23:00:22.361059+0000","last_peered":"2024-04-24T23:00:22.361059+0000","last_clean":"2024-04-24T23:00:22.361059+0000","last_became_active":"2024-04-24T23:00:15.395766+0000","last_became_peered":"2024-04-24T23:00:15.395766+0000","last_unstale":"2024-04-24T23:00:22.361059+0000","last_undegraded":"2024-04-24T23:00:22.361059+0000","last_fullsized":"2024-04-24T23:00:22.361059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:30.228280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487678+0000","last_change":"2024-04-24T23:00:16.458641+0000","last_active":"2024-04-24T23:00:21.487678+0000","last_peered":"2024-04-24T23:00:21.487678+0000","last_clean":"2024-04-24T23:00:21.487678+0000","last_became_active":"2024-04-24T23:00:16.458237+0000","last_became_peered":"2024-04-24T23:00:16.458237+0000","last_unstale":"2024-04-24T23:00:21.487678+0000","last_undegraded":"2024-04-24T23:00:21.487678+0000","last_fullsized":"2024-04-24T23:00:21.487678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:22:17.631542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361245+0000","last_change":"2024-04-24T23:00:20.518742+0000","last_active":"2024-04-24T23:00:22.361245+0000","last_peered":"2024-04-24T23:00:22.361245+0000","last_clean":"2024-04-24T23:00:22.361245+0000","last_became_active":"2024-04-24T23:00:20.518163+0000","last_became_peered":"2024-04-24T23:00:20.518163+0000","last_unstale":"2024-04-24T23:00:22.361245+0000","last_undegraded":"2024-04-24T23:00:22.361245+0000","last_fullsized":"2024-04-24T23:00:22.361245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:35.156511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486896+0000","last_change":"2024-04-24T23:00:16.448014+0000","last_active":"2024-04-24T23:00:21.486896+0000","last_peered":"2024-04-24T23:00:21.486896+0000","last_clean":"2024-04-24T23:00:21.486896+0000","last_became_active":"2024-04-24T23:00:16.447488+0000","last_became_peered":"2024-04-24T23:00:16.447488+0000","last_unstale":"2024-04-24T23:00:21.486896+0000","last_undegraded":"2024-04-24T23:00:21.486896+0000","last_fullsized":"2024-04-24T23:00:21.486896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:29.852278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487660+0000","last_change":"2024-04-24T23:00:15.408781+0000","last_active":"2024-04-24T23:00:21.487660+0000","last_peered":"2024-04-24T23:00:21.487660+0000","last_clean":"2024-04-24T23:00:21.487660+0000","last_became_active":"2024-04-24T23:00:15.408120+0000","last_became_peered":"2024-04-24T23:00:15.408120+0000","last_unstale":"2024-04-24T23:00:21.487660+0000","last_undegraded":"2024-04-24T23:00:21.487660+0000","last_fullsized":"2024-04-24T23:00:21.487660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:38.560562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487495+0000","last_change":"2024-04-24T23:00:20.503964+0000","last_active":"2024-04-24T23:00:21.487495+0000","last_peered":"2024-04-24T23:00:21.487495+0000","last_clean":"2024-04-24T23:00:21.487495+0000","last_became_active":"2024-04-24T23:00:20.501703+0000","last_became_peered":"2024-04-24T23:00:20.501703+0000","last_unstale":"2024-04-24T23:00:21.487495+0000","last_undegraded":"2024-04-24T23:00:21.487495+0000","last_fullsized":"2024-04-24T23:00:21.487495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:40.258673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365366+0000","last_change":"2024-04-24T23:00:16.472987+0000","last_active":"2024-04-24T23:00:22.365366+0000","last_peered":"2024-04-24T23:00:22.365366+0000","last_clean":"2024-04-24T23:00:22.365366+0000","last_became_active":"2024-04-24T23:00:16.472226+0000","last_became_peered":"2024-04-24T23:00:16.472226+0000","last_unstale":"2024-04-24T23:00:22.365366+0000","last_undegraded":"2024-04-24T23:00:22.365366+0000","last_fullsized":"2024-04-24T23:00:22.365366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364010+0000","last_change":"2024-04-24T23:00:15.422963+0000","last_active":"2024-04-24T23:00:22.364010+0000","last_peered":"2024-04-24T23:00:22.364010+0000","last_clean":"2024-04-24T23:00:22.364010+0000","last_became_active":"2024-04-24T23:00:15.422121+0000","last_became_peered":"2024-04-24T23:00:15.422121+0000","last_unstale":"2024-04-24T23:00:22.364010+0000","last_undegraded":"2024-04-24T23:00:22.364010+0000","last_fullsized":"2024-04-24T23:00:22.364010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360721+0000","last_change":"2024-04-24T23:00:20.540688+0000","last_active":"2024-04-24T23:00:22.360721+0000","last_peered":"2024-04-24T23:00:22.360721+0000","last_clean":"2024-04-24T23:00:22.360721+0000","last_became_active":"2024-04-24T23:00:20.540220+0000","last_became_peered":"2024-04-24T23:00:20.540220+0000","last_unstale":"2024-04-24T23:00:22.360721+0000","last_undegraded":"2024-04-24T23:00:22.360721+0000","last_fullsized":"2024-04-24T23:00:22.360721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:33.931661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489044+0000","last_change":"2024-04-24T23:00:16.488633+0000","last_active":"2024-04-24T23:00:21.489044+0000","last_peered":"2024-04-24T23:00:21.489044+0000","last_clean":"2024-04-24T23:00:21.489044+0000","last_became_active":"2024-04-24T23:00:16.487476+0000","last_became_peered":"2024-04-24T23:00:16.487476+0000","last_unstale":"2024-04-24T23:00:21.489044+0000","last_undegraded":"2024-04-24T23:00:21.489044+0000","last_fullsized":"2024-04-24T23:00:21.489044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:06.907656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489774+0000","last_change":"2024-04-24T23:00:15.397973+0000","last_active":"2024-04-24T23:00:21.489774+0000","last_peered":"2024-04-24T23:00:21.489774+0000","last_clean":"2024-04-24T23:00:21.489774+0000","last_became_active":"2024-04-24T23:00:15.396600+0000","last_became_peered":"2024-04-24T23:00:15.396600+0000","last_unstale":"2024-04-24T23:00:21.489774+0000","last_undegraded":"2024-04-24T23:00:21.489774+0000","last_fullsized":"2024-04-24T23:00:21.489774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:22.932046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364875+0000","last_change":"2024-04-24T23:00:20.511547+0000","last_active":"2024-04-24T23:00:22.364875+0000","last_peered":"2024-04-24T23:00:22.364875+0000","last_clean":"2024-04-24T23:00:22.364875+0000","last_became_active":"2024-04-24T23:00:20.510602+0000","last_became_peered":"2024-04-24T23:00:20.510602+0000","last_unstale":"2024-04-24T23:00:22.364875+0000","last_undegraded":"2024-04-24T23:00:22.364875+0000","last_fullsized":"2024-04-24T23:00:22.364875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:17.847434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486773+0000","last_change":"2024-04-24T23:00:16.483393+0000","last_active":"2024-04-24T23:00:21.486773+0000","last_peered":"2024-04-24T23:00:21.486773+0000","last_clean":"2024-04-24T23:00:21.486773+0000","last_became_active":"2024-04-24T23:00:16.483092+0000","last_became_peered":"2024-04-24T23:00:16.483092+0000","last_unstale":"2024-04-24T23:00:21.486773+0000","last_undegraded":"2024-04-24T23:00:21.486773+0000","last_fullsized":"2024-04-24T23:00:21.486773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:38.429072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360305+0000","last_change":"2024-04-24T23:00:15.398005+0000","last_active":"2024-04-24T23:00:22.360305+0000","last_peered":"2024-04-24T23:00:22.360305+0000","last_clean":"2024-04-24T23:00:22.360305+0000","last_became_active":"2024-04-24T23:00:15.397638+0000","last_became_peered":"2024-04-24T23:00:15.397638+0000","last_unstale":"2024-04-24T23:00:22.360305+0000","last_undegraded":"2024-04-24T23:00:22.360305+0000","last_fullsized":"2024-04-24T23:00:22.360305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362139+0000","last_change":"2024-04-24T23:00:20.505995+0000","last_active":"2024-04-24T23:00:22.362139+0000","last_peered":"2024-04-24T23:00:22.362139+0000","last_clean":"2024-04-24T23:00:22.362139+0000","last_became_active":"2024-04-24T23:00:20.505532+0000","last_became_peered":"2024-04-24T23:00:20.505532+0000","last_unstale":"2024-04-24T23:00:22.362139+0000","last_undegraded":"2024-04-24T23:00:22.362139+0000","last_fullsized":"2024-04-24T23:00:22.362139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:42.508455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491149+0000","last_change":"2024-04-24T23:00:16.484306+0000","last_active":"2024-04-24T23:00:21.491149+0000","last_peered":"2024-04-24T23:00:21.491149+0000","last_clean":"2024-04-24T23:00:21.491149+0000","last_became_active":"2024-04-24T23:00:16.483585+0000","last_became_peered":"2024-04-24T23:00:16.483585+0000","last_unstale":"2024-04-24T23:00:21.491149+0000","last_undegraded":"2024-04-24T23:00:21.491149+0000","last_fullsized":"2024-04-24T23:00:21.491149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:53.051451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488704+0000","last_change":"2024-04-24T23:00:15.421158+0000","last_active":"2024-04-24T23:00:21.488704+0000","last_peered":"2024-04-24T23:00:21.488704+0000","last_clean":"2024-04-24T23:00:21.488704+0000","last_became_active":"2024-04-24T23:00:15.420839+0000","last_became_peered":"2024-04-24T23:00:15.420839+0000","last_unstale":"2024-04-24T23:00:21.488704+0000","last_undegraded":"2024-04-24T23:00:21.488704+0000","last_fullsized":"2024-04-24T23:00:21.488704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:03.276247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361402+0000","last_change":"2024-04-24T23:00:20.519755+0000","last_active":"2024-04-24T23:00:22.361402+0000","last_peered":"2024-04-24T23:00:22.361402+0000","last_clean":"2024-04-24T23:00:22.361402+0000","last_became_active":"2024-04-24T23:00:20.518470+0000","last_became_peered":"2024-04-24T23:00:20.518470+0000","last_unstale":"2024-04-24T23:00:22.361402+0000","last_undegraded":"2024-04-24T23:00:22.361402+0000","last_fullsized":"2024-04-24T23:00:22.361402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:14.639189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492639+0000","last_change":"2024-04-24T23:00:16.464487+0000","last_active":"2024-04-24T23:00:21.492639+0000","last_peered":"2024-04-24T23:00:21.492639+0000","last_clean":"2024-04-24T23:00:21.492639+0000","last_became_active":"2024-04-24T23:00:16.463565+0000","last_became_peered":"2024-04-24T23:00:16.463565+0000","last_unstale":"2024-04-24T23:00:21.492639+0000","last_undegraded":"2024-04-24T23:00:21.492639+0000","last_fullsized":"2024-04-24T23:00:21.492639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491680+0000","last_change":"2024-04-24T23:00:15.400228+0000","last_active":"2024-04-24T23:00:21.491680+0000","last_peered":"2024-04-24T23:00:21.491680+0000","last_clean":"2024-04-24T23:00:21.491680+0000","last_became_active":"2024-04-24T23:00:15.397465+0000","last_became_peered":"2024-04-24T23:00:15.397465+0000","last_unstale":"2024-04-24T23:00:21.491680+0000","last_undegraded":"2024-04-24T23:00:21.491680+0000","last_fullsized":"2024-04-24T23:00:21.491680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488900+0000","last_change":"2024-04-24T23:00:20.516766+0000","last_active":"2024-04-24T23:00:21.488900+0000","last_peered":"2024-04-24T23:00:21.488900+0000","last_clean":"2024-04-24T23:00:21.488900+0000","last_became_active":"2024-04-24T23:00:20.515972+0000","last_became_peered":"2024-04-24T23:00:20.515972+0000","last_unstale":"2024-04-24T23:00:21.488900+0000","last_undegraded":"2024-04-24T23:00:21.488900+0000","last_fullsized":"2024-04-24T23:00:21.488900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365547+0000","last_change":"2024-04-24T23:00:16.480627+0000","last_active":"2024-04-24T23:00:22.365547+0000","last_peered":"2024-04-24T23:00:22.365547+0000","last_clean":"2024-04-24T23:00:22.365547+0000","last_became_active":"2024-04-24T23:00:16.480021+0000","last_became_peered":"2024-04-24T23:00:16.480021+0000","last_unstale":"2024-04-24T23:00:22.365547+0000","last_undegraded":"2024-04-24T23:00:22.365547+0000","last_fullsized":"2024-04-24T23:00:22.365547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:04.285389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488322+0000","last_change":"2024-04-24T23:00:15.428375+0000","last_active":"2024-04-24T23:00:21.488322+0000","last_peered":"2024-04-24T23:00:21.488322+0000","last_clean":"2024-04-24T23:00:21.488322+0000","last_became_active":"2024-04-24T23:00:15.428016+0000","last_became_peered":"2024-04-24T23:00:15.428016+0000","last_unstale":"2024-04-24T23:00:21.488322+0000","last_undegraded":"2024-04-24T23:00:21.488322+0000","last_fullsized":"2024-04-24T23:00:21.488322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:24.759195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363541+0000","last_change":"2024-04-24T23:00:20.535274+0000","last_active":"2024-04-24T23:00:22.363541+0000","last_peered":"2024-04-24T23:00:22.363541+0000","last_clean":"2024-04-24T23:00:22.363541+0000","last_became_active":"2024-04-24T23:00:20.524747+0000","last_became_peered":"2024-04-24T23:00:20.524747+0000","last_unstale":"2024-04-24T23:00:22.363541+0000","last_undegraded":"2024-04-24T23:00:22.363541+0000","last_fullsized":"2024-04-24T23:00:22.363541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.814128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361971+0000","last_change":"2024-04-24T23:00:16.456641+0000","last_active":"2024-04-24T23:00:22.361971+0000","last_peered":"2024-04-24T23:00:22.361971+0000","last_clean":"2024-04-24T23:00:22.361971+0000","last_became_active":"2024-04-24T23:00:16.456268+0000","last_became_peered":"2024-04-24T23:00:16.456268+0000","last_unstale":"2024-04-24T23:00:22.361971+0000","last_undegraded":"2024-04-24T23:00:22.361971+0000","last_fullsized":"2024-04-24T23:00:22.361971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491288+0000","last_change":"2024-04-24T23:00:15.429119+0000","last_active":"2024-04-24T23:00:21.491288+0000","last_peered":"2024-04-24T23:00:21.491288+0000","last_clean":"2024-04-24T23:00:21.491288+0000","last_became_active":"2024-04-24T23:00:15.428374+0000","last_became_peered":"2024-04-24T23:00:15.428374+0000","last_unstale":"2024-04-24T23:00:21.491288+0000","last_undegraded":"2024-04-24T23:00:21.491288+0000","last_fullsized":"2024-04-24T23:00:21.491288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:13:30.412685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363356+0000","last_change":"2024-04-24T23:00:20.535730+0000","last_active":"2024-04-24T23:00:22.363356+0000","last_peered":"2024-04-24T23:00:22.363356+0000","last_clean":"2024-04-24T23:00:22.363356+0000","last_became_active":"2024-04-24T23:00:20.534430+0000","last_became_peered":"2024-04-24T23:00:20.534430+0000","last_unstale":"2024-04-24T23:00:22.363356+0000","last_undegraded":"2024-04-24T23:00:22.363356+0000","last_fullsized":"2024-04-24T23:00:22.363356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:35.156511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360697+0000","last_change":"2024-04-24T23:00:16.444070+0000","last_active":"2024-04-24T23:00:22.360697+0000","last_peered":"2024-04-24T23:00:22.360697+0000","last_clean":"2024-04-24T23:00:22.360697+0000","last_became_active":"2024-04-24T23:00:16.443620+0000","last_became_peered":"2024-04-24T23:00:16.443620+0000","last_unstale":"2024-04-24T23:00:22.360697+0000","last_undegraded":"2024-04-24T23:00:22.360697+0000","last_fullsized":"2024-04-24T23:00:22.360697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:31.077128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487637+0000","last_change":"2024-04-24T23:00:15.422571+0000","last_active":"2024-04-24T23:00:21.487637+0000","last_peered":"2024-04-24T23:00:21.487637+0000","last_clean":"2024-04-24T23:00:21.487637+0000","last_became_active":"2024-04-24T23:00:15.422167+0000","last_became_peered":"2024-04-24T23:00:15.422167+0000","last_unstale":"2024-04-24T23:00:21.487637+0000","last_undegraded":"2024-04-24T23:00:21.487637+0000","last_fullsized":"2024-04-24T23:00:21.487637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:29.417228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365058+0000","last_change":"2024-04-24T23:00:20.540587+0000","last_active":"2024-04-24T23:00:22.365058+0000","last_peered":"2024-04-24T23:00:22.365058+0000","last_clean":"2024-04-24T23:00:22.365058+0000","last_became_active":"2024-04-24T23:00:20.524719+0000","last_became_peered":"2024-04-24T23:00:20.524719+0000","last_unstale":"2024-04-24T23:00:22.365058+0000","last_undegraded":"2024-04-24T23:00:22.365058+0000","last_fullsized":"2024-04-24T23:00:22.365058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488063+0000","last_change":"2024-04-24T23:00:16.471678+0000","last_active":"2024-04-24T23:00:21.488063+0000","last_peered":"2024-04-24T23:00:21.488063+0000","last_clean":"2024-04-24T23:00:21.488063+0000","last_became_active":"2024-04-24T23:00:16.469390+0000","last_became_peered":"2024-04-24T23:00:16.469390+0000","last_unstale":"2024-04-24T23:00:21.488063+0000","last_undegraded":"2024-04-24T23:00:21.488063+0000","last_fullsized":"2024-04-24T23:00:21.488063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:31:59.778549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363883+0000","last_change":"2024-04-24T23:00:15.423024+0000","last_active":"2024-04-24T23:00:22.363883+0000","last_peered":"2024-04-24T23:00:22.363883+0000","last_clean":"2024-04-24T23:00:22.363883+0000","last_became_active":"2024-04-24T23:00:15.422275+0000","last_became_peered":"2024-04-24T23:00:15.422275+0000","last_unstale":"2024-04-24T23:00:22.363883+0000","last_undegraded":"2024-04-24T23:00:22.363883+0000","last_fullsized":"2024-04-24T23:00:22.363883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365241+0000","last_change":"2024-04-24T23:00:20.535131+0000","last_active":"2024-04-24T23:00:22.365241+0000","last_peered":"2024-04-24T23:00:22.365241+0000","last_clean":"2024-04-24T23:00:22.365241+0000","last_became_active":"2024-04-24T23:00:20.534325+0000","last_became_peered":"2024-04-24T23:00:20.534325+0000","last_unstale":"2024-04-24T23:00:22.365241+0000","last_undegraded":"2024-04-24T23:00:22.365241+0000","last_fullsized":"2024-04-24T23:00:22.365241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363140+0000","last_change":"2024-04-24T23:00:16.451991+0000","last_active":"2024-04-24T23:00:22.363140+0000","last_peered":"2024-04-24T23:00:22.363140+0000","last_clean":"2024-04-24T23:00:22.363140+0000","last_became_active":"2024-04-24T23:00:16.451226+0000","last_became_peered":"2024-04-24T23:00:16.451226+0000","last_unstale":"2024-04-24T23:00:22.363140+0000","last_undegraded":"2024-04-24T23:00:22.363140+0000","last_fullsized":"2024-04-24T23:00:22.363140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:30.426371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487107+0000","last_change":"2024-04-24T23:00:15.414535+0000","last_active":"2024-04-24T23:00:21.487107+0000","last_peered":"2024-04-24T23:00:21.487107+0000","last_clean":"2024-04-24T23:00:21.487107+0000","last_became_active":"2024-04-24T23:00:15.414224+0000","last_became_peered":"2024-04-24T23:00:15.414224+0000","last_unstale":"2024-04-24T23:00:21.487107+0000","last_undegraded":"2024-04-24T23:00:21.487107+0000","last_fullsized":"2024-04-24T23:00:21.487107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:30.228280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491178+0000","last_change":"2024-04-24T23:00:20.531159+0000","last_active":"2024-04-24T23:00:21.491178+0000","last_peered":"2024-04-24T23:00:21.491178+0000","last_clean":"2024-04-24T23:00:21.491178+0000","last_became_active":"2024-04-24T23:00:20.530682+0000","last_became_peered":"2024-04-24T23:00:20.530682+0000","last_unstale":"2024-04-24T23:00:21.491178+0000","last_undegraded":"2024-04-24T23:00:21.491178+0000","last_fullsized":"2024-04-24T23:00:21.491178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:45.629364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490334+0000","last_change":"2024-04-24T23:00:16.481649+0000","last_active":"2024-04-24T23:00:21.490334+0000","last_peered":"2024-04-24T23:00:21.490334+0000","last_clean":"2024-04-24T23:00:21.490334+0000","last_became_active":"2024-04-24T23:00:16.477192+0000","last_became_peered":"2024-04-24T23:00:16.477192+0000","last_unstale":"2024-04-24T23:00:21.490334+0000","last_undegraded":"2024-04-24T23:00:21.490334+0000","last_fullsized":"2024-04-24T23:00:21.490334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:13.768051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487760+0000","last_change":"2024-04-24T23:00:15.407927+0000","last_active":"2024-04-24T23:00:21.487760+0000","last_peered":"2024-04-24T23:00:21.487760+0000","last_clean":"2024-04-24T23:00:21.487760+0000","last_became_active":"2024-04-24T23:00:15.407609+0000","last_became_peered":"2024-04-24T23:00:15.407609+0000","last_unstale":"2024-04-24T23:00:21.487760+0000","last_undegraded":"2024-04-24T23:00:21.487760+0000","last_fullsized":"2024-04-24T23:00:21.487760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:13.689340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.747953+0000","last_change":"2024-04-24T23:00:03.344529+0000","last_active":"2024-04-24T23:00:21.747953+0000","last_peered":"2024-04-24T23:00:21.747953+0000","last_clean":"2024-04-24T23:00:21.747953+0000","last_became_active":"2024-04-24T23:00:03.344074+0000","last_became_peered":"2024-04-24T23:00:03.344074+0000","last_unstale":"2024-04-24T23:00:21.747953+0000","last_undegraded":"2024-04-24T23:00:21.747953+0000","last_fullsized":"2024-04-24T23:00:21.747953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:02.322380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:02.322380+0000","last_clean_scrub_stamp":"2024-04-24T23:00:02.322380+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:40.550881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488278+0000","last_change":"2024-04-24T23:00:20.492015+0000","last_active":"2024-04-24T23:00:21.488278+0000","last_peered":"2024-04-24T23:00:21.488278+0000","last_clean":"2024-04-24T23:00:21.488278+0000","last_became_active":"2024-04-24T23:00:20.491092+0000","last_became_peered":"2024-04-24T23:00:20.491092+0000","last_unstale":"2024-04-24T23:00:21.488278+0000","last_undegraded":"2024-04-24T23:00:21.488278+0000","last_fullsized":"2024-04-24T23:00:21.488278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:49:22.306663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487732+0000","last_change":"2024-04-24T23:00:16.448759+0000","last_active":"2024-04-24T23:00:21.487732+0000","last_peered":"2024-04-24T23:00:21.487732+0000","last_clean":"2024-04-24T23:00:21.487732+0000","last_became_active":"2024-04-24T23:00:16.448187+0000","last_became_peered":"2024-04-24T23:00:16.448187+0000","last_unstale":"2024-04-24T23:00:21.487732+0000","last_undegraded":"2024-04-24T23:00:21.487732+0000","last_fullsized":"2024-04-24T23:00:21.487732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:08:59.708506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365797+0000","last_change":"2024-04-24T23:00:15.436270+0000","last_active":"2024-04-24T23:00:22.365797+0000","last_peered":"2024-04-24T23:00:22.365797+0000","last_clean":"2024-04-24T23:00:22.365797+0000","last_became_active":"2024-04-24T23:00:15.425134+0000","last_became_peered":"2024-04-24T23:00:15.425134+0000","last_unstale":"2024-04-24T23:00:22.365797+0000","last_undegraded":"2024-04-24T23:00:22.365797+0000","last_fullsized":"2024-04-24T23:00:22.365797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361374+0000","last_change":"2024-04-24T23:00:20.500617+0000","last_active":"2024-04-24T23:00:22.361374+0000","last_peered":"2024-04-24T23:00:22.361374+0000","last_clean":"2024-04-24T23:00:22.361374+0000","last_became_active":"2024-04-24T23:00:20.500158+0000","last_became_peered":"2024-04-24T23:00:20.500158+0000","last_unstale":"2024-04-24T23:00:22.361374+0000","last_undegraded":"2024-04-24T23:00:22.361374+0000","last_fullsized":"2024-04-24T23:00:22.361374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.814128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360974+0000","last_change":"2024-04-24T23:00:16.471754+0000","last_active":"2024-04-24T23:00:22.360974+0000","last_peered":"2024-04-24T23:00:22.360974+0000","last_clean":"2024-04-24T23:00:22.360974+0000","last_became_active":"2024-04-24T23:00:16.471497+0000","last_became_peered":"2024-04-24T23:00:16.471497+0000","last_unstale":"2024-04-24T23:00:22.360974+0000","last_undegraded":"2024-04-24T23:00:22.360974+0000","last_fullsized":"2024-04-24T23:00:22.360974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:27.760709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491588+0000","last_change":"2024-04-24T23:00:15.406401+0000","last_active":"2024-04-24T23:00:21.491588+0000","last_peered":"2024-04-24T23:00:21.491588+0000","last_clean":"2024-04-24T23:00:21.491588+0000","last_became_active":"2024-04-24T23:00:15.405636+0000","last_became_peered":"2024-04-24T23:00:15.405636+0000","last_unstale":"2024-04-24T23:00:21.491588+0000","last_undegraded":"2024-04-24T23:00:21.491588+0000","last_fullsized":"2024-04-24T23:00:21.491588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:02.654515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491774+0000","last_change":"2024-04-24T23:00:20.502050+0000","last_active":"2024-04-24T23:00:21.491774+0000","last_peered":"2024-04-24T23:00:21.491774+0000","last_clean":"2024-04-24T23:00:21.491774+0000","last_became_active":"2024-04-24T23:00:20.500153+0000","last_became_peered":"2024-04-24T23:00:20.500153+0000","last_unstale":"2024-04-24T23:00:21.491774+0000","last_undegraded":"2024-04-24T23:00:21.491774+0000","last_fullsized":"2024-04-24T23:00:21.491774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:51.285256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361451+0000","last_change":"2024-04-24T23:00:16.446762+0000","last_active":"2024-04-24T23:00:22.361451+0000","last_peered":"2024-04-24T23:00:22.361451+0000","last_clean":"2024-04-24T23:00:22.361451+0000","last_became_active":"2024-04-24T23:00:16.446170+0000","last_became_peered":"2024-04-24T23:00:16.446170+0000","last_unstale":"2024-04-24T23:00:22.361451+0000","last_undegraded":"2024-04-24T23:00:22.361451+0000","last_fullsized":"2024-04-24T23:00:22.361451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.801913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491407+0000","last_change":"2024-04-24T23:00:15.423703+0000","last_active":"2024-04-24T23:00:21.491407+0000","last_peered":"2024-04-24T23:00:21.491407+0000","last_clean":"2024-04-24T23:00:21.491407+0000","last_became_active":"2024-04-24T23:00:15.414863+0000","last_became_peered":"2024-04-24T23:00:15.414863+0000","last_unstale":"2024-04-24T23:00:21.491407+0000","last_undegraded":"2024-04-24T23:00:21.491407+0000","last_fullsized":"2024-04-24T23:00:21.491407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:26.588514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486409+0000","last_change":"2024-04-24T23:00:20.499277+0000","last_active":"2024-04-24T23:00:21.486409+0000","last_peered":"2024-04-24T23:00:21.486409+0000","last_clean":"2024-04-24T23:00:21.486409+0000","last_became_active":"2024-04-24T23:00:20.498802+0000","last_became_peered":"2024-04-24T23:00:20.498802+0000","last_unstale":"2024-04-24T23:00:21.486409+0000","last_undegraded":"2024-04-24T23:00:21.486409+0000","last_fullsized":"2024-04-24T23:00:21.486409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:32.166063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362253+0000","last_change":"2024-04-24T23:00:16.448112+0000","last_active":"2024-04-24T23:00:22.362253+0000","last_peered":"2024-04-24T23:00:22.362253+0000","last_clean":"2024-04-24T23:00:22.362253+0000","last_became_active":"2024-04-24T23:00:16.447838+0000","last_became_peered":"2024-04-24T23:00:16.447838+0000","last_unstale":"2024-04-24T23:00:22.362253+0000","last_undegraded":"2024-04-24T23:00:22.362253+0000","last_fullsized":"2024-04-24T23:00:22.362253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:24.143678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361996+0000","last_change":"2024-04-24T23:00:15.420914+0000","last_active":"2024-04-24T23:00:22.361996+0000","last_peered":"2024-04-24T23:00:22.361996+0000","last_clean":"2024-04-24T23:00:22.361996+0000","last_became_active":"2024-04-24T23:00:15.420590+0000","last_became_peered":"2024-04-24T23:00:15.420590+0000","last_unstale":"2024-04-24T23:00:22.361996+0000","last_undegraded":"2024-04-24T23:00:22.361996+0000","last_fullsized":"2024-04-24T23:00:22.361996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:53.443962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.748466+0000","last_change":"2024-04-24T23:00:20.494192+0000","last_active":"2024-04-24T23:00:21.748466+0000","last_peered":"2024-04-24T23:00:21.748466+0000","last_clean":"2024-04-24T23:00:21.748466+0000","last_became_active":"2024-04-24T23:00:20.493784+0000","last_became_peered":"2024-04-24T23:00:20.493784+0000","last_unstale":"2024-04-24T23:00:21.748466+0000","last_undegraded":"2024-04-24T23:00:21.748466+0000","last_fullsized":"2024-04-24T23:00:21.748466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:10.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486486+0000","last_change":"2024-04-24T23:00:16.452682+0000","last_active":"2024-04-24T23:00:21.486486+0000","last_peered":"2024-04-24T23:00:21.486486+0000","last_clean":"2024-04-24T23:00:21.486486+0000","last_became_active":"2024-04-24T23:00:16.447742+0000","last_became_peered":"2024-04-24T23:00:16.447742+0000","last_unstale":"2024-04-24T23:00:21.486486+0000","last_undegraded":"2024-04-24T23:00:21.486486+0000","last_fullsized":"2024-04-24T23:00:21.486486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.801913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489312+0000","last_change":"2024-04-24T23:00:15.416986+0000","last_active":"2024-04-24T23:00:21.489312+0000","last_peered":"2024-04-24T23:00:21.489312+0000","last_clean":"2024-04-24T23:00:21.489312+0000","last_became_active":"2024-04-24T23:00:15.416198+0000","last_became_peered":"2024-04-24T23:00:15.416198+0000","last_unstale":"2024-04-24T23:00:21.489312+0000","last_undegraded":"2024-04-24T23:00:21.489312+0000","last_fullsized":"2024-04-24T23:00:21.489312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:27.810443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492094+0000","last_change":"2024-04-24T23:00:20.526621+0000","last_active":"2024-04-24T23:00:21.492094+0000","last_peered":"2024-04-24T23:00:21.492094+0000","last_clean":"2024-04-24T23:00:21.492094+0000","last_became_active":"2024-04-24T23:00:20.525782+0000","last_became_peered":"2024-04-24T23:00:20.525782+0000","last_unstale":"2024-04-24T23:00:21.492094+0000","last_undegraded":"2024-04-24T23:00:21.492094+0000","last_fullsized":"2024-04-24T23:00:21.492094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:38:28.209697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.747735+0000","last_change":"2024-04-24T23:00:16.454748+0000","last_active":"2024-04-24T23:00:21.747735+0000","last_peered":"2024-04-24T23:00:21.747735+0000","last_clean":"2024-04-24T23:00:21.747735+0000","last_became_active":"2024-04-24T23:00:16.454031+0000","last_became_peered":"2024-04-24T23:00:16.454031+0000","last_unstale":"2024-04-24T23:00:21.747735+0000","last_undegraded":"2024-04-24T23:00:21.747735+0000","last_fullsized":"2024-04-24T23:00:21.747735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:31.237423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360689+0000","last_change":"2024-04-24T23:00:15.420149+0000","last_active":"2024-04-24T23:00:22.360689+0000","last_peered":"2024-04-24T23:00:22.360689+0000","last_clean":"2024-04-24T23:00:22.360689+0000","last_became_active":"2024-04-24T23:00:15.416688+0000","last_became_peered":"2024-04-24T23:00:15.416688+0000","last_unstale":"2024-04-24T23:00:22.360689+0000","last_undegraded":"2024-04-24T23:00:22.360689+0000","last_fullsized":"2024-04-24T23:00:22.360689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:27.810443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491371+0000","last_change":"2024-04-24T23:00:20.517137+0000","last_active":"2024-04-24T23:00:21.491371+0000","last_peered":"2024-04-24T23:00:21.491371+0000","last_clean":"2024-04-24T23:00:21.491371+0000","last_became_active":"2024-04-24T23:00:20.516152+0000","last_became_peered":"2024-04-24T23:00:20.516152+0000","last_unstale":"2024-04-24T23:00:21.491371+0000","last_undegraded":"2024-04-24T23:00:21.491371+0000","last_fullsized":"2024-04-24T23:00:21.491371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:29.452352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487144+0000","last_change":"2024-04-24T23:00:16.458939+0000","last_active":"2024-04-24T23:00:21.487144+0000","last_peered":"2024-04-24T23:00:21.487144+0000","last_clean":"2024-04-24T23:00:21.487144+0000","last_became_active":"2024-04-24T23:00:16.458081+0000","last_became_peered":"2024-04-24T23:00:16.458081+0000","last_unstale":"2024-04-24T23:00:21.487144+0000","last_undegraded":"2024-04-24T23:00:21.487144+0000","last_fullsized":"2024-04-24T23:00:21.487144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:27.760709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487474+0000","last_change":"2024-04-24T23:00:15.413409+0000","last_active":"2024-04-24T23:00:21.487474+0000","last_peered":"2024-04-24T23:00:21.487474+0000","last_clean":"2024-04-24T23:00:21.487474+0000","last_became_active":"2024-04-24T23:00:15.412847+0000","last_became_peered":"2024-04-24T23:00:15.412847+0000","last_unstale":"2024-04-24T23:00:21.487474+0000","last_undegraded":"2024-04-24T23:00:21.487474+0000","last_fullsized":"2024-04-24T23:00:21.487474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:35.114960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364628+0000","last_change":"2024-04-24T23:00:20.536112+0000","last_active":"2024-04-24T23:00:22.364628+0000","last_peered":"2024-04-24T23:00:22.364628+0000","last_clean":"2024-04-24T23:00:22.364628+0000","last_became_active":"2024-04-24T23:00:20.529427+0000","last_became_peered":"2024-04-24T23:00:20.529427+0000","last_unstale":"2024-04-24T23:00:22.364628+0000","last_undegraded":"2024-04-24T23:00:22.364628+0000","last_fullsized":"2024-04-24T23:00:22.364628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:14.639189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363813+0000","last_change":"2024-04-24T23:00:16.465373+0000","last_active":"2024-04-24T23:00:22.363813+0000","last_peered":"2024-04-24T23:00:22.363813+0000","last_clean":"2024-04-24T23:00:22.363813+0000","last_became_active":"2024-04-24T23:00:16.464653+0000","last_became_peered":"2024-04-24T23:00:16.464653+0000","last_unstale":"2024-04-24T23:00:22.363813+0000","last_undegraded":"2024-04-24T23:00:22.363813+0000","last_fullsized":"2024-04-24T23:00:22.363813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:24.143678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365627+0000","last_change":"2024-04-24T23:00:15.427483+0000","last_active":"2024-04-24T23:00:22.365627+0000","last_peered":"2024-04-24T23:00:22.365627+0000","last_clean":"2024-04-24T23:00:22.365627+0000","last_became_active":"2024-04-24T23:00:15.426641+0000","last_became_peered":"2024-04-24T23:00:15.426641+0000","last_unstale":"2024-04-24T23:00:22.365627+0000","last_undegraded":"2024-04-24T23:00:22.365627+0000","last_fullsized":"2024-04-24T23:00:22.365627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487531+0000","last_change":"2024-04-24T23:00:20.518479+0000","last_active":"2024-04-24T23:00:21.487531+0000","last_peered":"2024-04-24T23:00:21.487531+0000","last_clean":"2024-04-24T23:00:21.487531+0000","last_became_active":"2024-04-24T23:00:20.517950+0000","last_became_peered":"2024-04-24T23:00:20.517950+0000","last_unstale":"2024-04-24T23:00:21.487531+0000","last_undegraded":"2024-04-24T23:00:21.487531+0000","last_fullsized":"2024-04-24T23:00:21.487531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:37:10.220625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361194+0000","last_change":"2024-04-24T23:00:16.456931+0000","last_active":"2024-04-24T23:00:22.361194+0000","last_peered":"2024-04-24T23:00:22.361194+0000","last_clean":"2024-04-24T23:00:22.361194+0000","last_became_active":"2024-04-24T23:00:16.456636+0000","last_became_peered":"2024-04-24T23:00:16.456636+0000","last_unstale":"2024-04-24T23:00:22.361194+0000","last_undegraded":"2024-04-24T23:00:22.361194+0000","last_fullsized":"2024-04-24T23:00:22.361194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:10.559806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:26.746469+0000","last_change":"2024-04-24T23:00:15.428189+0000","last_active":"2024-04-24T23:00:26.746469+0000","last_peered":"2024-04-24T23:00:26.746469+0000","last_clean":"2024-04-24T23:00:26.746469+0000","last_became_active":"2024-04-24T23:00:15.427837+0000","last_became_peered":"2024-04-24T23:00:15.427837+0000","last_unstale":"2024-04-24T23:00:26.746469+0000","last_undegraded":"2024-04-24T23:00:26.746469+0000","last_fullsized":"2024-04-24T23:00:26.746469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490499+0000","last_change":"2024-04-24T23:00:20.501448+0000","last_active":"2024-04-24T23:00:21.490499+0000","last_peered":"2024-04-24T23:00:21.490499+0000","last_clean":"2024-04-24T23:00:21.490499+0000","last_became_active":"2024-04-24T23:00:20.499677+0000","last_became_peered":"2024-04-24T23:00:20.499677+0000","last_unstale":"2024-04-24T23:00:21.490499+0000","last_undegraded":"2024-04-24T23:00:21.490499+0000","last_fullsized":"2024-04-24T23:00:21.490499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:42.508455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487010+0000","last_change":"2024-04-24T23:00:16.453438+0000","last_active":"2024-04-24T23:00:21.487010+0000","last_peered":"2024-04-24T23:00:21.487010+0000","last_clean":"2024-04-24T23:00:21.487010+0000","last_became_active":"2024-04-24T23:00:16.453033+0000","last_became_peered":"2024-04-24T23:00:16.453033+0000","last_unstale":"2024-04-24T23:00:21.487010+0000","last_undegraded":"2024-04-24T23:00:21.487010+0000","last_fullsized":"2024-04-24T23:00:21.487010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:52:36.324979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364820+0000","last_change":"2024-04-24T23:00:15.431369+0000","last_active":"2024-04-24T23:00:22.364820+0000","last_peered":"2024-04-24T23:00:22.364820+0000","last_clean":"2024-04-24T23:00:22.364820+0000","last_became_active":"2024-04-24T23:00:15.430254+0000","last_became_peered":"2024-04-24T23:00:15.430254+0000","last_unstale":"2024-04-24T23:00:22.364820+0000","last_undegraded":"2024-04-24T23:00:22.364820+0000","last_fullsized":"2024-04-24T23:00:22.364820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361853+0000","last_change":"2024-04-24T23:00:20.503369+0000","last_active":"2024-04-24T23:00:22.361853+0000","last_peered":"2024-04-24T23:00:22.361853+0000","last_clean":"2024-04-24T23:00:22.361853+0000","last_became_active":"2024-04-24T23:00:20.502285+0000","last_became_peered":"2024-04-24T23:00:20.502285+0000","last_unstale":"2024-04-24T23:00:22.361853+0000","last_undegraded":"2024-04-24T23:00:22.361853+0000","last_fullsized":"2024-04-24T23:00:22.361853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491903+0000","last_change":"2024-04-24T23:00:16.452958+0000","last_active":"2024-04-24T23:00:21.491903+0000","last_peered":"2024-04-24T23:00:21.491903+0000","last_clean":"2024-04-24T23:00:21.491903+0000","last_became_active":"2024-04-24T23:00:16.451611+0000","last_became_peered":"2024-04-24T23:00:16.451611+0000","last_unstale":"2024-04-24T23:00:21.491903+0000","last_undegraded":"2024-04-24T23:00:21.491903+0000","last_fullsized":"2024-04-24T23:00:21.491903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:06.283705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361667+0000","last_change":"2024-04-24T23:00:15.397614+0000","last_active":"2024-04-24T23:00:22.361667+0000","last_peered":"2024-04-24T23:00:22.361667+0000","last_clean":"2024-04-24T23:00:22.361667+0000","last_became_active":"2024-04-24T23:00:15.397253+0000","last_became_peered":"2024-04-24T23:00:15.397253+0000","last_unstale":"2024-04-24T23:00:22.361667+0000","last_undegraded":"2024-04-24T23:00:22.361667+0000","last_fullsized":"2024-04-24T23:00:22.361667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:38.560562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363337+0000","last_change":"2024-04-24T23:00:20.506736+0000","last_active":"2024-04-24T23:00:22.363337+0000","last_peered":"2024-04-24T23:00:22.363337+0000","last_clean":"2024-04-24T23:00:22.363337+0000","last_became_active":"2024-04-24T23:00:20.505504+0000","last_became_peered":"2024-04-24T23:00:20.505504+0000","last_unstale":"2024-04-24T23:00:22.363337+0000","last_undegraded":"2024-04-24T23:00:22.363337+0000","last_fullsized":"2024-04-24T23:00:22.363337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:10.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362210+0000","last_change":"2024-04-24T23:00:16.451217+0000","last_active":"2024-04-24T23:00:22.362210+0000","last_peered":"2024-04-24T23:00:22.362210+0000","last_clean":"2024-04-24T23:00:22.362210+0000","last_became_active":"2024-04-24T23:00:16.450149+0000","last_became_peered":"2024-04-24T23:00:16.450149+0000","last_unstale":"2024-04-24T23:00:22.362210+0000","last_undegraded":"2024-04-24T23:00:22.362210+0000","last_fullsized":"2024-04-24T23:00:22.362210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:36.124103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.749533+0000","last_change":"2024-04-24T23:00:15.428164+0000","last_active":"2024-04-24T23:00:21.749533+0000","last_peered":"2024-04-24T23:00:21.749533+0000","last_clean":"2024-04-24T23:00:21.749533+0000","last_became_active":"2024-04-24T23:00:15.427857+0000","last_became_peered":"2024-04-24T23:00:15.427857+0000","last_unstale":"2024-04-24T23:00:21.749533+0000","last_undegraded":"2024-04-24T23:00:21.749533+0000","last_fullsized":"2024-04-24T23:00:21.749533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489396+0000","last_change":"2024-04-24T23:00:20.507135+0000","last_active":"2024-04-24T23:00:21.489396+0000","last_peered":"2024-04-24T23:00:21.489396+0000","last_clean":"2024-04-24T23:00:21.489396+0000","last_became_active":"2024-04-24T23:00:20.506257+0000","last_became_peered":"2024-04-24T23:00:20.506257+0000","last_unstale":"2024-04-24T23:00:21.489396+0000","last_undegraded":"2024-04-24T23:00:21.489396+0000","last_fullsized":"2024-04-24T23:00:21.489396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491003+0000","last_change":"2024-04-24T23:00:20.497645+0000","last_active":"2024-04-24T23:00:21.491003+0000","last_peered":"2024-04-24T23:00:21.491003+0000","last_clean":"2024-04-24T23:00:21.491003+0000","last_became_active":"2024-04-24T23:00:20.496598+0000","last_became_peered":"2024-04-24T23:00:20.496598+0000","last_unstale":"2024-04-24T23:00:21.491003+0000","last_undegraded":"2024-04-24T23:00:21.491003+0000","last_fullsized":"2024-04-24T23:00:21.491003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:59.881296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489530+0000","last_change":"2024-04-24T23:00:16.478734+0000","last_active":"2024-04-24T23:00:21.489530+0000","last_peered":"2024-04-24T23:00:21.489530+0000","last_clean":"2024-04-24T23:00:21.489530+0000","last_became_active":"2024-04-24T23:00:16.477474+0000","last_became_peered":"2024-04-24T23:00:16.477474+0000","last_unstale":"2024-04-24T23:00:21.489530+0000","last_undegraded":"2024-04-24T23:00:21.489530+0000","last_fullsized":"2024-04-24T23:00:21.489530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.178504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486799+0000","last_change":"2024-04-24T23:00:15.405948+0000","last_active":"2024-04-24T23:00:21.486799+0000","last_peered":"2024-04-24T23:00:21.486799+0000","last_clean":"2024-04-24T23:00:21.486799+0000","last_became_active":"2024-04-24T23:00:15.405608+0000","last_became_peered":"2024-04-24T23:00:15.405608+0000","last_unstale":"2024-04-24T23:00:21.486799+0000","last_undegraded":"2024-04-24T23:00:21.486799+0000","last_fullsized":"2024-04-24T23:00:21.486799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488596+0000","last_change":"2024-04-24T23:00:20.493810+0000","last_active":"2024-04-24T23:00:21.488596+0000","last_peered":"2024-04-24T23:00:21.488596+0000","last_clean":"2024-04-24T23:00:21.488596+0000","last_became_active":"2024-04-24T23:00:20.492303+0000","last_became_peered":"2024-04-24T23:00:20.492303+0000","last_unstale":"2024-04-24T23:00:21.488596+0000","last_undegraded":"2024-04-24T23:00:21.488596+0000","last_fullsized":"2024-04-24T23:00:21.488596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:58:38.649805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489593+0000","last_change":"2024-04-24T23:00:16.465460+0000","last_active":"2024-04-24T23:00:21.489593+0000","last_peered":"2024-04-24T23:00:21.489593+0000","last_clean":"2024-04-24T23:00:21.489593+0000","last_became_active":"2024-04-24T23:00:16.457311+0000","last_became_peered":"2024-04-24T23:00:16.457311+0000","last_unstale":"2024-04-24T23:00:21.489593+0000","last_undegraded":"2024-04-24T23:00:21.489593+0000","last_fullsized":"2024-04-24T23:00:21.489593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:43:08.876496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363401+0000","last_change":"2024-04-24T23:00:15.436608+0000","last_active":"2024-04-24T23:00:22.363401+0000","last_peered":"2024-04-24T23:00:22.363401+0000","last_clean":"2024-04-24T23:00:22.363401+0000","last_became_active":"2024-04-24T23:00:15.435730+0000","last_became_peered":"2024-04-24T23:00:15.435730+0000","last_unstale":"2024-04-24T23:00:22.363401+0000","last_undegraded":"2024-04-24T23:00:22.363401+0000","last_fullsized":"2024-04-24T23:00:22.363401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487390+0000","last_change":"2024-04-24T23:00:15.417533+0000","last_active":"2024-04-24T23:00:21.487390+0000","last_peered":"2024-04-24T23:00:21.487390+0000","last_clean":"2024-04-24T23:00:21.487390+0000","last_became_active":"2024-04-24T23:00:15.417226+0000","last_became_peered":"2024-04-24T23:00:15.417226+0000","last_unstale":"2024-04-24T23:00:21.487390+0000","last_undegraded":"2024-04-24T23:00:21.487390+0000","last_fullsized":"2024-04-24T23:00:21.487390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:05.898513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490640+0000","last_change":"2024-04-24T23:00:16.483374+0000","last_active":"2024-04-24T23:00:21.490640+0000","last_peered":"2024-04-24T23:00:21.490640+0000","last_clean":"2024-04-24T23:00:21.490640+0000","last_became_active":"2024-04-24T23:00:16.482676+0000","last_became_peered":"2024-04-24T23:00:16.482676+0000","last_unstale":"2024-04-24T23:00:21.490640+0000","last_undegraded":"2024-04-24T23:00:21.490640+0000","last_fullsized":"2024-04-24T23:00:21.490640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:05.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491288+0000","last_change":"2024-04-24T23:00:20.542916+0000","last_active":"2024-04-24T23:00:21.491288+0000","last_peered":"2024-04-24T23:00:21.491288+0000","last_clean":"2024-04-24T23:00:21.491288+0000","last_became_active":"2024-04-24T23:00:20.541822+0000","last_became_peered":"2024-04-24T23:00:20.541822+0000","last_unstale":"2024-04-24T23:00:21.491288+0000","last_undegraded":"2024-04-24T23:00:21.491288+0000","last_fullsized":"2024-04-24T23:00:21.491288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:31.840092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492280+0000","last_change":"2024-04-24T23:00:15.425495+0000","last_active":"2024-04-24T23:00:21.492280+0000","last_peered":"2024-04-24T23:00:21.492280+0000","last_clean":"2024-04-24T23:00:21.492280+0000","last_became_active":"2024-04-24T23:00:15.424739+0000","last_became_peered":"2024-04-24T23:00:15.424739+0000","last_unstale":"2024-04-24T23:00:21.492280+0000","last_undegraded":"2024-04-24T23:00:21.492280+0000","last_fullsized":"2024-04-24T23:00:21.492280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:49.740745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.748176+0000","last_change":"2024-04-24T23:00:16.454250+0000","last_active":"2024-04-24T23:00:21.748176+0000","last_peered":"2024-04-24T23:00:21.748176+0000","last_clean":"2024-04-24T23:00:21.748176+0000","last_became_active":"2024-04-24T23:00:16.453965+0000","last_became_peered":"2024-04-24T23:00:16.453965+0000","last_unstale":"2024-04-24T23:00:21.748176+0000","last_undegraded":"2024-04-24T23:00:21.748176+0000","last_fullsized":"2024-04-24T23:00:21.748176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364268+0000","last_change":"2024-04-24T23:00:20.510475+0000","last_active":"2024-04-24T23:00:22.364268+0000","last_peered":"2024-04-24T23:00:22.364268+0000","last_clean":"2024-04-24T23:00:22.364268+0000","last_became_active":"2024-04-24T23:00:20.509269+0000","last_became_peered":"2024-04-24T23:00:20.509269+0000","last_unstale":"2024-04-24T23:00:22.364268+0000","last_undegraded":"2024-04-24T23:00:22.364268+0000","last_fullsized":"2024-04-24T23:00:22.364268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:09.596902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361286+0000","last_change":"2024-04-24T23:00:16.456976+0000","last_active":"2024-04-24T23:00:22.361286+0000","last_peered":"2024-04-24T23:00:22.361286+0000","last_clean":"2024-04-24T23:00:22.361286+0000","last_became_active":"2024-04-24T23:00:16.456289+0000","last_became_peered":"2024-04-24T23:00:16.456289+0000","last_unstale":"2024-04-24T23:00:22.361286+0000","last_undegraded":"2024-04-24T23:00:22.361286+0000","last_fullsized":"2024-04-24T23:00:22.361286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363709+0000","last_change":"2024-04-24T23:00:16.471774+0000","last_active":"2024-04-24T23:00:22.363709+0000","last_peered":"2024-04-24T23:00:22.363709+0000","last_clean":"2024-04-24T23:00:22.363709+0000","last_became_active":"2024-04-24T23:00:16.466134+0000","last_became_peered":"2024-04-24T23:00:16.466134+0000","last_unstale":"2024-04-24T23:00:22.363709+0000","last_undegraded":"2024-04-24T23:00:22.363709+0000","last_fullsized":"2024-04-24T23:00:22.363709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:31.237423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486774+0000","last_change":"2024-04-24T23:00:16.465926+0000","last_active":"2024-04-24T23:00:21.486774+0000","last_peered":"2024-04-24T23:00:21.486774+0000","last_clean":"2024-04-24T23:00:21.486774+0000","last_became_active":"2024-04-24T23:00:16.465659+0000","last_became_peered":"2024-04-24T23:00:16.465659+0000","last_unstale":"2024-04-24T23:00:21.486774+0000","last_undegraded":"2024-04-24T23:00:21.486774+0000","last_fullsized":"2024-04-24T23:00:21.486774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:09:47.001195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492033+0000","last_change":"2024-04-24T23:00:16.474929+0000","last_active":"2024-04-24T23:00:21.492033+0000","last_peered":"2024-04-24T23:00:21.492033+0000","last_clean":"2024-04-24T23:00:21.492033+0000","last_became_active":"2024-04-24T23:00:16.474181+0000","last_became_peered":"2024-04-24T23:00:16.474181+0000","last_unstale":"2024-04-24T23:00:21.492033+0000","last_undegraded":"2024-04-24T23:00:21.492033+0000","last_fullsized":"2024-04-24T23:00:21.492033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:56.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365315+0000","last_change":"2024-04-24T23:00:16.458411+0000","last_active":"2024-04-24T23:00:22.365315+0000","last_peered":"2024-04-24T23:00:22.365315+0000","last_clean":"2024-04-24T23:00:22.365315+0000","last_became_active":"2024-04-24T23:00:16.457641+0000","last_became_peered":"2024-04-24T23:00:16.457641+0000","last_unstale":"2024-04-24T23:00:22.365315+0000","last_undegraded":"2024-04-24T23:00:22.365315+0000","last_fullsized":"2024-04-24T23:00:22.365315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:06.907656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364328+0000","last_change":"2024-04-24T23:00:16.470324+0000","last_active":"2024-04-24T23:00:22.364328+0000","last_peered":"2024-04-24T23:00:22.364328+0000","last_clean":"2024-04-24T23:00:22.364328+0000","last_became_active":"2024-04-24T23:00:16.469614+0000","last_became_peered":"2024-04-24T23:00:16.469614+0000","last_unstale":"2024-04-24T23:00:22.364328+0000","last_undegraded":"2024-04-24T23:00:22.364328+0000","last_fullsized":"2024-04-24T23:00:22.364328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:05.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362165+0000","last_change":"2024-04-24T23:00:16.450764+0000","last_active":"2024-04-24T23:00:22.362165+0000","last_peered":"2024-04-24T23:00:22.362165+0000","last_clean":"2024-04-24T23:00:22.362165+0000","last_became_active":"2024-04-24T23:00:16.450561+0000","last_became_peered":"2024-04-24T23:00:16.450561+0000","last_unstale":"2024-04-24T23:00:22.362165+0000","last_undegraded":"2024-04-24T23:00:22.362165+0000","last_fullsized":"2024-04-24T23:00:22.362165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:30.426371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490926+0000","last_change":"2024-04-24T23:00:16.453953+0000","last_active":"2024-04-24T23:00:21.490926+0000","last_peered":"2024-04-24T23:00:21.490926+0000","last_clean":"2024-04-24T23:00:21.490926+0000","last_became_active":"2024-04-24T23:00:16.452345+0000","last_became_peered":"2024-04-24T23:00:16.452345+0000","last_unstale":"2024-04-24T23:00:21.490926+0000","last_undegraded":"2024-04-24T23:00:21.490926+0000","last_fullsized":"2024-04-24T23:00:21.490926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:58.273719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486575+0000","last_change":"2024-04-24T23:00:16.459030+0000","last_active":"2024-04-24T23:00:21.486575+0000","last_peered":"2024-04-24T23:00:21.486575+0000","last_clean":"2024-04-24T23:00:21.486575+0000","last_became_active":"2024-04-24T23:00:16.458402+0000","last_became_peered":"2024-04-24T23:00:16.458402+0000","last_unstale":"2024-04-24T23:00:21.486575+0000","last_undegraded":"2024-04-24T23:00:21.486575+0000","last_fullsized":"2024-04-24T23:00:21.486575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:33.558529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488396+0000","last_change":"2024-04-24T23:00:16.456818+0000","last_active":"2024-04-24T23:00:21.488396+0000","last_peered":"2024-04-24T23:00:21.488396+0000","last_clean":"2024-04-24T23:00:21.488396+0000","last_became_active":"2024-04-24T23:00:16.453065+0000","last_became_peered":"2024-04-24T23:00:16.453065+0000","last_unstale":"2024-04-24T23:00:21.488396+0000","last_undegraded":"2024-04-24T23:00:21.488396+0000","last_fullsized":"2024-04-24T23:00:21.488396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:02.728439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.747938+0000","last_change":"2024-04-24T23:00:16.447668+0000","last_active":"2024-04-24T23:00:21.747938+0000","last_peered":"2024-04-24T23:00:21.747938+0000","last_clean":"2024-04-24T23:00:21.747938+0000","last_became_active":"2024-04-24T23:00:16.447370+0000","last_became_peered":"2024-04-24T23:00:16.447370+0000","last_unstale":"2024-04-24T23:00:21.747938+0000","last_undegraded":"2024-04-24T23:00:21.747938+0000","last_fullsized":"2024-04-24T23:00:21.747938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490570+0000","last_change":"2024-04-24T23:00:16.478716+0000","last_active":"2024-04-24T23:00:21.490570+0000","last_peered":"2024-04-24T23:00:21.490570+0000","last_clean":"2024-04-24T23:00:21.490570+0000","last_became_active":"2024-04-24T23:00:16.477982+0000","last_became_peered":"2024-04-24T23:00:16.477982+0000","last_unstale":"2024-04-24T23:00:21.490570+0000","last_undegraded":"2024-04-24T23:00:21.490570+0000","last_fullsized":"2024-04-24T23:00:21.490570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:04.285389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360946+0000","last_change":"2024-04-24T23:00:16.449265+0000","last_active":"2024-04-24T23:00:22.360946+0000","last_peered":"2024-04-24T23:00:22.360946+0000","last_clean":"2024-04-24T23:00:22.360946+0000","last_became_active":"2024-04-24T23:00:16.446583+0000","last_became_peered":"2024-04-24T23:00:16.446583+0000","last_unstale":"2024-04-24T23:00:22.360946+0000","last_undegraded":"2024-04-24T23:00:22.360946+0000","last_fullsized":"2024-04-24T23:00:22.360946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:38.429072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488019+0000","last_change":"2024-04-24T23:00:16.483354+0000","last_active":"2024-04-24T23:00:21.488019+0000","last_peered":"2024-04-24T23:00:21.488019+0000","last_clean":"2024-04-24T23:00:21.488019+0000","last_became_active":"2024-04-24T23:00:16.483079+0000","last_became_peered":"2024-04-24T23:00:16.483079+0000","last_unstale":"2024-04-24T23:00:21.488019+0000","last_undegraded":"2024-04-24T23:00:21.488019+0000","last_fullsized":"2024-04-24T23:00:21.488019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:57:02.861698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364543+0000","last_change":"2024-04-24T23:00:16.472605+0000","last_active":"2024-04-24T23:00:22.364543+0000","last_peered":"2024-04-24T23:00:22.364543+0000","last_clean":"2024-04-24T23:00:22.364543+0000","last_became_active":"2024-04-24T23:00:16.466076+0000","last_became_peered":"2024-04-24T23:00:16.466076+0000","last_unstale":"2024-04-24T23:00:22.364543+0000","last_undegraded":"2024-04-24T23:00:22.364543+0000","last_fullsized":"2024-04-24T23:00:22.364543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488702+0000","last_change":"2024-04-24T23:00:16.457737+0000","last_active":"2024-04-24T23:00:21.488702+0000","last_peered":"2024-04-24T23:00:21.488702+0000","last_clean":"2024-04-24T23:00:21.488702+0000","last_became_active":"2024-04-24T23:00:16.453949+0000","last_became_peered":"2024-04-24T23:00:16.453949+0000","last_unstale":"2024-04-24T23:00:21.488702+0000","last_undegraded":"2024-04-24T23:00:21.488702+0000","last_fullsized":"2024-04-24T23:00:21.488702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:08.928463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486501+0000","last_change":"2024-04-24T23:00:16.452839+0000","last_active":"2024-04-24T23:00:21.486501+0000","last_peered":"2024-04-24T23:00:21.486501+0000","last_clean":"2024-04-24T23:00:21.486501+0000","last_became_active":"2024-04-24T23:00:16.445253+0000","last_became_peered":"2024-04-24T23:00:16.445253+0000","last_unstale":"2024-04-24T23:00:21.486501+0000","last_undegraded":"2024-04-24T23:00:21.486501+0000","last_fullsized":"2024-04-24T23:00:21.486501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:23.938299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488118+0000","last_change":"2024-04-24T23:00:16.455784+0000","last_active":"2024-04-24T23:00:21.488118+0000","last_peered":"2024-04-24T23:00:21.488118+0000","last_clean":"2024-04-24T23:00:21.488118+0000","last_became_active":"2024-04-24T23:00:16.454953+0000","last_became_peered":"2024-04-24T23:00:16.454953+0000","last_unstale":"2024-04-24T23:00:21.488118+0000","last_undegraded":"2024-04-24T23:00:21.488118+0000","last_fullsized":"2024-04-24T23:00:21.488118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:32.545524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363621+0000","last_change":"2024-04-24T23:00:16.468365+0000","last_active":"2024-04-24T23:00:22.363621+0000","last_peered":"2024-04-24T23:00:22.363621+0000","last_clean":"2024-04-24T23:00:22.363621+0000","last_became_active":"2024-04-24T23:00:16.467630+0000","last_became_peered":"2024-04-24T23:00:16.467630+0000","last_unstale":"2024-04-24T23:00:22.363621+0000","last_undegraded":"2024-04-24T23:00:22.363621+0000","last_fullsized":"2024-04-24T23:00:22.363621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363514+0000","last_change":"2024-04-24T23:00:16.456188+0000","last_active":"2024-04-24T23:00:22.363514+0000","last_peered":"2024-04-24T23:00:22.363514+0000","last_clean":"2024-04-24T23:00:22.363514+0000","last_became_active":"2024-04-24T23:00:16.455114+0000","last_became_peered":"2024-04-24T23:00:16.455114+0000","last_unstale":"2024-04-24T23:00:22.363514+0000","last_undegraded":"2024-04-24T23:00:22.363514+0000","last_fullsized":"2024-04-24T23:00:22.363514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:36.124103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360885+0000","last_change":"2024-04-24T23:00:16.450776+0000","last_active":"2024-04-24T23:00:22.360885+0000","last_peered":"2024-04-24T23:00:22.360885+0000","last_clean":"2024-04-24T23:00:22.360885+0000","last_became_active":"2024-04-24T23:00:16.450466+0000","last_became_peered":"2024-04-24T23:00:16.450466+0000","last_unstale":"2024-04-24T23:00:22.360885+0000","last_undegraded":"2024-04-24T23:00:22.360885+0000","last_fullsized":"2024-04-24T23:00:22.360885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:32.331306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361100+0000","last_change":"2024-04-24T23:00:16.450743+0000","last_active":"2024-04-24T23:00:22.361100+0000","last_peered":"2024-04-24T23:00:22.361100+0000","last_clean":"2024-04-24T23:00:22.361100+0000","last_became_active":"2024-04-24T23:00:16.450279+0000","last_became_peered":"2024-04-24T23:00:16.450279+0000","last_unstale":"2024-04-24T23:00:22.361100+0000","last_undegraded":"2024-04-24T23:00:22.361100+0000","last_fullsized":"2024-04-24T23:00:22.361100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:00.869015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361531+0000","last_change":"2024-04-24T23:00:16.446745+0000","last_active":"2024-04-24T23:00:22.361531+0000","last_peered":"2024-04-24T23:00:22.361531+0000","last_clean":"2024-04-24T23:00:22.361531+0000","last_became_active":"2024-04-24T23:00:16.446317+0000","last_became_peered":"2024-04-24T23:00:16.446317+0000","last_unstale":"2024-04-24T23:00:22.361531+0000","last_undegraded":"2024-04-24T23:00:22.361531+0000","last_fullsized":"2024-04-24T23:00:22.361531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:47.110869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.749496+0000","last_change":"2024-04-24T23:00:16.446352+0000","last_active":"2024-04-24T23:00:21.749496+0000","last_peered":"2024-04-24T23:00:21.749496+0000","last_clean":"2024-04-24T23:00:21.749496+0000","last_became_active":"2024-04-24T23:00:16.445839+0000","last_became_peered":"2024-04-24T23:00:16.445839+0000","last_unstale":"2024-04-24T23:00:21.749496+0000","last_undegraded":"2024-04-24T23:00:21.749496+0000","last_fullsized":"2024-04-24T23:00:21.749496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487985+0000","last_change":"2024-04-24T23:00:16.451439+0000","last_active":"2024-04-24T23:00:21.487985+0000","last_peered":"2024-04-24T23:00:21.487985+0000","last_clean":"2024-04-24T23:00:21.487985+0000","last_became_active":"2024-04-24T23:00:16.450293+0000","last_became_peered":"2024-04-24T23:00:16.450293+0000","last_unstale":"2024-04-24T23:00:21.487985+0000","last_undegraded":"2024-04-24T23:00:21.487985+0000","last_fullsized":"2024-04-24T23:00:21.487985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:19.586817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360593+0000","last_change":"2024-04-24T23:00:16.482222+0000","last_active":"2024-04-24T23:00:22.360593+0000","last_peered":"2024-04-24T23:00:22.360593+0000","last_clean":"2024-04-24T23:00:22.360593+0000","last_became_active":"2024-04-24T23:00:16.481897+0000","last_became_peered":"2024-04-24T23:00:16.481897+0000","last_unstale":"2024-04-24T23:00:22.360593+0000","last_undegraded":"2024-04-24T23:00:22.360593+0000","last_fullsized":"2024-04-24T23:00:22.360593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361442+0000","last_change":"2024-04-24T23:00:16.482100+0000","last_active":"2024-04-24T23:00:22.361442+0000","last_peered":"2024-04-24T23:00:22.361442+0000","last_clean":"2024-04-24T23:00:22.361442+0000","last_became_active":"2024-04-24T23:00:16.481832+0000","last_became_peered":"2024-04-24T23:00:16.481832+0000","last_unstale":"2024-04-24T23:00:22.361442+0000","last_undegraded":"2024-04-24T23:00:22.361442+0000","last_fullsized":"2024-04-24T23:00:22.361442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360651+0000","last_change":"2024-04-24T23:00:16.466121+0000","last_active":"2024-04-24T23:00:22.360651+0000","last_peered":"2024-04-24T23:00:22.360651+0000","last_clean":"2024-04-24T23:00:22.360651+0000","last_became_active":"2024-04-24T23:00:16.465749+0000","last_became_peered":"2024-04-24T23:00:16.465749+0000","last_unstale":"2024-04-24T23:00:22.360651+0000","last_undegraded":"2024-04-24T23:00:22.360651+0000","last_fullsized":"2024-04-24T23:00:22.360651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:05.734745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361597+0000","last_change":"2024-04-24T23:00:16.481682+0000","last_active":"2024-04-24T23:00:22.361597+0000","last_peered":"2024-04-24T23:00:22.361597+0000","last_clean":"2024-04-24T23:00:22.361597+0000","last_became_active":"2024-04-24T23:00:16.481381+0000","last_became_peered":"2024-04-24T23:00:16.481381+0000","last_unstale":"2024-04-24T23:00:22.361597+0000","last_undegraded":"2024-04-24T23:00:22.361597+0000","last_fullsized":"2024-04-24T23:00:22.361597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:14.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491105+0000","last_change":"2024-04-24T23:00:16.461984+0000","last_active":"2024-04-24T23:00:21.491105+0000","last_peered":"2024-04-24T23:00:21.491105+0000","last_clean":"2024-04-24T23:00:21.491105+0000","last_became_active":"2024-04-24T23:00:16.461267+0000","last_became_peered":"2024-04-24T23:00:16.461267+0000","last_unstale":"2024-04-24T23:00:21.491105+0000","last_undegraded":"2024-04-24T23:00:21.491105+0000","last_fullsized":"2024-04-24T23:00:21.491105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:53:00.776972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491640+0000","last_change":"2024-04-24T23:00:16.460191+0000","last_active":"2024-04-24T23:00:21.491640+0000","last_peered":"2024-04-24T23:00:21.491640+0000","last_clean":"2024-04-24T23:00:21.491640+0000","last_became_active":"2024-04-24T23:00:16.459445+0000","last_became_peered":"2024-04-24T23:00:16.459445+0000","last_unstale":"2024-04-24T23:00:21.491640+0000","last_undegraded":"2024-04-24T23:00:21.491640+0000","last_fullsized":"2024-04-24T23:00:21.491640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:12.313822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361195+0000","last_change":"2024-04-24T23:00:16.450409+0000","last_active":"2024-04-24T23:00:22.361195+0000","last_peered":"2024-04-24T23:00:22.361195+0000","last_clean":"2024-04-24T23:00:22.361195+0000","last_became_active":"2024-04-24T23:00:16.450061+0000","last_became_peered":"2024-04-24T23:00:16.450061+0000","last_unstale":"2024-04-24T23:00:22.361195+0000","last_undegraded":"2024-04-24T23:00:22.361195+0000","last_fullsized":"2024-04-24T23:00:22.361195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:23.938299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":101627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":102085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":327680,"data_stored":691941,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":101559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":101503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":691963,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:00:34.949 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-24T23:00:34.949 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-24T23:00:34.949 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-24T23:00:34.950 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-24T23:00:34.950 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-24T23:00:35.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.099+0000 7f0dff6ae640 1 Processor -- start 2024-04-24T23:00:35.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.099+0000 7f0dff6ae640 1 -- start start 2024-04-24T23:00:35.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.099+0000 7f0dff6ae640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0df80bd810 0x7f0df80b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.099+0000 7f0dff6ae640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df80bdbf0 con 0x7f0df814aef0 2024-04-24T23:00:35.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.099+0000 7f0dff6ae640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df814b320 con 0x7f0df814aab0 2024-04-24T23:00:35.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.099+0000 7f0dff6ae640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f0df80b4670 con 0x7f0df80bd810 2024-04-24T23:00:35.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.099+0000 7f0dfd44a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0df80bd810 0x7f0df80b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.099+0000 7f0dfdc4b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0df814aef0 0x7f0df8151e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54476/0 (socket says 172.21.15.43:54476) 2024-04-24T23:00:35.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.099+0000 7f0dfdc4b640 1 -- 172.21.15.43:0/4064825886 learned_addr learned my addr 172.21.15.43:0/4064825886 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:35.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.099+0000 7f0dfd44a640 1 -- 172.21.15.43:0/4064825886 >> v1:172.21.15.162:6789/0 conn(0x7f0df814aab0 legacy=0x7f0df8141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:35.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.099+0000 7f0dfd44a640 1 -- 172.21.15.43:0/4064825886 >> v1:172.21.15.43:6789/0 conn(0x7f0df814aef0 legacy=0x7f0df8151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.099+0000 7f0dfd44a640 1 -- 172.21.15.43:0/4064825886 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df80b4950 con 0x7f0df80bd810 2024-04-24T23:00:35.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.099+0000 7f0dfd44a640 1 --2- 172.21.15.43:0/4064825886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0df80bd810 0x7f0df80b5af0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0df40097c0 tx=0x7f0df401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5859e6518ca889 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:35.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0deffff640 1 -- 172.21.15.43:0/4064825886 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df40b0070 con 0x7f0df80bd810 2024-04-24T23:00:35.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0deffff640 1 -- 172.21.15.43:0/4064825886 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df40ab600 con 0x7f0df80bd810 2024-04-24T23:00:35.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0deffff640 1 -- 172.21.15.43:0/4064825886 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df40ab9d0 con 0x7f0df80bd810 2024-04-24T23:00:35.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 -- 172.21.15.43:0/4064825886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0df80bd810 msgr2=0x7f0df80b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 --2- 172.21.15.43:0/4064825886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0df80bd810 0x7f0df80b5af0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0df40097c0 tx=0x7f0df401c460 comp rx=0 tx=0).stop 2024-04-24T23:00:35.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 -- 172.21.15.43:0/4064825886 shutdown_connections 2024-04-24T23:00:35.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 --2- 172.21.15.43:0/4064825886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0df80bd810 0x7f0df80b5af0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 -- 172.21.15.43:0/4064825886 >> 172.21.15.43:0/4064825886 conn(0x7f0df8072f20 msgr2=0x7f0df80bcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:35.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 -- 172.21.15.43:0/4064825886 shutdown_connections 2024-04-24T23:00:35.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 -- 172.21.15.43:0/4064825886 wait complete. 2024-04-24T23:00:35.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 Processor -- start 2024-04-24T23:00:35.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 -- start start 2024-04-24T23:00:35.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0df80bd810 0x7f0df814a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df814aab0 0x7f0df81e3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0df814aef0 0x7f0df81e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0df8141b90 con 0x7f0df80bd810 2024-04-24T23:00:35.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0df8141a10 con 0x7f0df814aef0 2024-04-24T23:00:35.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0df8155d80 con 0x7f0df814aab0 2024-04-24T23:00:35.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dfd44a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0df80bd810 0x7f0df814a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dfd44a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0df80bd810 0x7f0df814a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42856/0 (socket says 172.21.15.43:42856) 2024-04-24T23:00:35.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dfd44a640 1 -- 172.21.15.43:0/2319087546 learned_addr learned my addr 172.21.15.43:0/2319087546 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:35.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dfd44a640 1 -- 172.21.15.43:0/2319087546 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df814aab0 msgr2=0x7f0df81e3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dfd44a640 1 --2- 172.21.15.43:0/2319087546 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df814aab0 0x7f0df81e3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dfd44a640 1 -- 172.21.15.43:0/2319087546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0df814aef0 msgr2=0x7f0df81e3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dfd44a640 1 --2- 172.21.15.43:0/2319087546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0df814aef0 0x7f0df81e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dfd44a640 1 -- 172.21.15.43:0/2319087546 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df813a110 con 0x7f0df80bd810 2024-04-24T23:00:35.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dfd44a640 1 --2- 172.21.15.43:0/2319087546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0df80bd810 0x7f0df814a3d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0df4019070 tx=0x7f0df4019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:35.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dedffb640 1 -- 172.21.15.43:0/2319087546 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df40b8030 con 0x7f0df80bd810 2024-04-24T23:00:35.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dedffb640 1 -- 172.21.15.43:0/2319087546 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df40b4410 con 0x7f0df80bd810 2024-04-24T23:00:35.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dedffb640 1 -- 172.21.15.43:0/2319087546 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df40b0040 con 0x7f0df80bd810 2024-04-24T23:00:35.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 -- 172.21.15.43:0/2319087546 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df813a3b0 con 0x7f0df80bd810 2024-04-24T23:00:35.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.103+0000 7f0dff6ae640 1 -- 172.21.15.43:0/2319087546 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df81e3140 con 0x7f0df80bd810 2024-04-24T23:00:35.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.107+0000 7f0dff6ae640 1 -- 172.21.15.43:0/2319087546 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df804f580 con 0x7f0df80bd810 2024-04-24T23:00:35.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.107+0000 7f0dedffb640 1 -- 172.21.15.43:0/2319087546 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0df40bb070 con 0x7f0df80bd810 2024-04-24T23:00:35.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.107+0000 7f0dedffb640 1 --2- 172.21.15.43:0/2319087546 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f0ddc0678c0 0x7f0ddc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.107+0000 7f0dedffb640 1 -- 172.21.15.43:0/2319087546 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0df411f390 con 0x7f0df80bd810 2024-04-24T23:00:35.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.107+0000 7f0dfcc49640 1 --2- 172.21.15.43:0/2319087546 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f0ddc0678c0 0x7f0ddc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.107+0000 7f0dfcc49640 1 --2- 172.21.15.43:0/2319087546 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f0ddc0678c0 0x7f0ddc069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0df80bcaf0 tx=0x7f0de80079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:35.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.111+0000 7f0dedffb640 1 -- 172.21.15.43:0/2319087546 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f0df40c3020 con 0x7f0df80bd810 2024-04-24T23:00:35.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.311+0000 7f0dff6ae640 1 -- 172.21.15.43:0/2319087546 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0df813ee40 con 0x7f0df80bd810 2024-04-24T23:00:35.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.315+0000 7f0dedffb640 1 -- 172.21.15.43:0/2319087546 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166884 (secure 0 0 0) 0x7f0df4016050 con 0x7f0df80bd810 2024-04-24T23:00:35.322 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:35.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.319+0000 7f0dff6ae640 1 -- 172.21.15.43:0/2319087546 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f0ddc0678c0 msgr2=0x7f0ddc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.319+0000 7f0dff6ae640 1 --2- 172.21.15.43:0/2319087546 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f0ddc0678c0 0x7f0ddc069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0df80bcaf0 tx=0x7f0de80079c0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.319+0000 7f0dff6ae640 1 -- 172.21.15.43:0/2319087546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0df80bd810 msgr2=0x7f0df814a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.319+0000 7f0dff6ae640 1 --2- 172.21.15.43:0/2319087546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0df80bd810 0x7f0df814a3d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0df4019070 tx=0x7f0df4019200 comp rx=0 tx=0).stop 2024-04-24T23:00:35.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.319+0000 7f0dff6ae640 1 -- 172.21.15.43:0/2319087546 shutdown_connections 2024-04-24T23:00:35.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.319+0000 7f0dff6ae640 1 --2- 172.21.15.43:0/2319087546 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f0ddc0678c0 0x7f0ddc069d80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.319+0000 7f0dff6ae640 1 --2- 172.21.15.43:0/2319087546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0df814aef0 0x7f0df81e3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.319+0000 7f0dff6ae640 1 --2- 172.21.15.43:0/2319087546 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df814aab0 0x7f0df81e3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.319+0000 7f0dff6ae640 1 --2- 172.21.15.43:0/2319087546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0df80bd810 0x7f0df814a3d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.319+0000 7f0dff6ae640 1 -- 172.21.15.43:0/2319087546 >> 172.21.15.43:0/2319087546 conn(0x7f0df8072f20 msgr2=0x7f0df80b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:35.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.319+0000 7f0dff6ae640 1 -- 172.21.15.43:0/2319087546 shutdown_connections 2024-04-24T23:00:35.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.319+0000 7f0dff6ae640 1 -- 172.21.15.43:0/2319087546 wait complete. 2024-04-24T23:00:35.339 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":444634859},{"type":"v1","addr":"172.21.15.43:6833","nonce":444634859}]},"active_addr":"172.21.15.43:6833/444634859","active_change":"2024-04-24T22:59:56.244680+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":2082962622}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":2492614087}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":2920685225}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":3244071997}]}]} 2024-04-24T23:00:35.342 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-24T23:00:35.343 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-24T23:00:35.343 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:35.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.455+0000 7f65f166c640 1 Processor -- start 2024-04-24T23:00:35.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.455+0000 7f65f166c640 1 -- start start 2024-04-24T23:00:35.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.455+0000 7f65f166c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f65ec0bd870 0x7f65ec0b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.455+0000 7f65f166c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65ec14b360 0x7f65ec1411c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.455+0000 7f65f166c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65ec0bdc50 con 0x7f65ec0b9590 2024-04-24T23:00:35.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.455+0000 7f65f166c640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f65ec0b5740 con 0x7f65ec0bd870 2024-04-24T23:00:35.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.455+0000 7f65f166c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f65ec0b5a20 con 0x7f65ec14b360 2024-04-24T23:00:35.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.455+0000 7f65eaffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f65ec0bd870 0x7f65ec0b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.455+0000 7f65eaffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f65ec0bd870 0x7f65ec0b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42872/0 (socket says 172.21.15.43:42872) 2024-04-24T23:00:35.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.455+0000 7f65eaffd640 1 -- 172.21.15.43:0/2063081492 learned_addr learned my addr 172.21.15.43:0/2063081492 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:35.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.455+0000 7f65eb7fe640 1 --2- 172.21.15.43:0/2063081492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65ec14b360 0x7f65ec1411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.455+0000 7f65eaffd640 1 -- 172.21.15.43:0/2063081492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65ec14b360 msgr2=0x7f65ec1411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:35.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.455+0000 7f65eaffd640 1 --2- 172.21.15.43:0/2063081492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65ec14b360 0x7f65ec1411c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.455+0000 7f65eaffd640 1 -- 172.21.15.43:0/2063081492 >> v1:172.21.15.162:6789/0 conn(0x7f65ec0b9590 legacy=0x7f65ec14ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:35.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.455+0000 7f65eaffd640 1 -- 172.21.15.43:0/2063081492 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ec0b5d00 con 0x7f65ec0bd870 2024-04-24T23:00:35.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65eaffd640 1 --2- 172.21.15.43:0/2063081492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65ec0bd870 0x7f65ec0b49d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009870 tx=0x7f65dc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e12ba5d86c87a7f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:35.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65ea7fc640 1 -- 172.21.15.43:0/2063081492 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0a7070 con 0x7f65ec0bd870 2024-04-24T23:00:35.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65ea7fc640 1 -- 172.21.15.43:0/2063081492 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc0b0070 con 0x7f65ec0bd870 2024-04-24T23:00:35.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65ea7fc640 1 -- 172.21.15.43:0/2063081492 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0ab890 con 0x7f65ec0bd870 2024-04-24T23:00:35.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 -- 172.21.15.43:0/2063081492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65ec0bd870 msgr2=0x7f65ec0b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 --2- 172.21.15.43:0/2063081492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65ec0bd870 0x7f65ec0b49d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009870 tx=0x7f65dc01c490 comp rx=0 tx=0).stop 2024-04-24T23:00:35.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 -- 172.21.15.43:0/2063081492 shutdown_connections 2024-04-24T23:00:35.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 --2- 172.21.15.43:0/2063081492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65ec14b360 0x7f65ec1411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 --2- 172.21.15.43:0/2063081492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65ec0bd870 0x7f65ec0b49d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 -- 172.21.15.43:0/2063081492 >> 172.21.15.43:0/2063081492 conn(0x7f65ec072f20 msgr2=0x7f65ec0bcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:35.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 -- 172.21.15.43:0/2063081492 shutdown_connections 2024-04-24T23:00:35.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 -- 172.21.15.43:0/2063081492 wait complete. 2024-04-24T23:00:35.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 Processor -- start 2024-04-24T23:00:35.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 -- start start 2024-04-24T23:00:35.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65ec0bd870 0x7f65ec13df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65ec14b360 0x7f65ec1e3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65ec1e3a40 0x7f65ec14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f65ec1549e0 con 0x7f65ec14b360 2024-04-24T23:00:35.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f65ec154860 con 0x7f65ec1e3a40 2024-04-24T23:00:35.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65f166c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f65ec154b60 con 0x7f65ec0bd870 2024-04-24T23:00:35.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65e3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65ec14b360 0x7f65ec1e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65e3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65ec14b360 0x7f65ec1e3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42878/0 (socket says 172.21.15.43:42878) 2024-04-24T23:00:35.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65e3fff640 1 -- 172.21.15.43:0/2026447034 learned_addr learned my addr 172.21.15.43:0/2026447034 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:35.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65eaffd640 1 --2- 172.21.15.43:0/2026447034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65ec0bd870 0x7f65ec13df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.459+0000 7f65eb7fe640 1 --2- 172.21.15.43:0/2026447034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65ec1e3a40 0x7f65ec14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65e3fff640 1 -- 172.21.15.43:0/2026447034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65ec0bd870 msgr2=0x7f65ec13df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65e3fff640 1 --2- 172.21.15.43:0/2026447034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65ec0bd870 0x7f65ec13df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65e3fff640 1 -- 172.21.15.43:0/2026447034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65ec1e3a40 msgr2=0x7f65ec14c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65e3fff640 1 --2- 172.21.15.43:0/2026447034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65ec1e3a40 0x7f65ec14c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65e3fff640 1 -- 172.21.15.43:0/2026447034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ec14cbf0 con 0x7f65ec14b360 2024-04-24T23:00:35.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65e3fff640 1 --2- 172.21.15.43:0/2026447034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65ec14b360 0x7f65ec1e3500 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f65d400c400 tx=0x7f65d400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:35.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65e37fe640 1 -- 172.21.15.43:0/2026447034 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d40052d0 con 0x7f65ec14b360 2024-04-24T23:00:35.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65e37fe640 1 -- 172.21.15.43:0/2026447034 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d4005470 con 0x7f65ec14b360 2024-04-24T23:00:35.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65e37fe640 1 -- 172.21.15.43:0/2026447034 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d4007260 con 0x7f65ec14b360 2024-04-24T23:00:35.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65f166c640 1 -- 172.21.15.43:0/2026447034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65ec14b920 con 0x7f65ec14b360 2024-04-24T23:00:35.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65f166c640 1 -- 172.21.15.43:0/2026447034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65ec143c40 con 0x7f65ec14b360 2024-04-24T23:00:35.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65f166c640 1 -- 172.21.15.43:0/2026447034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65ec04f580 con 0x7f65ec14b360 2024-04-24T23:00:35.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65e37fe640 1 -- 172.21.15.43:0/2026447034 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65d4007400 con 0x7f65ec14b360 2024-04-24T23:00:35.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65e37fe640 1 --2- 172.21.15.43:0/2026447034 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f65cc0678f0 0x7f65cc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65e37fe640 1 -- 172.21.15.43:0/2026447034 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f65d4085460 con 0x7f65ec14b360 2024-04-24T23:00:35.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65eaffd640 1 --2- 172.21.15.43:0/2026447034 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f65cc0678f0 0x7f65cc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.463+0000 7f65eaffd640 1 --2- 172.21.15.43:0/2026447034 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f65cc0678f0 0x7f65cc069db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f65dc0af000 tx=0x7f65dc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:35.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.467+0000 7f65e37fe640 1 -- 172.21.15.43:0/2026447034 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f65d4055c50 con 0x7f65ec14b360 2024-04-24T23:00:35.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.631+0000 7f65f166c640 1 -- 172.21.15.43:0/2026447034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65ec149530 con 0x7f65ec14b360 2024-04-24T23:00:35.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.635+0000 7f65e37fe640 1 -- 172.21.15.43:0/2026447034 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18518 (secure 0 0 0) 0x7f65d4055550 con 0x7f65ec14b360 2024-04-24T23:00:35.641 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:35.641 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:20.863941+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:35.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.639+0000 7f65f166c640 1 -- 172.21.15.43:0/2026447034 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f65cc0678f0 msgr2=0x7f65cc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.639+0000 7f65f166c640 1 --2- 172.21.15.43:0/2026447034 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f65cc0678f0 0x7f65cc069db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f65dc0af000 tx=0x7f65dc0a7000 comp rx=0 tx=0).stop 2024-04-24T23:00:35.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.639+0000 7f65f166c640 1 -- 172.21.15.43:0/2026447034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65ec14b360 msgr2=0x7f65ec1e3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.639+0000 7f65f166c640 1 --2- 172.21.15.43:0/2026447034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65ec14b360 0x7f65ec1e3500 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f65d400c400 tx=0x7f65d400c8c0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.639+0000 7f65f166c640 1 -- 172.21.15.43:0/2026447034 shutdown_connections 2024-04-24T23:00:35.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.639+0000 7f65f166c640 1 --2- 172.21.15.43:0/2026447034 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f65cc0678f0 0x7f65cc069db0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.639+0000 7f65f166c640 1 --2- 172.21.15.43:0/2026447034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65ec1e3a40 0x7f65ec14c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.639+0000 7f65f166c640 1 --2- 172.21.15.43:0/2026447034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65ec14b360 0x7f65ec1e3500 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.639+0000 7f65f166c640 1 --2- 172.21.15.43:0/2026447034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65ec0bd870 0x7f65ec13df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.639+0000 7f65f166c640 1 -- 172.21.15.43:0/2026447034 >> 172.21.15.43:0/2026447034 conn(0x7f65ec072f20 msgr2=0x7f65ec140650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:35.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.639+0000 7f65f166c640 1 -- 172.21.15.43:0/2026447034 shutdown_connections 2024-04-24T23:00:35.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.639+0000 7f65f166c640 1 -- 172.21.15.43:0/2026447034 wait complete. 2024-04-24T23:00:35.660 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-24T23:00:35.660 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:35.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f154e4b5640 1 Processor -- start 2024-04-24T23:00:35.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f154e4b5640 1 -- start start 2024-04-24T23:00:35.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f154e4b5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f154814ecf0 0x7f15481510e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f154e4b5640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1548070060 con 0x7f154813f1f0 2024-04-24T23:00:35.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f154e4b5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15480b28e0 con 0x7f15480b2500 2024-04-24T23:00:35.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f154e4b5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f15480af8f0 con 0x7f154814ecf0 2024-04-24T23:00:35.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f15477fe640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f154813f1f0 0x7f154813f680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54492/0 (socket says 172.21.15.43:54492) 2024-04-24T23:00:35.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f15477fe640 1 -- 172.21.15.43:0/311634363 learned_addr learned my addr 172.21.15.43:0/311634363 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:35.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f154ca52640 1 --2- 172.21.15.43:0/311634363 >> v2:172.21.15.162:3300/0 conn(0x7f154814ecf0 0x7f15481510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1546ffd640 1 -- 172.21.15.43:0/311634363 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158068567 0 0) 0x7f1548070060 con 0x7f154813f1f0 2024-04-24T23:00:35.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1546ffd640 1 -- 172.21.15.43:0/311634363 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1530003530 con 0x7f154813f1f0 2024-04-24T23:00:35.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1546ffd640 1 -- 172.21.15.43:0/311634363 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4244243071 0 0) 0x7f1530003530 con 0x7f154813f1f0 2024-04-24T23:00:35.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1546ffd640 1 -- 172.21.15.43:0/311634363 >> v2:172.21.15.162:3300/0 conn(0x7f154814ecf0 msgr2=0x7f15481510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:35.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1546ffd640 1 --2- 172.21.15.43:0/311634363 >> v2:172.21.15.162:3300/0 conn(0x7f154814ecf0 0x7f15481510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1546ffd640 1 -- 172.21.15.43:0/311634363 >> v1:172.21.15.162:6789/0 conn(0x7f15480b2500 legacy=0x7f1548145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1546ffd640 1 -- 172.21.15.43:0/311634363 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154806fb40 con 0x7f154813f1f0 2024-04-24T23:00:35.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1546ffd640 1 -- 172.21.15.43:0/311634363 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f153c001680 con 0x7f154813f1f0 2024-04-24T23:00:35.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1546ffd640 1 -- 172.21.15.43:0/311634363 >> v1:172.21.15.43:6789/0 conn(0x7f154813f1f0 legacy=0x7f154813f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1546ffd640 1 --2- 172.21.15.43:0/311634363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15300039c0 0x7f1530003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1546ffd640 1 --2- 172.21.15.43:0/311634363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1530004810 0x7f1530004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1546ffd640 1 --2- 172.21.15.43:0/311634363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15300051d0 0x7f153000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1546ffd640 1 -- 172.21.15.43:0/311634363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15480af8f0 con 0x7f15300051d0 2024-04-24T23:00:35.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1546ffd640 1 -- 172.21.15.43:0/311634363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f153000c070 con 0x7f1530004810 2024-04-24T23:00:35.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1546ffd640 1 -- 172.21.15.43:0/311634363 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f153000c270 con 0x7f15300039c0 2024-04-24T23:00:35.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f154ca52640 1 --2- 172.21.15.43:0/311634363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15300051d0 0x7f153000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f15477fe640 1 --2- 172.21.15.43:0/311634363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1530004810 0x7f1530004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f154ca52640 1 -- 172.21.15.43:0/311634363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15300039c0 msgr2=0x7f1530003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:35.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f1547fff640 1 --2- 172.21.15.43:0/311634363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15300039c0 0x7f1530003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f154ca52640 1 --2- 172.21.15.43:0/311634363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15300039c0 0x7f1530003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f154ca52640 1 -- 172.21.15.43:0/311634363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1530004810 msgr2=0x7f1530004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:35.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f154ca52640 1 --2- 172.21.15.43:0/311634363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1530004810 0x7f1530004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f154ca52640 1 -- 172.21.15.43:0/311634363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1530003530 con 0x7f15300051d0 2024-04-24T23:00:35.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.771+0000 7f15477fe640 1 --2- 172.21.15.43:0/311634363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1530004810 0x7f1530004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:35.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154ca52640 1 -- 172.21.15.43:0/311634363 reap_dead start 2024-04-24T23:00:35.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154ca52640 1 --2- 172.21.15.43:0/311634363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15300051d0 0x7f153000b9d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1540009fc0 tx=0x7f154001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e746757f6881f4b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:35.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f1546ffd640 1 -- 172.21.15.43:0/311634363 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1540009c10 con 0x7f15300051d0 2024-04-24T23:00:35.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f1546ffd640 1 -- 172.21.15.43:0/311634363 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15400a5cd0 con 0x7f15300051d0 2024-04-24T23:00:35.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f1546ffd640 1 -- 172.21.15.43:0/311634363 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1540003be0 con 0x7f15300051d0 2024-04-24T23:00:35.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154e4b5640 1 -- 172.21.15.43:0/311634363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15300051d0 msgr2=0x7f153000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154e4b5640 1 --2- 172.21.15.43:0/311634363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15300051d0 0x7f153000b9d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1540009fc0 tx=0x7f154001ccc0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154e4b5640 1 -- 172.21.15.43:0/311634363 shutdown_connections 2024-04-24T23:00:35.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154e4b5640 1 --2- 172.21.15.43:0/311634363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15300051d0 0x7f153000b9d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154e4b5640 1 -- 172.21.15.43:0/311634363 >> 172.21.15.43:0/311634363 conn(0x7f15480b5690 msgr2=0x7f15480b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:35.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154e4b5640 1 -- 172.21.15.43:0/311634363 shutdown_connections 2024-04-24T23:00:35.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154e4b5640 1 -- 172.21.15.43:0/311634363 wait complete. 2024-04-24T23:00:35.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154e4b5640 1 Processor -- start 2024-04-24T23:00:35.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154e4b5640 1 -- start start 2024-04-24T23:00:35.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154e4b5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15300051d0 0x7f15481e0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154e4b5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15481328b0 0x7f154814e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154e4b5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1548133a50 0x7f15481384e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154e4b5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15480b5290 con 0x7f15300051d0 2024-04-24T23:00:35.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154e4b5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f15480b63c0 con 0x7f15481328b0 2024-04-24T23:00:35.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f154e4b5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f15480b5410 con 0x7f1548133a50 2024-04-24T23:00:35.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f1547fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15300051d0 0x7f15481e0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f1547fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15300051d0 0x7f15481e0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42898/0 (socket says 172.21.15.43:42898) 2024-04-24T23:00:35.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.775+0000 7f1547fff640 1 -- 172.21.15.43:0/1467127402 learned_addr learned my addr 172.21.15.43:0/1467127402 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:35.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f15477fe640 1 --2- 172.21.15.43:0/1467127402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15481328b0 0x7f154814e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f154ca52640 1 --2- 172.21.15.43:0/1467127402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1548133a50 0x7f15481384e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f1547fff640 1 -- 172.21.15.43:0/1467127402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1548133a50 msgr2=0x7f15481384e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f1547fff640 1 --2- 172.21.15.43:0/1467127402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1548133a50 0x7f15481384e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f1547fff640 1 -- 172.21.15.43:0/1467127402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15481328b0 msgr2=0x7f154814e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f1547fff640 1 --2- 172.21.15.43:0/1467127402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15481328b0 0x7f154814e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f1547fff640 1 -- 172.21.15.43:0/1467127402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1548132d90 con 0x7f15300051d0 2024-04-24T23:00:35.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f154ca52640 1 --2- 172.21.15.43:0/1467127402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1548133a50 0x7f15481384e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:35.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f1547fff640 1 --2- 172.21.15.43:0/1467127402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15300051d0 0x7f15481e0220 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f153800d4c0 tx=0x7f153800d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:35.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f1544ff9640 1 -- 172.21.15.43:0/1467127402 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538005480 con 0x7f15300051d0 2024-04-24T23:00:35.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f1544ff9640 1 -- 172.21.15.43:0/1467127402 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1538017070 con 0x7f15300051d0 2024-04-24T23:00:35.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f154e4b5640 1 -- 172.21.15.43:0/1467127402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1548133070 con 0x7f15300051d0 2024-04-24T23:00:35.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f1544ff9640 1 -- 172.21.15.43:0/1467127402 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538003860 con 0x7f15300051d0 2024-04-24T23:00:35.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f154e4b5640 1 -- 172.21.15.43:0/1467127402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1548131ee0 con 0x7f15300051d0 2024-04-24T23:00:35.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f154e4b5640 1 -- 172.21.15.43:0/1467127402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f154804f580 con 0x7f15300051d0 2024-04-24T23:00:35.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f1544ff9640 1 -- 172.21.15.43:0/1467127402 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1538003a00 con 0x7f15300051d0 2024-04-24T23:00:35.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f1544ff9640 1 --2- 172.21.15.43:0/1467127402 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f15340678f0 0x7f1534069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:35.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f1544ff9640 1 -- 172.21.15.43:0/1467127402 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1538085cd0 con 0x7f15300051d0 2024-04-24T23:00:35.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f15477fe640 1 --2- 172.21.15.43:0/1467127402 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f15340678f0 0x7f1534069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:35.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.779+0000 7f15477fe640 1 --2- 172.21.15.43:0/1467127402 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f15340678f0 0x7f1534069db0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f153c0017f0 tx=0x7f153c001b70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:35.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.783+0000 7f1544ff9640 1 -- 172.21.15.43:0/1467127402 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f153800f2f0 con 0x7f15300051d0 2024-04-24T23:00:35.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.943+0000 7f154e4b5640 1 -- 172.21.15.43:0/1467127402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1548131cb0 con 0x7f15300051d0 2024-04-24T23:00:35.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.943+0000 7f1544ff9640 1 -- 172.21.15.43:0/1467127402 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18518 (secure 0 0 0) 0x7f1538056560 con 0x7f15300051d0 2024-04-24T23:00:35.949 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:35.949 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:20.863941+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:35.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.947+0000 7f154e4b5640 1 -- 172.21.15.43:0/1467127402 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f15340678f0 msgr2=0x7f1534069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.947+0000 7f154e4b5640 1 --2- 172.21.15.43:0/1467127402 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f15340678f0 0x7f1534069db0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f153c0017f0 tx=0x7f153c001b70 comp rx=0 tx=0).stop 2024-04-24T23:00:35.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.947+0000 7f154e4b5640 1 -- 172.21.15.43:0/1467127402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15300051d0 msgr2=0x7f15481e0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:35.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.947+0000 7f154e4b5640 1 --2- 172.21.15.43:0/1467127402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15300051d0 0x7f15481e0220 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f153800d4c0 tx=0x7f153800d980 comp rx=0 tx=0).stop 2024-04-24T23:00:35.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.947+0000 7f154e4b5640 1 -- 172.21.15.43:0/1467127402 shutdown_connections 2024-04-24T23:00:35.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.947+0000 7f154e4b5640 1 --2- 172.21.15.43:0/1467127402 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f15340678f0 0x7f1534069db0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.947+0000 7f154e4b5640 1 --2- 172.21.15.43:0/1467127402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1548133a50 0x7f15481384e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.947+0000 7f154e4b5640 1 --2- 172.21.15.43:0/1467127402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15481328b0 0x7f154814e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.947+0000 7f154e4b5640 1 --2- 172.21.15.43:0/1467127402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15300051d0 0x7f15481e0220 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:35.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.947+0000 7f154e4b5640 1 -- 172.21.15.43:0/1467127402 >> 172.21.15.43:0/1467127402 conn(0x7f15480b5690 msgr2=0x7f154806d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:35.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.947+0000 7f154e4b5640 1 -- 172.21.15.43:0/1467127402 shutdown_connections 2024-04-24T23:00:35.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:35.947+0000 7f154e4b5640 1 -- 172.21.15.43:0/1467127402 wait complete. 2024-04-24T23:00:35.967 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-24T23:00:35.968 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-24T23:00:35.968 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-24T23:00:35.969 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-24T23:00:35.969 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-24T23:00:35.970 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-24T23:00:35.970 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-24T23:00:35.970 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-24T23:00:36.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.139+0000 7f75c2fe5640 1 Processor -- start 2024-04-24T23:00:36.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.139+0000 7f75c2fe5640 1 -- start start 2024-04-24T23:00:36.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f990d3a2640 1 Processor -- start 2024-04-24T23:00:36.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f75c2fe5640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f75bc0b47e0 0x7f75bc06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f75c2fe5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f75bc146500 0x7f75bc14ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f75c2fe5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75bc0732e0 con 0x7f75bc06d190 2024-04-24T23:00:36.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f75c2fe5640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f75bc0af7c0 con 0x7f75bc0b47e0 2024-04-24T23:00:36.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f75c2fe5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f75bc06d5f0 con 0x7f75bc146500 2024-04-24T23:00:36.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f75c0d81640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f75bc0b47e0 0x7f75bc06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f75c0d81640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f75bc0b47e0 0x7f75bc06cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42904/0 (socket says 172.21.15.43:42904) 2024-04-24T23:00:36.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f75c0d81640 1 -- 172.21.15.43:0/1668552385 learned_addr learned my addr 172.21.15.43:0/1668552385 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f75c1582640 1 --2- 172.21.15.43:0/1668552385 >> v2:172.21.15.162:3300/0 conn(0x7f75bc146500 0x7f75bc14ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f990d3a2640 1 -- start start 2024-04-24T23:00:36.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f990d3a2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f99080ae6f0 0x7f99080aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f990d3a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f990806d5e0 0x7f990814fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f990d3a2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99080ae3b0 con 0x7f99080adfd0 2024-04-24T23:00:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f990d3a2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f99080afab0 con 0x7f99080ae6f0 2024-04-24T23:00:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f990d3a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f99080af340 con 0x7f990806d5e0 2024-04-24T23:00:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f75c0d81640 1 -- 172.21.15.43:0/1668552385 >> v2:172.21.15.162:3300/0 conn(0x7f75bc146500 msgr2=0x7f75bc14ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f75c0d81640 1 --2- 172.21.15.43:0/1668552385 >> v2:172.21.15.162:3300/0 conn(0x7f75bc146500 0x7f75bc14ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f75c0d81640 1 -- 172.21.15.43:0/1668552385 >> v1:172.21.15.162:6789/0 conn(0x7f75bc06d190 legacy=0x7f75bc145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f75c0d81640 1 -- 172.21.15.43:0/1668552385 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75bc0b4bc0 con 0x7f75bc0b47e0 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f99067fc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f99080ae6f0 0x7f99080aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f99067fc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f99080ae6f0 0x7f99080aece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.43:45638/0 (socket says 172.21.15.43:45638) 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f99067fc640 1 -- 172.21.15.43:0/1242013968 learned_addr learned my addr 172.21.15.43:0/1242013968 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f99077fe640 1 --2- 172.21.15.43:0/1242013968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f990806d5e0 0x7f990814fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f99067fc640 1 -- 172.21.15.43:0/1242013968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f990806d5e0 msgr2=0x7f990814fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f99067fc640 1 --2- 172.21.15.43:0/1242013968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f990806d5e0 0x7f990814fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f99067fc640 1 -- 172.21.15.43:0/1242013968 >> v1:172.21.15.162:6789/0 conn(0x7f99080adfd0 legacy=0x7f990814f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f99067fc640 1 -- 172.21.15.43:0/1242013968 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99080b4e20 con 0x7f99080ae6f0 2024-04-24T23:00:36.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f612e1ee640 1 Processor -- start 2024-04-24T23:00:36.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f612e1ee640 1 -- start start 2024-04-24T23:00:36.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7fa19ed2b640 1 Processor -- start 2024-04-24T23:00:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f1c7ee61640 1 Processor -- start 2024-04-24T23:00:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f1c7ee61640 1 -- start start 2024-04-24T23:00:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f1c7ee61640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1c780ae0d0 0x7f1c780b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f1c7ee61640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c780b5240 0x7f1c7806e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f1c7ee61640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c7806d680 con 0x7f1c7808b520 2024-04-24T23:00:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f1c7ee61640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1c7806d920 con 0x7f1c780ae0d0 2024-04-24T23:00:36.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f1c7ee61640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1c780af3e0 con 0x7f1c780b5240 2024-04-24T23:00:36.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7fa19ed2b640 1 -- start start 2024-04-24T23:00:36.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f1c77fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c780b5240 0x7f1c7806e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f1c77fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c780b5240 0x7f1c7806e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.43:39448/0 (socket says 172.21.15.43:39448) 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f1c77fff640 1 -- 172.21.15.43:0/3207267981 learned_addr learned my addr 172.21.15.43:0/3207267981 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f1c7cbfd640 1 --2- 172.21.15.43:0/3207267981 >> v2:172.21.15.162:3300/0 conn(0x7f1c780ae0d0 0x7f1c780b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f1c77fff640 1 -- 172.21.15.43:0/3207267981 >> v2:172.21.15.162:3300/0 conn(0x7f1c780ae0d0 msgr2=0x7f1c780b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f1c77fff640 1 --2- 172.21.15.43:0/3207267981 >> v2:172.21.15.162:3300/0 conn(0x7f1c780ae0d0 0x7f1c780b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f1c77fff640 1 -- 172.21.15.43:0/3207267981 >> v1:172.21.15.162:6789/0 conn(0x7f1c7808b520 legacy=0x7f1c7806c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.143+0000 7f1c77fff640 1 -- 172.21.15.43:0/3207267981 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c780b2df0 con 0x7f1c780b5240 2024-04-24T23:00:36.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7fa19ed2b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa1980b47e0 0x7fa19806cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7fa19ed2b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa19806d190 0x7fa198145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7fa19ed2b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1980732e0 con 0x7fa198146330 2024-04-24T23:00:36.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7fa19ed2b640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa1980af7c0 con 0x7fa19806d190 2024-04-24T23:00:36.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7fa19ed2b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa19806d5f0 con 0x7fa1980b47e0 2024-04-24T23:00:36.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f612e1ee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61280ae060 0x7f61280b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f612e1ee640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61280b4ac0 con 0x7f612814b4d0 2024-04-24T23:00:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f612e1ee640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61280ae440 con 0x7f612806e1c0 2024-04-24T23:00:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f612e1ee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61280b2fc0 con 0x7f61280ae060 2024-04-24T23:00:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b924a8640 1 Processor -- start 2024-04-24T23:00:36.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f6127fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f612814b4d0 0x7f6128152290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54498/0 (socket says 172.21.15.43:54498) 2024-04-24T23:00:36.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f6127fff640 1 -- 172.21.15.43:0/2855369456 learned_addr learned my addr 172.21.15.43:0/2855369456 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:36.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7fa19d2c8640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa198146330 0x7fa198146a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.43:53528/0 (socket says 172.21.15.43:53528) 2024-04-24T23:00:36.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7fa19d2c8640 1 -- 172.21.15.43:0/909265578 learned_addr learned my addr 172.21.15.43:0/909265578 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:36.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7fa19cac7640 1 --2- 172.21.15.43:0/909265578 >> v2:172.21.15.162:3300/0 conn(0x7fa1980b47e0 0x7fa19806cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7fa197fff640 1 --2- 172.21.15.43:0/909265578 >> v2:172.21.15.43:3300/0 conn(0x7fa19806d190 0x7fa198145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f61277fe640 1 --2- 172.21.15.43:0/2855369456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61280ae060 0x7f61280b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f75c0d81640 1 --2- 172.21.15.43:0/1668552385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc0b47e0 0x7f75bc06cc50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0b53f0 tx=0x7f75b401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e57214c1b3b8f74 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f61267fc640 1 -- 172.21.15.43:0/2855369456 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3989034345 0 0) 0x7f61280b4ac0 con 0x7f612814b4d0 2024-04-24T23:00:36.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f61267fc640 1 -- 172.21.15.43:0/2855369456 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6110003530 con 0x7f612814b4d0 2024-04-24T23:00:36.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b924a8640 1 -- start start 2024-04-24T23:00:36.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f75bb7fe640 1 -- 172.21.15.43:0/1668552385 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40a5aa0 con 0x7f75bc0b47e0 2024-04-24T23:00:36.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f75bb7fe640 1 -- 172.21.15.43:0/1668552385 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b40a5c40 con 0x7f75bc0b47e0 2024-04-24T23:00:36.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f75bb7fe640 1 -- 172.21.15.43:0/1668552385 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40ad3f0 con 0x7f75bc0b47e0 2024-04-24T23:00:36.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b924a8640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3b8c0b9e80 0x7f3b8c0b5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b924a8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b8c141100 0x7f3b8c141540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b924a8640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8c141a80 con 0x7f3b8c14aa30 2024-04-24T23:00:36.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b924a8640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f3b8c0b5c70 con 0x7f3b8c0b9e80 2024-04-24T23:00:36.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b924a8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3b8c0ba260 con 0x7f3b8c141100 2024-04-24T23:00:36.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b90a45640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3b8c14aa30 0x7f3b8c14ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54510/0 (socket says 172.21.15.43:54510) 2024-04-24T23:00:36.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b90a45640 1 -- 172.21.15.43:0/3956724785 learned_addr learned my addr 172.21.15.43:0/3956724785 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:36.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b8bfff640 1 --2- 172.21.15.43:0/3956724785 >> v2:172.21.15.43:3300/0 conn(0x7f3b8c0b9e80 0x7f3b8c0b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b8affd640 1 -- 172.21.15.43:0/3956724785 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2767905170 0 0) 0x7f3b8c141a80 con 0x7f3b8c14aa30 2024-04-24T23:00:36.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b8affd640 1 -- 172.21.15.43:0/3956724785 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b74003530 con 0x7f3b8c14aa30 2024-04-24T23:00:36.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b8bfff640 1 -- 172.21.15.43:0/3956724785 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b8c141100 msgr2=0x7f3b8c141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b8bfff640 1 --2- 172.21.15.43:0/3956724785 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b8c141100 0x7f3b8c141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b8bfff640 1 -- 172.21.15.43:0/3956724785 >> v1:172.21.15.43:6789/0 conn(0x7f3b8c14aa30 legacy=0x7f3b8c14ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f3b8bfff640 1 -- 172.21.15.43:0/3956724785 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c0b4650 con 0x7f3b8c0b9e80 2024-04-24T23:00:36.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f5327ede640 1 Processor -- start 2024-04-24T23:00:36.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f5327ede640 1 -- start start 2024-04-24T23:00:36.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f5327ede640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f53200adfd0 0x7f53200ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f5327ede640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53201503b0 con 0x7f532006d5e0 2024-04-24T23:00:36.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f5327ede640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53200ae3b0 con 0x7f53200aece0 2024-04-24T23:00:36.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f5327ede640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f53200afab0 con 0x7f53200adfd0 2024-04-24T23:00:36.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f5325c7a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f53200adfd0 0x7f53200ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f5325c7a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f53200adfd0 0x7f53200ae6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.43:45664/0 (socket says 172.21.15.43:45664) 2024-04-24T23:00:36.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f5325c7a640 1 -- 172.21.15.43:0/2094633157 learned_addr learned my addr 172.21.15.43:0/2094633157 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f5325c7a640 1 -- 172.21.15.43:0/2094633157 >> v1:172.21.15.162:6789/0 conn(0x7f53200aece0 legacy=0x7f532014f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f5325c7a640 1 -- 172.21.15.43:0/2094633157 >> v1:172.21.15.43:6789/0 conn(0x7f532006d5e0 legacy=0x7f532014fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f5325c7a640 1 -- 172.21.15.43:0/2094633157 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53200af340 con 0x7f53200adfd0 2024-04-24T23:00:36.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f75c2fe5640 1 -- 172.21.15.43:0/1668552385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc0b47e0 msgr2=0x7f75bc06cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f75c2fe5640 1 --2- 172.21.15.43:0/1668552385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc0b47e0 0x7f75bc06cc50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0b53f0 tx=0x7f75b401cbd0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f75c2fe5640 1 -- 172.21.15.43:0/1668552385 shutdown_connections 2024-04-24T23:00:36.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f75c2fe5640 1 --2- 172.21.15.43:0/1668552385 >> v2:172.21.15.162:3300/0 conn(0x7f75bc146500 0x7f75bc14ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f75c2fe5640 1 --2- 172.21.15.43:0/1668552385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc0b47e0 0x7f75bc06cc50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f75c2fe5640 1 -- 172.21.15.43:0/1668552385 >> 172.21.15.43:0/1668552385 conn(0x7f75bc0b5670 msgr2=0x7f75bc0b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7fa197fff640 1 -- 172.21.15.43:0/909265578 >> v2:172.21.15.162:3300/0 conn(0x7fa1980b47e0 msgr2=0x7fa19806cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7fa197fff640 1 --2- 172.21.15.43:0/909265578 >> v2:172.21.15.162:3300/0 conn(0x7fa1980b47e0 0x7fa19806cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7fa197fff640 1 -- 172.21.15.43:0/909265578 >> v1:172.21.15.162:6789/0 conn(0x7fa198146330 legacy=0x7fa198146a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7fa197fff640 1 -- 172.21.15.43:0/909265578 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1980b4bc0 con 0x7fa19806d190 2024-04-24T23:00:36.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f61277fe640 1 -- 172.21.15.43:0/2855369456 >> v1:172.21.15.162:6789/0 conn(0x7f612806e1c0 legacy=0x7f612814adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f61277fe640 1 -- 172.21.15.43:0/2855369456 >> v1:172.21.15.43:6789/0 conn(0x7f612814b4d0 legacy=0x7f6128152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f61277fe640 1 -- 172.21.15.43:0/2855369456 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61280af3b0 con 0x7f61280ae060 2024-04-24T23:00:36.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f99067fc640 1 --2- 172.21.15.43:0/1242013968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99080ae6f0 0x7f99080aece0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9900009e50 tx=0x7f990001c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d1201cabe20dc28 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f9905ffb640 1 -- 172.21.15.43:0/1242013968 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99000a56e0 con 0x7f99080ae6f0 2024-04-24T23:00:36.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f9905ffb640 1 -- 172.21.15.43:0/1242013968 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99000a5880 con 0x7f99080ae6f0 2024-04-24T23:00:36.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f9905ffb640 1 -- 172.21.15.43:0/1242013968 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99000a5c50 con 0x7f99080ae6f0 2024-04-24T23:00:36.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f990d3a2640 1 -- 172.21.15.43:0/1242013968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99080ae6f0 msgr2=0x7f99080aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f990d3a2640 1 --2- 172.21.15.43:0/1242013968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99080ae6f0 0x7f99080aece0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9900009e50 tx=0x7f990001c910 comp rx=0 tx=0).stop 2024-04-24T23:00:36.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f990d3a2640 1 -- 172.21.15.43:0/1242013968 shutdown_connections 2024-04-24T23:00:36.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f990d3a2640 1 --2- 172.21.15.43:0/1242013968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f990806d5e0 0x7f990814fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f990d3a2640 1 --2- 172.21.15.43:0/1242013968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99080ae6f0 0x7f99080aece0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f990d3a2640 1 -- 172.21.15.43:0/1242013968 >> 172.21.15.43:0/1242013968 conn(0x7f99080b8d40 msgr2=0x7f99080b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f990d3a2640 1 -- 172.21.15.43:0/1242013968 shutdown_connections 2024-04-24T23:00:36.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.147+0000 7f1c77fff640 1 --2- 172.21.15.43:0/3207267981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c780b5240 0x7f1c7806e080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000af00 tx=0x7f1c70021180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a289740f523b0ed server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f990d3a2640 1 -- 172.21.15.43:0/1242013968 wait complete. 2024-04-24T23:00:36.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f1c777fe640 1 -- 172.21.15.43:0/3207267981 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c700b5070 con 0x7f1c780b5240 2024-04-24T23:00:36.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7fa197fff640 1 --2- 172.21.15.43:0/909265578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa19806d190 0x7fa198145df0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa19806c0b0 tx=0x7fa18c020690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40445174896f71b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f75c2fe5640 1 -- 172.21.15.43:0/1668552385 shutdown_connections 2024-04-24T23:00:36.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7fa1977fe640 1 -- 172.21.15.43:0/909265578 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c00d2d0 con 0x7fa19806d190 2024-04-24T23:00:36.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7fa1977fe640 1 -- 172.21.15.43:0/909265578 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa18c0a9540 con 0x7fa19806d190 2024-04-24T23:00:36.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7fa1977fe640 1 -- 172.21.15.43:0/909265578 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0a9910 con 0x7fa19806d190 2024-04-24T23:00:36.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f990d3a2640 1 Processor -- start 2024-04-24T23:00:36.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f61277fe640 1 --2- 172.21.15.43:0/2855369456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61280ae060 0x7f61280b4580 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6118009770 tx=0x7f611801c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c80fa9f3d8821896 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f61267fc640 1 -- 172.21.15.43:0/2855369456 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61180b0070 con 0x7f61280ae060 2024-04-24T23:00:36.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f61267fc640 1 -- 172.21.15.43:0/2855369456 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61180ab600 con 0x7f61280ae060 2024-04-24T23:00:36.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f61267fc640 1 -- 172.21.15.43:0/2855369456 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61180ab9d0 con 0x7f61280ae060 2024-04-24T23:00:36.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f3b8bfff640 1 --2- 172.21.15.43:0/3956724785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c0b9e80 0x7f3b8c0b5730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009d90 tx=0x7f3b8401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99173f2aa60dac02 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f3b8affd640 1 -- 172.21.15.43:0/3956724785 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b840b2070 con 0x7f3b8c0b9e80 2024-04-24T23:00:36.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f3b8affd640 1 -- 172.21.15.43:0/3956724785 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b840a5890 con 0x7f3b8c0b9e80 2024-04-24T23:00:36.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f3b8affd640 1 -- 172.21.15.43:0/3956724785 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b840a5c60 con 0x7f3b8c0b9e80 2024-04-24T23:00:36.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7fa19ed2b640 1 -- 172.21.15.43:0/909265578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa19806d190 msgr2=0x7fa198145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7fa19ed2b640 1 --2- 172.21.15.43:0/909265578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa19806d190 0x7fa198145df0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa19806c0b0 tx=0x7fa18c020690 comp rx=0 tx=0).stop 2024-04-24T23:00:36.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f990d3a2640 1 -- start start 2024-04-24T23:00:36.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f990d3a2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f990806d5e0 0x7f9908120d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f990d3a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99080adfd0 0x7f9908121ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f990d3a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99080ae6f0 0x7f990806f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f990d3a2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f99081503f0 con 0x7f990806d5e0 2024-04-24T23:00:36.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f990d3a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f990806dc60 con 0x7f99080ae6f0 2024-04-24T23:00:36.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f990d3a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9908159210 con 0x7f99080adfd0 2024-04-24T23:00:36.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f9906ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f990806d5e0 0x7f9908120d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f9906ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f990806d5e0 0x7f9908120d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42938/0 (socket says 172.21.15.43:42938) 2024-04-24T23:00:36.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f9906ffd640 1 -- 172.21.15.43:0/1992305963 learned_addr learned my addr 172.21.15.43:0/1992305963 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f1c777fe640 1 -- 172.21.15.43:0/3207267981 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c700b0600 con 0x7f1c780b5240 2024-04-24T23:00:36.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f1c777fe640 1 -- 172.21.15.43:0/3207267981 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c700b09d0 con 0x7f1c780b5240 2024-04-24T23:00:36.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f75c2fe5640 1 -- 172.21.15.43:0/1668552385 wait complete. 2024-04-24T23:00:36.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f75c2fe5640 1 Processor -- start 2024-04-24T23:00:36.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7fa19ed2b640 1 -- 172.21.15.43:0/909265578 shutdown_connections 2024-04-24T23:00:36.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7fa19ed2b640 1 --2- 172.21.15.43:0/909265578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa19806d190 0x7fa198145df0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7fa19ed2b640 1 --2- 172.21.15.43:0/909265578 >> v2:172.21.15.162:3300/0 conn(0x7fa1980b47e0 0x7fa19806cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7fa19ed2b640 1 -- 172.21.15.43:0/909265578 >> 172.21.15.43:0/909265578 conn(0x7fa1980b5670 msgr2=0x7fa1980b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f1c7ee61640 1 -- 172.21.15.43:0/3207267981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c780b5240 msgr2=0x7f1c7806e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f1c7ee61640 1 --2- 172.21.15.43:0/3207267981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c780b5240 0x7f1c7806e080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000af00 tx=0x7f1c70021180 comp rx=0 tx=0).stop 2024-04-24T23:00:36.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f3b924a8640 1 -- 172.21.15.43:0/3956724785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c0b9e80 msgr2=0x7f3b8c0b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f3b924a8640 1 --2- 172.21.15.43:0/3956724785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c0b9e80 0x7f3b8c0b5730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009d90 tx=0x7f3b8401c8e0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f99077fe640 1 --2- 172.21.15.43:0/1992305963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99080ae6f0 0x7f990806f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f99067fc640 1 --2- 172.21.15.43:0/1992305963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99080adfd0 0x7f9908121ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f5325c7a640 1 --2- 172.21.15.43:0/2094633157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53200adfd0 0x7f53200ae6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5318009e50 tx=0x7f531801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=309f7e9fabeac69 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f1c7ee61640 1 -- 172.21.15.43:0/3207267981 shutdown_connections 2024-04-24T23:00:36.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f1c7ee61640 1 --2- 172.21.15.43:0/3207267981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c780b5240 0x7f1c7806e080 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000af00 tx=0x7f1c70021180 comp rx=0 tx=0).stop 2024-04-24T23:00:36.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f1c7ee61640 1 --2- 172.21.15.43:0/3207267981 >> v2:172.21.15.162:3300/0 conn(0x7f1c780ae0d0 0x7f1c780b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f1c7ee61640 1 -- 172.21.15.43:0/3207267981 >> 172.21.15.43:0/3207267981 conn(0x7f1c780b5670 msgr2=0x7f1c780b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f3b924a8640 1 -- 172.21.15.43:0/3956724785 shutdown_connections 2024-04-24T23:00:36.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f3b924a8640 1 --2- 172.21.15.43:0/3956724785 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b8c141100 0x7f3b8c141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f3b924a8640 1 --2- 172.21.15.43:0/3956724785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c0b9e80 0x7f3b8c0b5730 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f3b924a8640 1 -- 172.21.15.43:0/3956724785 >> 172.21.15.43:0/3956724785 conn(0x7f3b8c072d20 msgr2=0x7f3b8c073130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f9906ffd640 1 -- 172.21.15.43:0/1992305963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99080adfd0 msgr2=0x7f9908121ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f9906ffd640 1 --2- 172.21.15.43:0/1992305963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99080adfd0 0x7f9908121ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f9906ffd640 1 -- 172.21.15.43:0/1992305963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99080ae6f0 msgr2=0x7f990806f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f9906ffd640 1 --2- 172.21.15.43:0/1992305963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99080ae6f0 0x7f990806f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f9906ffd640 1 -- 172.21.15.43:0/1992305963 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9908072310 con 0x7f990806d5e0 2024-04-24T23:00:36.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f3b924a8640 1 -- 172.21.15.43:0/3956724785 shutdown_connections 2024-04-24T23:00:36.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f3b924a8640 1 -- 172.21.15.43:0/3956724785 wait complete. 2024-04-24T23:00:36.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f5324c78640 1 -- 172.21.15.43:0/2094633157 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53180a5660 con 0x7f53200adfd0 2024-04-24T23:00:36.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f5324c78640 1 -- 172.21.15.43:0/2094633157 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53180a5800 con 0x7f53200adfd0 2024-04-24T23:00:36.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f9906ffd640 1 --2- 172.21.15.43:0/1992305963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f990806d5e0 0x7f9908120d50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c500 tx=0x7f98f800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f612e1ee640 1 -- 172.21.15.43:0/2855369456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61280ae060 msgr2=0x7f61280b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f612e1ee640 1 --2- 172.21.15.43:0/2855369456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61280ae060 0x7f61280b4580 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6118009770 tx=0x7f611801c310 comp rx=0 tx=0).stop 2024-04-24T23:00:36.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f1c7ee61640 1 -- 172.21.15.43:0/3207267981 shutdown_connections 2024-04-24T23:00:36.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f1c7ee61640 1 -- 172.21.15.43:0/3207267981 wait complete. 2024-04-24T23:00:36.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f612e1ee640 1 -- 172.21.15.43:0/2855369456 shutdown_connections 2024-04-24T23:00:36.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f612e1ee640 1 --2- 172.21.15.43:0/2855369456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61280ae060 0x7f61280b4580 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6118009770 tx=0x7f611801c310 comp rx=0 tx=0).stop 2024-04-24T23:00:36.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f612e1ee640 1 -- 172.21.15.43:0/2855369456 >> 172.21.15.43:0/2855369456 conn(0x7f61280b5670 msgr2=0x7f61280b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f98ef7fe640 1 -- 172.21.15.43:0/1992305963 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8016020 con 0x7f990806d5e0 2024-04-24T23:00:36.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f98ef7fe640 1 -- 172.21.15.43:0/1992305963 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f8005220 con 0x7f990806d5e0 2024-04-24T23:00:36.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f98ef7fe640 1 -- 172.21.15.43:0/1992305963 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8007030 con 0x7f990806d5e0 2024-04-24T23:00:36.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f990d3a2640 1 -- 172.21.15.43:0/1992305963 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9908072ae0 con 0x7f990806d5e0 2024-04-24T23:00:36.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f990d3a2640 1 -- 172.21.15.43:0/1992305963 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99080712c0 con 0x7f990806d5e0 2024-04-24T23:00:36.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5327ede640 1 -- 172.21.15.43:0/2094633157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53200adfd0 msgr2=0x7f53200ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5327ede640 1 --2- 172.21.15.43:0/2094633157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53200adfd0 0x7f53200ae6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5318009e50 tx=0x7f531801c890 comp rx=0 tx=0).stop 2024-04-24T23:00:36.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5327ede640 1 -- 172.21.15.43:0/2094633157 shutdown_connections 2024-04-24T23:00:36.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5327ede640 1 --2- 172.21.15.43:0/2094633157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53200adfd0 0x7f53200ae6f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5327ede640 1 -- 172.21.15.43:0/2094633157 >> 172.21.15.43:0/2094633157 conn(0x7f53200b8d40 msgr2=0x7f53200b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5327ede640 1 -- 172.21.15.43:0/2094633157 shutdown_connections 2024-04-24T23:00:36.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.151+0000 7f75c2fe5640 1 -- start start 2024-04-24T23:00:36.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c2fe5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75bc06d190 0x7f75bc144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c2fe5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc0b47e0 0x7f75bc071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c2fe5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75bc146500 0x7f75bc06fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c2fe5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc0af440 con 0x7f75bc0b47e0 2024-04-24T23:00:36.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c2fe5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc0ae840 con 0x7f75bc146500 2024-04-24T23:00:36.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c2fe5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f75bc150b20 con 0x7f75bc06d190 2024-04-24T23:00:36.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b924a8640 1 Processor -- start 2024-04-24T23:00:36.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b924a8640 1 -- start start 2024-04-24T23:00:36.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c7ee61640 1 Processor -- start 2024-04-24T23:00:36.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c0d81640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75bc06d190 0x7f75bc144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c1582640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75bc146500 0x7f75bc06fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c1582640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75bc146500 0x7f75bc06fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.43:45680/0 (socket says 172.21.15.43:45680) 2024-04-24T23:00:36.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c1582640 1 -- 172.21.15.43:0/1956707443 learned_addr learned my addr 172.21.15.43:0/1956707443 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f612e1ee640 1 -- 172.21.15.43:0/2855369456 shutdown_connections 2024-04-24T23:00:36.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b924a8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b8c0b9e80 0x7f3b8c0b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b924a8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b8c141100 0x7f3b8c13af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b924a8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c14aa30 0x7f3b8c13c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b924a8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c0b9420 con 0x7f3b8c14aa30 2024-04-24T23:00:36.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b924a8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c0b92a0 con 0x7f3b8c141100 2024-04-24T23:00:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b924a8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3b8c1544e0 con 0x7f3b8c0b9e80 2024-04-24T23:00:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b90a45640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c14aa30 0x7f3b8c13c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b8b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b8c141100 0x7f3b8c13af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b90a45640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c14aa30 0x7f3b8c13c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42954/0 (socket says 172.21.15.43:42954) 2024-04-24T23:00:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b90a45640 1 -- 172.21.15.43:0/1098442975 learned_addr learned my addr 172.21.15.43:0/1098442975 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b8bfff640 1 --2- 172.21.15.43:0/1098442975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b8c0b9e80 0x7f3b8c0b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b90a45640 1 -- 172.21.15.43:0/1098442975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b8c0b9e80 msgr2=0x7f3b8c0b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b90a45640 1 --2- 172.21.15.43:0/1098442975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b8c0b9e80 0x7f3b8c0b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b90a45640 1 -- 172.21.15.43:0/1098442975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b8c141100 msgr2=0x7f3b8c13af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b90a45640 1 --2- 172.21.15.43:0/1098442975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b8c141100 0x7f3b8c13af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b90a45640 1 -- 172.21.15.43:0/1098442975 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c146eb0 con 0x7f3b8c14aa30 2024-04-24T23:00:36.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b8bfff640 1 --2- 172.21.15.43:0/1098442975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b8c0b9e80 0x7f3b8c0b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:36.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5327ede640 1 -- 172.21.15.43:0/2094633157 wait complete. 2024-04-24T23:00:36.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5327ede640 1 Processor -- start 2024-04-24T23:00:36.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c1582640 1 -- 172.21.15.43:0/1956707443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75bc06d190 msgr2=0x7f75bc144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c1582640 1 --2- 172.21.15.43:0/1956707443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75bc06d190 0x7f75bc144e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c1582640 1 -- 172.21.15.43:0/1956707443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc0b47e0 msgr2=0x7f75bc071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c1582640 1 --2- 172.21.15.43:0/1956707443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc0b47e0 0x7f75bc071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c1582640 1 -- 172.21.15.43:0/1956707443 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75bc13f060 con 0x7f75bc146500 2024-04-24T23:00:36.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f98ef7fe640 1 -- 172.21.15.43:0/1992305963 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f98f80071f0 con 0x7f990806d5e0 2024-04-24T23:00:36.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c7ee61640 1 -- start start 2024-04-24T23:00:36.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c7ee61640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c7808b520 0x7f1c7809b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c7ee61640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c780ae0d0 0x7f1c7806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c7ee61640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c7806ffe0 0x7f1c781f8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c7ee61640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1c780afcd0 con 0x7f1c7806ffe0 2024-04-24T23:00:36.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c7ee61640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1c780afb50 con 0x7f1c7808b520 2024-04-24T23:00:36.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c7ee61640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1c78161910 con 0x7f1c780ae0d0 2024-04-24T23:00:36.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c7cbfd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c7808b520 0x7f1c7809b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c7cbfd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c7808b520 0x7f1c7809b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.43:45704/0 (socket says 172.21.15.43:45704) 2024-04-24T23:00:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c7cbfd640 1 -- 172.21.15.43:0/759349893 learned_addr learned my addr 172.21.15.43:0/759349893 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c77fff640 1 --2- 172.21.15.43:0/759349893 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c780ae0d0 0x7f1c7806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c7d3fe640 1 --2- 172.21.15.43:0/759349893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c7806ffe0 0x7f1c781f8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b90a45640 1 --2- 172.21.15.43:0/1098442975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c14aa30 0x7f3b8c13c120 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00c400 tx=0x7f3b7c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c1582640 1 --2- 172.21.15.43:0/1956707443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75bc146500 0x7f75bc06fc20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00f900 tx=0x7f75ac00fdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75b97fa640 1 -- 172.21.15.43:0/1956707443 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac017070 con 0x7f75bc146500 2024-04-24T23:00:36.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75b97fa640 1 -- 172.21.15.43:0/1956707443 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75ac00dc70 con 0x7f75bc146500 2024-04-24T23:00:36.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7fa19ed2b640 1 -- 172.21.15.43:0/909265578 shutdown_connections 2024-04-24T23:00:36.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f98ef7fe640 1 --2- 172.21.15.43:0/1992305963 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98f4067910 0x7f98f4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b88ff9640 1 -- 172.21.15.43:0/1098442975 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c017070 con 0x7f3b8c14aa30 2024-04-24T23:00:36.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b88ff9640 1 -- 172.21.15.43:0/1098442975 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b7c005cf0 con 0x7f3b8c14aa30 2024-04-24T23:00:36.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b88ff9640 1 -- 172.21.15.43:0/1098442975 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0072f0 con 0x7f3b8c14aa30 2024-04-24T23:00:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b924a8640 1 -- 172.21.15.43:0/1098442975 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8c13b6e0 con 0x7f3b8c14aa30 2024-04-24T23:00:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f3b924a8640 1 -- 172.21.15.43:0/1098442975 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8c13a4a0 con 0x7f3b8c14aa30 2024-04-24T23:00:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5327ede640 1 -- start start 2024-04-24T23:00:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5327ede640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532006d5e0 0x7f532014f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5327ede640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53200adfd0 0x7f5320120c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5327ede640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53200aece0 0x7f5320123f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5327ede640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f532015a630 con 0x7f532006d5e0 2024-04-24T23:00:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5327ede640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f532006dc60 con 0x7f53200adfd0 2024-04-24T23:00:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5327ede640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f532015a7b0 con 0x7f53200aece0 2024-04-24T23:00:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f532647b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53200aece0 0x7f5320123f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f532647b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53200aece0 0x7f5320123f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.43:39494/0 (socket says 172.21.15.43:39494) 2024-04-24T23:00:36.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f532647b640 1 -- 172.21.15.43:0/1974249142 learned_addr learned my addr 172.21.15.43:0/1974249142 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f5325479640 1 --2- 172.21.15.43:0/1974249142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53200adfd0 0x7f5320120c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c2fe5640 1 -- 172.21.15.43:0/1956707443 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75bc071be0 con 0x7f75bc146500 2024-04-24T23:00:36.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75c2fe5640 1 -- 172.21.15.43:0/1956707443 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75bc1456b0 con 0x7f75bc146500 2024-04-24T23:00:36.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f75b97fa640 1 -- 172.21.15.43:0/1956707443 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac012460 con 0x7f75bc146500 2024-04-24T23:00:36.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7fa19ed2b640 1 -- 172.21.15.43:0/909265578 wait complete. 2024-04-24T23:00:36.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f612e1ee640 1 -- 172.21.15.43:0/2855369456 wait complete. 2024-04-24T23:00:36.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f612e1ee640 1 Processor -- start 2024-04-24T23:00:36.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f98ef7fe640 1 -- 172.21.15.43:0/1992305963 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f98f8085370 con 0x7f990806d5e0 2024-04-24T23:00:36.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f99067fc640 1 --2- 172.21.15.43:0/1992305963 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98f4067910 0x7f98f4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f99067fc640 1 --2- 172.21.15.43:0/1992305963 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98f4067910 0x7f98f4069dd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f99000ae000 tx=0x7f99000a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f990d3a2640 1 --2- 172.21.15.43:0/1992305963 >> [v2:172.21.15.162:6824/4054273326,v1:172.21.15.162:6825/4054273326] conn(0x7f990806fd50 0x7f99080b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c77fff640 1 -- 172.21.15.43:0/759349893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c7808b520 msgr2=0x7f1c7809b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c77fff640 1 --2- 172.21.15.43:0/759349893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c7808b520 0x7f1c7809b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c77fff640 1 -- 172.21.15.43:0/759349893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c7806ffe0 msgr2=0x7f1c781f8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c77fff640 1 --2- 172.21.15.43:0/759349893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c7806ffe0 0x7f1c781f8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c77fff640 1 -- 172.21.15.43:0/759349893 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c78070470 con 0x7f1c780ae0d0 2024-04-24T23:00:36.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.155+0000 7f1c77fff640 1 --2- 172.21.15.43:0/759349893 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c780ae0d0 0x7f1c7806faa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1c700b0000 tx=0x7f1c7001df20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f3b924a8640 1 -- 172.21.15.43:0/1098442975 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b6c001040 con 0x7f3b8c14aa30 2024-04-24T23:00:36.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f990d3a2640 1 -- 172.21.15.43:0/1992305963 --> [v2:172.21.15.162:6824/4054273326,v1:172.21.15.162:6825/4054273326] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f990804f510 con 0x7f990806fd50 2024-04-24T23:00:36.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f532647b640 1 -- 172.21.15.43:0/1974249142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53200adfd0 msgr2=0x7f5320120c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f532647b640 1 --2- 172.21.15.43:0/1974249142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53200adfd0 0x7f5320120c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f532647b640 1 -- 172.21.15.43:0/1974249142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532006d5e0 msgr2=0x7f532014f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f532647b640 1 --2- 172.21.15.43:0/1974249142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f532006d5e0 0x7f532014f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f532647b640 1 -- 172.21.15.43:0/1974249142 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53201e4ce0 con 0x7f53200aece0 2024-04-24T23:00:36.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f5325479640 1 --2- 172.21.15.43:0/1974249142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53200adfd0 0x7f5320120c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:00:36.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f99077fe640 1 --2- 172.21.15.43:0/1992305963 >> [v2:172.21.15.162:6824/4054273326,v1:172.21.15.162:6825/4054273326] conn(0x7f990806fd50 0x7f99080b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f532647b640 1 --2- 172.21.15.43:0/1974249142 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53200aece0 0x7f5320123f50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f531c00c440 tx=0x7f531c00c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa19ed2b640 1 Processor -- start 2024-04-24T23:00:36.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f612e1ee640 1 -- start start 2024-04-24T23:00:36.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f99077fe640 1 --2- 172.21.15.43:0/1992305963 >> [v2:172.21.15.162:6824/4054273326,v1:172.21.15.162:6825/4054273326] conn(0x7f990806fd50 0x7f99080b7f40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f75c2fe5640 1 -- 172.21.15.43:0/1956707443 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f75bc072750 con 0x7f75bc146500 2024-04-24T23:00:36.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f75b97fa640 1 -- 172.21.15.43:0/1956707443 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f75ac01a070 con 0x7f75bc146500 2024-04-24T23:00:36.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f612e1ee640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f612806e1c0 0x7f6128145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f3b88ff9640 1 -- 172.21.15.43:0/1098442975 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3b7c01a070 con 0x7f3b8c14aa30 2024-04-24T23:00:36.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f3b88ff9640 1 --2- 172.21.15.43:0/1098442975 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3b78067990 0x7f3b78069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f3b88ff9640 1 -- 172.21.15.43:0/1098442975 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3b7c085a30 con 0x7f3b8c14aa30 2024-04-24T23:00:36.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f3b88ff9640 1 --2- 172.21.15.43:0/1098442975 >> [v2:172.21.15.43:6800/4282580106,v1:172.21.15.43:6801/4282580106] conn(0x7f3b78071080 0x7f3b780734c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f3b88ff9640 1 -- 172.21.15.43:0/1098442975 --> [v2:172.21.15.43:6800/4282580106,v1:172.21.15.43:6801/4282580106] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b7c01ee50 con 0x7f3b78071080 2024-04-24T23:00:36.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f3b88ff9640 1 -- 172.21.15.43:0/1098442975 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3b7c051ef0 con 0x7f3b8c14aa30 2024-04-24T23:00:36.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f3b8bfff640 1 --2- 172.21.15.43:0/1098442975 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3b78067990 0x7f3b78069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f3b8b7fe640 1 --2- 172.21.15.43:0/1098442975 >> [v2:172.21.15.43:6800/4282580106,v1:172.21.15.43:6801/4282580106] conn(0x7f3b78071080 0x7f3b780734c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f3b8bfff640 1 --2- 172.21.15.43:0/1098442975 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3b78067990 0x7f3b78069e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3b840af000 tx=0x7f3b840a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f3b8b7fe640 1 --2- 172.21.15.43:0/1098442975 >> [v2:172.21.15.43:6800/4282580106,v1:172.21.15.43:6801/4282580106] conn(0x7f3b78071080 0x7f3b780734c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f53167fc640 1 -- 172.21.15.43:0/1974249142 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c017070 con 0x7f53200aece0 2024-04-24T23:00:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f5327ede640 1 -- 172.21.15.43:0/1974249142 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53201211a0 con 0x7f53200aece0 2024-04-24T23:00:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f5327ede640 1 -- 172.21.15.43:0/1974249142 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5320121750 con 0x7f53200aece0 2024-04-24T23:00:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f53167fc640 1 -- 172.21.15.43:0/1974249142 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f531c003600 con 0x7f53200aece0 2024-04-24T23:00:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f53167fc640 1 -- 172.21.15.43:0/1974249142 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c0039f0 con 0x7f53200aece0 2024-04-24T23:00:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f5327ede640 1 -- 172.21.15.43:0/1974249142 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53201e5660 con 0x7f53200aece0 2024-04-24T23:00:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f75b97fa640 1 --2- 172.21.15.43:0/1956707443 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f75a80678f0 0x7f75a8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f75b97fa640 1 -- 172.21.15.43:0/1956707443 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f75ac086300 con 0x7f75bc146500 2024-04-24T23:00:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f75b97fa640 1 --2- 172.21.15.43:0/1956707443 >> [v2:172.21.15.43:6816/1769132304,v1:172.21.15.43:6817/1769132304] conn(0x7f75a8070ff0 0x7f75a8073430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f75b97fa640 1 -- 172.21.15.43:0/1956707443 --> [v2:172.21.15.43:6816/1769132304,v1:172.21.15.43:6817/1769132304] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75ac016e50 con 0x7f75a8070ff0 2024-04-24T23:00:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f75b97fa640 1 -- 172.21.15.43:0/1956707443 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f75ac0866f0 con 0x7f75bc146500 2024-04-24T23:00:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f75bbfff640 1 --2- 172.21.15.43:0/1956707443 >> [v2:172.21.15.43:6816/1769132304,v1:172.21.15.43:6817/1769132304] conn(0x7f75a8070ff0 0x7f75a8073430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f75c0d81640 1 --2- 172.21.15.43:0/1956707443 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f75a80678f0 0x7f75a8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f75bbfff640 1 --2- 172.21.15.43:0/1956707443 >> [v2:172.21.15.43:6816/1769132304,v1:172.21.15.43:6817/1769132304] conn(0x7f75a8070ff0 0x7f75a8073430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f75c0d81640 1 --2- 172.21.15.43:0/1956707443 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f75a80678f0 0x7f75a8069db0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f75b40ae000 tx=0x7f75b40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa19ed2b640 1 -- start start 2024-04-24T23:00:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa19ed2b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa19806d190 0x7fa1981e8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa19ed2b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1980b47e0 0x7fa19813ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa19ed2b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa198146330 0x7fa1980b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa19ed2b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa1980af440 con 0x7fa198146330 2024-04-24T23:00:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa19ed2b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa1980ae840 con 0x7fa19806d190 2024-04-24T23:00:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa19ed2b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa198146740 con 0x7fa1980b47e0 2024-04-24T23:00:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa197fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1980b47e0 0x7fa19813ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa197fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1980b47e0 0x7fa19813ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.43:39498/0 (socket says 172.21.15.43:39498) 2024-04-24T23:00:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa19cac7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa19806d190 0x7fa1981e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa197fff640 1 -- 172.21.15.43:0/3107556169 learned_addr learned my addr 172.21.15.43:0/3107556169 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa19cac7640 1 -- 172.21.15.43:0/3107556169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1980b47e0 msgr2=0x7fa19813ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa19cac7640 1 --2- 172.21.15.43:0/3107556169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1980b47e0 0x7fa19813ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa19cac7640 1 -- 172.21.15.43:0/3107556169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa198146330 msgr2=0x7fa1980b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa19cac7640 1 --2- 172.21.15.43:0/3107556169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa198146330 0x7fa1980b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa19cac7640 1 -- 172.21.15.43:0/3107556169 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa198070ee0 con 0x7fa19806d190 2024-04-24T23:00:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7fa19cac7640 1 --2- 172.21.15.43:0/3107556169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa19806d190 0x7fa1981e8610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa190008c00 tx=0x7fa190010500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7fa1957fa640 1 -- 172.21.15.43:0/3107556169 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19001b070 con 0x7fa19806d190 2024-04-24T23:00:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7fa1957fa640 1 -- 172.21.15.43:0/3107556169 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa190008e10 con 0x7fa19806d190 2024-04-24T23:00:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7fa1957fa640 1 -- 172.21.15.43:0/3107556169 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa190010e10 con 0x7fa19806d190 2024-04-24T23:00:36.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f61277fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f612806e1c0 0x7f6128145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f612e1ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f612814b4d0 0x7f61281d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f6126ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f612814b4d0 0x7f61281d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f6126ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f612814b4d0 0x7f61281d32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.43:45738/0 (socket says 172.21.15.43:45738) 2024-04-24T23:00:36.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f61277fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f612806e1c0 0x7f6128145fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42964/0 (socket says 172.21.15.43:42964) 2024-04-24T23:00:36.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f612e1ee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61281d3830 0x7f61281e4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f6126ffd640 1 -- 172.21.15.43:0/3119556994 learned_addr learned my addr 172.21.15.43:0/3119556994 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f612e1ee640 1 -- 172.21.15.43:0/3119556994 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f61280b2c50 con 0x7f612806e1c0 2024-04-24T23:00:36.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f612e1ee640 1 -- 172.21.15.43:0/3119556994 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61280af690 con 0x7f612814b4d0 2024-04-24T23:00:36.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f6127fff640 1 --2- 172.21.15.43:0/3119556994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61281d3830 0x7f61281e4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f612e1ee640 1 -- 172.21.15.43:0/3119556994 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61280b5260 con 0x7f61281d3830 2024-04-24T23:00:36.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f98ef7fe640 1 -- 172.21.15.43:0/1992305963 <== osd.6 v2:172.21.15.162:6824/4054273326 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f990804f510 con 0x7f990806fd50 2024-04-24T23:00:36.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f1c757fa640 1 -- 172.21.15.43:0/759349893 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c700b5070 con 0x7f1c780ae0d0 2024-04-24T23:00:36.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f1c7ee61640 1 -- 172.21.15.43:0/759349893 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7809d4b0 con 0x7f1c780ae0d0 2024-04-24T23:00:36.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f1c7ee61640 1 -- 172.21.15.43:0/759349893 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c78071930 con 0x7f1c780ae0d0 2024-04-24T23:00:36.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f1c757fa640 1 -- 172.21.15.43:0/759349893 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c700039a0 con 0x7f1c780ae0d0 2024-04-24T23:00:36.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f1c757fa640 1 -- 172.21.15.43:0/759349893 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70003d90 con 0x7f1c780ae0d0 2024-04-24T23:00:36.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.159+0000 7f1c7ee61640 1 -- 172.21.15.43:0/759349893 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c7804f510 con 0x7f1c780ae0d0 2024-04-24T23:00:36.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f1c757fa640 1 -- 172.21.15.43:0/759349893 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c700b9070 con 0x7f1c780ae0d0 2024-04-24T23:00:36.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f1c757fa640 1 --2- 172.21.15.43:0/759349893 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1c640678c0 0x7f1c64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f1c757fa640 1 -- 172.21.15.43:0/759349893 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1c70120860 con 0x7f1c780ae0d0 2024-04-24T23:00:36.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f1c757fa640 1 --2- 172.21.15.43:0/759349893 >> [v2:172.21.15.162:6802/2526900120,v1:172.21.15.162:6804/2526900120] conn(0x7f1c64070fb0 0x7f1c640733f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f1c7cbfd640 1 --2- 172.21.15.43:0/759349893 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1c640678c0 0x7f1c64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f1c757fa640 1 -- 172.21.15.43:0/759349893 --> [v2:172.21.15.162:6802/2526900120,v1:172.21.15.162:6804/2526900120] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c64073ac0 con 0x7f1c64070fb0 2024-04-24T23:00:36.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f1c757fa640 1 -- 172.21.15.43:0/759349893 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1c70120c50 con 0x7f1c780ae0d0 2024-04-24T23:00:36.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f75b97fa640 1 -- 172.21.15.43:0/1956707443 <== osd.2 v2:172.21.15.43:6816/1769132304 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f75ac016e50 con 0x7f75a8070ff0 2024-04-24T23:00:36.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f6126ffd640 1 -- 172.21.15.43:0/3119556994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61281d3830 msgr2=0x7f61281e4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f6126ffd640 1 --2- 172.21.15.43:0/3119556994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61281d3830 0x7f61281e4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f6126ffd640 1 -- 172.21.15.43:0/3119556994 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f612806e1c0 msgr2=0x7f6128145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f6126ffd640 1 --2- 172.21.15.43:0/3119556994 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f612806e1c0 0x7f6128145fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f6126ffd640 1 -- 172.21.15.43:0/3119556994 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6128147180 con 0x7f612814b4d0 2024-04-24T23:00:36.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f1c7d3fe640 1 --2- 172.21.15.43:0/759349893 >> [v2:172.21.15.162:6802/2526900120,v1:172.21.15.162:6804/2526900120] conn(0x7f1c64070fb0 0x7f1c640733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f1c7cbfd640 1 --2- 172.21.15.43:0/759349893 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1c640678c0 0x7f1c64069d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c006aa0 tx=0x7f1c6c00f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7fa19ed2b640 1 -- 172.21.15.43:0/3107556169 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1980b2d80 con 0x7fa19806d190 2024-04-24T23:00:36.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7fa19ed2b640 1 -- 172.21.15.43:0/3107556169 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa198070c00 con 0x7fa19806d190 2024-04-24T23:00:36.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f6126ffd640 1 --2- 172.21.15.43:0/3119556994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f612814b4d0 0x7f61281d32f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f611c00faa0 tx=0x7f611c00ff60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f3b88ff9640 1 -- 172.21.15.43:0/1098442975 <== osd.0 v2:172.21.15.43:6800/4282580106 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b7c01ee50 con 0x7f3b78071080 2024-04-24T23:00:36.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f610ffff640 1 -- 172.21.15.43:0/3119556994 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c01a070 con 0x7f612814b4d0 2024-04-24T23:00:36.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f1c7d3fe640 1 --2- 172.21.15.43:0/759349893 >> [v2:172.21.15.162:6802/2526900120,v1:172.21.15.162:6804/2526900120] conn(0x7f1c64070fb0 0x7f1c640733f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f610ffff640 1 -- 172.21.15.43:0/3119556994 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f611c0084a0 con 0x7f612814b4d0 2024-04-24T23:00:36.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f610ffff640 1 -- 172.21.15.43:0/3119556994 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c00da30 con 0x7f612814b4d0 2024-04-24T23:00:36.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f612e1ee640 1 -- 172.21.15.43:0/3119556994 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61281d2b30 con 0x7f612814b4d0 2024-04-24T23:00:36.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f612e1ee640 1 -- 172.21.15.43:0/3119556994 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f612809b150 con 0x7f612814b4d0 2024-04-24T23:00:36.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f53167fc640 1 -- 172.21.15.43:0/1974249142 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f531c01a070 con 0x7f53200aece0 2024-04-24T23:00:36.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f612e1ee640 1 -- 172.21.15.43:0/3119556994 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f612804f510 con 0x7f612814b4d0 2024-04-24T23:00:36.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f53167fc640 1 --2- 172.21.15.43:0/1974249142 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f53040678f0 0x7f5304069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f53167fc640 1 -- 172.21.15.43:0/1974249142 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f531c085a10 con 0x7f53200aece0 2024-04-24T23:00:36.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f53167fc640 1 --2- 172.21.15.43:0/1974249142 >> [v2:172.21.15.43:6808/3690422661,v1:172.21.15.43:6809/3690422661] conn(0x7f5304071060 0x7f53040734a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f53167fc640 1 -- 172.21.15.43:0/1974249142 --> [v2:172.21.15.43:6808/3690422661,v1:172.21.15.43:6809/3690422661] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5304073b70 con 0x7f5304071060 2024-04-24T23:00:36.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f53167fc640 1 -- 172.21.15.43:0/1974249142 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f531c085e00 con 0x7f53200aece0 2024-04-24T23:00:36.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f5325c7a640 1 --2- 172.21.15.43:0/1974249142 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f53040678f0 0x7f5304069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f5325479640 1 --2- 172.21.15.43:0/1974249142 >> [v2:172.21.15.43:6808/3690422661,v1:172.21.15.43:6809/3690422661] conn(0x7f5304071060 0x7f53040734a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7f5325c7a640 1 --2- 172.21.15.43:0/1974249142 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f53040678f0 0x7f5304069db0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f53180ae000 tx=0x7f5318004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.163+0000 7fa19ed2b640 1 -- 172.21.15.43:0/3107556169 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1980b2fc0 con 0x7fa19806d190 2024-04-24T23:00:36.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.167+0000 7f5325479640 1 --2- 172.21.15.43:0/1974249142 >> [v2:172.21.15.43:6808/3690422661,v1:172.21.15.43:6809/3690422661] conn(0x7f5304071060 0x7f53040734a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.167+0000 7f1c757fa640 1 -- 172.21.15.43:0/759349893 <== osd.7 v2:172.21.15.162:6802/2526900120 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c64073ac0 con 0x7f1c64070fb0 2024-04-24T23:00:36.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.167+0000 7fa1957fa640 1 -- 172.21.15.43:0/3107556169 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa19001e070 con 0x7fa19806d190 2024-04-24T23:00:36.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.167+0000 7fa1957fa640 1 --2- 172.21.15.43:0/3107556169 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa184067990 0x7fa184069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.167+0000 7fa1957fa640 1 -- 172.21.15.43:0/3107556169 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa190086680 con 0x7fa19806d190 2024-04-24T23:00:36.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.167+0000 7f53167fc640 1 -- 172.21.15.43:0/1974249142 <== osd.1 v2:172.21.15.43:6808/3690422661 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5304073b70 con 0x7f5304071060 2024-04-24T23:00:36.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.167+0000 7fa1957fa640 1 --2- 172.21.15.43:0/3107556169 >> [v2:172.21.15.43:6818/451290605,v1:172.21.15.43:6821/451290605] conn(0x7fa184071110 0x7fa184073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.167+0000 7fa1957fa640 1 -- 172.21.15.43:0/3107556169 --> [v2:172.21.15.43:6818/451290605,v1:172.21.15.43:6821/451290605] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa19000ff80 con 0x7fa184071110 2024-04-24T23:00:36.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.167+0000 7fa1957fa640 1 -- 172.21.15.43:0/3107556169 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa190086a70 con 0x7fa19806d190 2024-04-24T23:00:36.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.167+0000 7fa19d2c8640 1 --2- 172.21.15.43:0/3107556169 >> [v2:172.21.15.43:6818/451290605,v1:172.21.15.43:6821/451290605] conn(0x7fa184071110 0x7fa184073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.167+0000 7fa19d2c8640 1 --2- 172.21.15.43:0/3107556169 >> [v2:172.21.15.43:6818/451290605,v1:172.21.15.43:6821/451290605] conn(0x7fa184071110 0x7fa184073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.167+0000 7fa1957fa640 1 -- 172.21.15.43:0/3107556169 <== osd.3 v2:172.21.15.43:6818/451290605 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa19000ff80 con 0x7fa184071110 2024-04-24T23:00:36.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.175+0000 7f610ffff640 1 -- 172.21.15.43:0/3119556994 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f611c01d070 con 0x7f612814b4d0 2024-04-24T23:00:36.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.175+0000 7f610ffff640 1 --2- 172.21.15.43:0/3119556994 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f61140678c0 0x7f6114069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.175+0000 7f610ffff640 1 -- 172.21.15.43:0/3119556994 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f611c088f90 con 0x7f612814b4d0 2024-04-24T23:00:36.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.175+0000 7f610ffff640 1 --2- 172.21.15.43:0/3119556994 >> [v2:172.21.15.162:6800/2854620223,v1:172.21.15.162:6801/2854620223] conn(0x7f6114071040 0x7f6114073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.175+0000 7f610ffff640 1 -- 172.21.15.43:0/3119556994 --> [v2:172.21.15.162:6800/2854620223,v1:172.21.15.162:6801/2854620223] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6114073b50 con 0x7f6114071040 2024-04-24T23:00:36.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.175+0000 7f610ffff640 1 -- 172.21.15.43:0/3119556994 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f611c089380 con 0x7f612814b4d0 2024-04-24T23:00:36.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.175+0000 7fa197fff640 1 --2- 172.21.15.43:0/3107556169 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa184067990 0x7fa184069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.175+0000 7f6127fff640 1 --2- 172.21.15.43:0/3119556994 >> [v2:172.21.15.162:6800/2854620223,v1:172.21.15.162:6801/2854620223] conn(0x7f6114071040 0x7f6114073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.175+0000 7f61277fe640 1 --2- 172.21.15.43:0/3119556994 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f61140678c0 0x7f6114069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.175+0000 7f6127fff640 1 --2- 172.21.15.43:0/3119556994 >> [v2:172.21.15.162:6800/2854620223,v1:172.21.15.162:6801/2854620223] conn(0x7f6114071040 0x7f6114073480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.175+0000 7fa197fff640 1 --2- 172.21.15.43:0/3107556169 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa184067990 0x7fa184069e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa1980b5040 tx=0x7fa18c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.175+0000 7f61277fe640 1 --2- 172.21.15.43:0/3119556994 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f61140678c0 0x7f6114069d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f61180ad000 tx=0x7f6118008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.179+0000 7f610ffff640 1 -- 172.21.15.43:0/3119556994 <== osd.4 v2:172.21.15.162:6800/2854620223 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6114073b50 con 0x7f6114071040 2024-04-24T23:00:36.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.183+0000 7fa19ed2b640 1 -- 172.21.15.43:0/3107556169 --> [v2:172.21.15.43:6818/451290605,v1:172.21.15.43:6821/451290605] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa19804f510 con 0x7fa184071110 2024-04-24T23:00:36.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.183+0000 7fa1957fa640 1 -- 172.21.15.43:0/3107556169 <== osd.3 v2:172.21.15.43:6818/451290605 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa19804f510 con 0x7fa184071110 2024-04-24T23:00:36.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.183+0000 7fa6e4d36640 1 Processor -- start 2024-04-24T23:00:36.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.183+0000 7fa6e4d36640 1 -- start start 2024-04-24T23:00:36.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.187+0000 7fa6e4d36640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa6e006cb30 0x7fa6e014c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.187+0000 7fa6e4d36640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6e00b28f0 con 0x7fa6e00b3590 2024-04-24T23:00:36.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.187+0000 7fa6e4d36640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6e006cf10 con 0x7fa6e00afa80 2024-04-24T23:00:36.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.187+0000 7fa6e4d36640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa6e00b1bd0 con 0x7fa6e006cb30 2024-04-24T23:00:36.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.187+0000 7fa6ddd9b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa6e00b3590 0x7fa6e00b3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54534/0 (socket says 172.21.15.43:54534) 2024-04-24T23:00:36.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.187+0000 7fa6ddd9b640 1 -- 172.21.15.43:0/3048055905 learned_addr learned my addr 172.21.15.43:0/3048055905 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:36.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.187+0000 7fa6de59c640 1 --2- 172.21.15.43:0/3048055905 >> v2:172.21.15.43:3300/0 conn(0x7fa6e006cb30 0x7fa6e014c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.187+0000 7fa6de59c640 1 -- 172.21.15.43:0/3048055905 >> v1:172.21.15.162:6789/0 conn(0x7fa6e00afa80 legacy=0x7fa6e0156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.187+0000 7fa6de59c640 1 -- 172.21.15.43:0/3048055905 >> v1:172.21.15.43:6789/0 conn(0x7fa6e00b3590 legacy=0x7fa6e00b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.187+0000 7fa6de59c640 1 -- 172.21.15.43:0/3048055905 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e014c990 con 0x7fa6e006cb30 2024-04-24T23:00:36.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.187+0000 7fa6de59c640 1 --2- 172.21.15.43:0/3048055905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6e006cb30 0x7fa6e014c450 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00097c0 tx=0x7fa6d001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8817cbb384201387 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.187+0000 7fa6dd59a640 1 -- 172.21.15.43:0/3048055905 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00b0070 con 0x7fa6e006cb30 2024-04-24T23:00:36.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.187+0000 7fa6dd59a640 1 -- 172.21.15.43:0/3048055905 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6d00ab600 con 0x7fa6e006cb30 2024-04-24T23:00:36.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7fa6e4d36640 1 -- 172.21.15.43:0/3048055905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6e006cb30 msgr2=0x7fa6e014c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7fa6e4d36640 1 --2- 172.21.15.43:0/3048055905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6e006cb30 0x7fa6e014c450 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00097c0 tx=0x7fa6d001c410 comp rx=0 tx=0).stop 2024-04-24T23:00:36.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7fa6e4d36640 1 -- 172.21.15.43:0/3048055905 shutdown_connections 2024-04-24T23:00:36.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7fa6e4d36640 1 --2- 172.21.15.43:0/3048055905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6e006cb30 0x7fa6e014c450 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00097c0 tx=0x7fa6d001c410 comp rx=0 tx=0).stop 2024-04-24T23:00:36.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7fa6e4d36640 1 -- 172.21.15.43:0/3048055905 >> 172.21.15.43:0/3048055905 conn(0x7fa6e00b8d60 msgr2=0x7fa6e00b9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7fa6e4d36640 1 -- 172.21.15.43:0/3048055905 shutdown_connections 2024-04-24T23:00:36.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f990d3a2640 1 -- 172.21.15.43:0/1992305963 --> [v2:172.21.15.162:6824/4054273326,v1:172.21.15.162:6825/4054273326] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9908121540 con 0x7f990806fd50 2024-04-24T23:00:36.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f98ef7fe640 1 -- 172.21.15.43:0/1992305963 <== osd.6 v2:172.21.15.162:6824/4054273326 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9908121540 con 0x7f990806fd50 2024-04-24T23:00:36.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f3b924a8640 1 -- 172.21.15.43:0/1098442975 --> [v2:172.21.15.43:6800/4282580106,v1:172.21.15.43:6801/4282580106] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b6c002de0 con 0x7f3b78071080 2024-04-24T23:00:36.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f990d3a2640 1 -- 172.21.15.43:0/1992305963 >> [v2:172.21.15.162:6824/4054273326,v1:172.21.15.162:6825/4054273326] conn(0x7f990806fd50 msgr2=0x7f99080b7f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f990d3a2640 1 --2- 172.21.15.43:0/1992305963 >> [v2:172.21.15.162:6824/4054273326,v1:172.21.15.162:6825/4054273326] conn(0x7f990806fd50 0x7f99080b7f40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f990d3a2640 1 -- 172.21.15.43:0/1992305963 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98f4067910 msgr2=0x7f98f4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f990d3a2640 1 --2- 172.21.15.43:0/1992305963 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98f4067910 0x7f98f4069dd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f99000ae000 tx=0x7f99000a7070 comp rx=0 tx=0).stop 2024-04-24T23:00:36.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f990d3a2640 1 -- 172.21.15.43:0/1992305963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f990806d5e0 msgr2=0x7f9908120d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f990d3a2640 1 --2- 172.21.15.43:0/1992305963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f990806d5e0 0x7f9908120d50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c500 tx=0x7f98f800c9c0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f99077fe640 1 -- 172.21.15.43:0/1992305963 reap_dead start 2024-04-24T23:00:36.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f990d3a2640 1 -- 172.21.15.43:0/1992305963 shutdown_connections 2024-04-24T23:00:36.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f990d3a2640 1 -- 172.21.15.43:0/1992305963 >> 172.21.15.43:0/1992305963 conn(0x7f99080b8d40 msgr2=0x7f990806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f990d3a2640 1 -- 172.21.15.43:0/1992305963 shutdown_connections 2024-04-24T23:00:36.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f990d3a2640 1 -- 172.21.15.43:0/1992305963 wait complete. 2024-04-24T23:00:36.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f3b88ff9640 1 -- 172.21.15.43:0/1098442975 <== osd.0 v2:172.21.15.43:6800/4282580106 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3b6c002de0 con 0x7f3b78071080 2024-04-24T23:00:36.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f75c2fe5640 1 -- 172.21.15.43:0/1956707443 --> [v2:172.21.15.43:6816/1769132304,v1:172.21.15.43:6817/1769132304] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f75bc13eca0 con 0x7f75a8070ff0 2024-04-24T23:00:36.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7fa6e4d36640 1 -- 172.21.15.43:0/3048055905 wait complete. 2024-04-24T23:00:36.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7fa6e4d36640 1 Processor -- start 2024-04-24T23:00:36.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7f75b97fa640 1 -- 172.21.15.43:0/1956707443 <== osd.2 v2:172.21.15.43:6816/1769132304 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f75bc13eca0 con 0x7f75a8070ff0 2024-04-24T23:00:36.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7fa17effd640 1 -- 172.21.15.43:0/3107556169 >> [v2:172.21.15.43:6818/451290605,v1:172.21.15.43:6821/451290605] conn(0x7fa184071110 msgr2=0x7fa184073550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7fa17effd640 1 --2- 172.21.15.43:0/3107556169 >> [v2:172.21.15.43:6818/451290605,v1:172.21.15.43:6821/451290605] conn(0x7fa184071110 0x7fa184073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa17effd640 1 -- 172.21.15.43:0/3107556169 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa184067990 msgr2=0x7fa184069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa17effd640 1 --2- 172.21.15.43:0/3107556169 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa184067990 0x7fa184069e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa1980b5040 tx=0x7fa18c008040 comp rx=0 tx=0).stop 2024-04-24T23:00:36.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa17effd640 1 -- 172.21.15.43:0/3107556169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa19806d190 msgr2=0x7fa1981e8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa17effd640 1 --2- 172.21.15.43:0/3107556169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa19806d190 0x7fa1981e8610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa190008c00 tx=0x7fa190010500 comp rx=0 tx=0).stop 2024-04-24T23:00:36.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa19d2c8640 1 -- 172.21.15.43:0/3107556169 reap_dead start 2024-04-24T23:00:36.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.191+0000 7fa6e4d36640 1 -- start start 2024-04-24T23:00:36.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f3b727fc640 1 -- 172.21.15.43:0/1098442975 >> [v2:172.21.15.43:6800/4282580106,v1:172.21.15.43:6801/4282580106] conn(0x7f3b78071080 msgr2=0x7f3b780734c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f3b727fc640 1 --2- 172.21.15.43:0/1098442975 >> [v2:172.21.15.43:6800/4282580106,v1:172.21.15.43:6801/4282580106] conn(0x7f3b78071080 0x7f3b780734c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa17effd640 1 -- 172.21.15.43:0/3107556169 shutdown_connections 2024-04-24T23:00:36.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f3b727fc640 1 -- 172.21.15.43:0/1098442975 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3b78067990 msgr2=0x7f3b78069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f3b727fc640 1 --2- 172.21.15.43:0/1098442975 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3b78067990 0x7f3b78069e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3b840af000 tx=0x7f3b840a7070 comp rx=0 tx=0).stop 2024-04-24T23:00:36.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f3b727fc640 1 -- 172.21.15.43:0/1098442975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c14aa30 msgr2=0x7f3b8c13c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f3b727fc640 1 --2- 172.21.15.43:0/1098442975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c14aa30 0x7f3b8c13c120 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00c400 tx=0x7f3b7c00c8c0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa17effd640 1 -- 172.21.15.43:0/3107556169 >> 172.21.15.43:0/3107556169 conn(0x7fa1980b5670 msgr2=0x7fa198141830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f3b90a45640 1 -- 172.21.15.43:0/1098442975 reap_dead start 2024-04-24T23:00:36.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f3b727fc640 1 -- 172.21.15.43:0/1098442975 shutdown_connections 2024-04-24T23:00:36.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f3b727fc640 1 -- 172.21.15.43:0/1098442975 >> 172.21.15.43:0/1098442975 conn(0x7f3b8c072d20 msgr2=0x7f3b8c149e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f3b727fc640 1 -- 172.21.15.43:0/1098442975 shutdown_connections 2024-04-24T23:00:36.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f3b727fc640 1 -- 172.21.15.43:0/1098442975 wait complete. 2024-04-24T23:00:36.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa6e4d36640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e00afa80 0x7fa6e0072690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa6e4d36640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e00b3590 0x7fa6e006fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa6e4d36640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6e0070330 0x7fa6e0137b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa6e4d36640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e00b2e90 con 0x7fa6e0070330 2024-04-24T23:00:36.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa6e4d36640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e00b2d10 con 0x7fa6e00b3590 2024-04-24T23:00:36.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa6e4d36640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa6e0120f80 con 0x7fa6e00afa80 2024-04-24T23:00:36.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa6ddd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e00b3590 0x7fa6e006fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa6ddd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e00b3590 0x7fa6e006fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.43:45752/0 (socket says 172.21.15.43:45752) 2024-04-24T23:00:36.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa6ddd9b640 1 -- 172.21.15.43:0/4078463638 learned_addr learned my addr 172.21.15.43:0/4078463638 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa6ded9d640 1 --2- 172.21.15.43:0/4078463638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6e0070330 0x7fa6e0137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f5327ede640 1 -- 172.21.15.43:0/1974249142 --> [v2:172.21.15.43:6808/3690422661,v1:172.21.15.43:6809/3690422661] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f53201246e0 con 0x7f5304071060 2024-04-24T23:00:36.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa6ddd9b640 1 -- 172.21.15.43:0/4078463638 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e00afa80 msgr2=0x7fa6e0072690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-24T23:00:36.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa6ddd9b640 1 --2- 172.21.15.43:0/4078463638 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e00afa80 0x7fa6e0072690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa6ddd9b640 1 -- 172.21.15.43:0/4078463638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6e0070330 msgr2=0x7fa6e0137b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa6ddd9b640 1 --2- 172.21.15.43:0/4078463638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6e0070330 0x7fa6e0137b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7fa6ddd9b640 1 -- 172.21.15.43:0/4078463638 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e00aa240 con 0x7fa6e00b3590 2024-04-24T23:00:36.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f53167fc640 1 -- 172.21.15.43:0/1974249142 <== osd.1 v2:172.21.15.43:6808/3690422661 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f53201246e0 con 0x7f5304071060 2024-04-24T23:00:36.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f1c7ee61640 1 -- 172.21.15.43:0/759349893 --> [v2:172.21.15.162:6802/2526900120,v1:172.21.15.162:6804/2526900120] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1c780b0b80 con 0x7f1c64070fb0 2024-04-24T23:00:36.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f5303fff640 1 -- 172.21.15.43:0/1974249142 >> [v2:172.21.15.43:6808/3690422661,v1:172.21.15.43:6809/3690422661] conn(0x7f5304071060 msgr2=0x7f53040734a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f5303fff640 1 --2- 172.21.15.43:0/1974249142 >> [v2:172.21.15.43:6808/3690422661,v1:172.21.15.43:6809/3690422661] conn(0x7f5304071060 0x7f53040734a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f75a2ffd640 1 -- 172.21.15.43:0/1956707443 >> [v2:172.21.15.43:6816/1769132304,v1:172.21.15.43:6817/1769132304] conn(0x7f75a8070ff0 msgr2=0x7f75a8073430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f75a2ffd640 1 --2- 172.21.15.43:0/1956707443 >> [v2:172.21.15.43:6816/1769132304,v1:172.21.15.43:6817/1769132304] conn(0x7f75a8070ff0 0x7f75a8073430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f5303fff640 1 -- 172.21.15.43:0/1974249142 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f53040678f0 msgr2=0x7f5304069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f5303fff640 1 --2- 172.21.15.43:0/1974249142 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f53040678f0 0x7f5304069db0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f53180ae000 tx=0x7f5318004ac0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f5303fff640 1 -- 172.21.15.43:0/1974249142 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53200aece0 msgr2=0x7f5320123f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f5303fff640 1 --2- 172.21.15.43:0/1974249142 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53200aece0 0x7f5320123f50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f531c00c440 tx=0x7f531c00c900 comp rx=0 tx=0).stop 2024-04-24T23:00:36.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f532647b640 1 -- 172.21.15.43:0/1974249142 reap_dead start 2024-04-24T23:00:36.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f5303fff640 1 -- 172.21.15.43:0/1974249142 shutdown_connections 2024-04-24T23:00:36.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f5303fff640 1 -- 172.21.15.43:0/1974249142 >> 172.21.15.43:0/1974249142 conn(0x7f53200b8d40 msgr2=0x7f53200b7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f5303fff640 1 -- 172.21.15.43:0/1974249142 shutdown_connections 2024-04-24T23:00:36.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f5303fff640 1 -- 172.21.15.43:0/1974249142 wait complete. 2024-04-24T23:00:36.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f1c757fa640 1 -- 172.21.15.43:0/759349893 <== osd.7 v2:172.21.15.162:6802/2526900120 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1c780b0b80 con 0x7f1c64070fb0 2024-04-24T23:00:36.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f75a2ffd640 1 -- 172.21.15.43:0/1956707443 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f75a80678f0 msgr2=0x7f75a8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f75a2ffd640 1 --2- 172.21.15.43:0/1956707443 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f75a80678f0 0x7f75a8069db0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f75b40ae000 tx=0x7f75b40a7070 comp rx=0 tx=0).stop 2024-04-24T23:00:36.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f75a2ffd640 1 -- 172.21.15.43:0/1956707443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75bc146500 msgr2=0x7f75bc06fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f75a2ffd640 1 --2- 172.21.15.43:0/1956707443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75bc146500 0x7f75bc06fc20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00f900 tx=0x7f75ac00fdc0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f75c1582640 1 -- 172.21.15.43:0/1956707443 reap_dead start 2024-04-24T23:00:36.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f75a2ffd640 1 -- 172.21.15.43:0/1956707443 shutdown_connections 2024-04-24T23:00:36.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f75a2ffd640 1 -- 172.21.15.43:0/1956707443 >> 172.21.15.43:0/1956707443 conn(0x7f75bc0b5670 msgr2=0x7f75bc09b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f75a2ffd640 1 -- 172.21.15.43:0/1956707443 shutdown_connections 2024-04-24T23:00:36.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f75a2ffd640 1 -- 172.21.15.43:0/1956707443 wait complete. 2024-04-24T23:00:36.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f1c7ee61640 1 -- 172.21.15.43:0/759349893 >> [v2:172.21.15.162:6802/2526900120,v1:172.21.15.162:6804/2526900120] conn(0x7f1c64070fb0 msgr2=0x7f1c640733f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.195+0000 7f1c7ee61640 1 --2- 172.21.15.43:0/759349893 >> [v2:172.21.15.162:6802/2526900120,v1:172.21.15.162:6804/2526900120] conn(0x7f1c64070fb0 0x7f1c640733f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.199+0000 7fa17effd640 1 -- 172.21.15.43:0/3107556169 shutdown_connections 2024-04-24T23:00:36.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.199+0000 7fa17effd640 1 -- 172.21.15.43:0/3107556169 wait complete. 2024-04-24T23:00:36.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.199+0000 7fa6ddd9b640 1 --2- 172.21.15.43:0/4078463638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e00b3590 0x7fa6e006fdf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6d400c340 tx=0x7fa6d400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.199+0000 7fa6ceffd640 1 -- 172.21.15.43:0/4078463638 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4017070 con 0x7fa6e00b3590 2024-04-24T23:00:36.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.199+0000 7fa6ceffd640 1 -- 172.21.15.43:0/4078463638 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6d4005cf0 con 0x7fa6e00b3590 2024-04-24T23:00:36.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.199+0000 7fa6e4d36640 1 -- 172.21.15.43:0/4078463638 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e0149100 con 0x7fa6e00b3590 2024-04-24T23:00:36.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.199+0000 7fa6e4d36640 1 -- 172.21.15.43:0/4078463638 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e006f8d0 con 0x7fa6e00b3590 2024-04-24T23:00:36.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.199+0000 7fa6ceffd640 1 -- 172.21.15.43:0/4078463638 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40072f0 con 0x7fa6e00b3590 2024-04-24T23:00:36.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.199+0000 7fa6e4d36640 1 -- 172.21.15.43:0/4078463638 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa6e004f580 con 0x7fa6e00b3590 2024-04-24T23:00:36.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.203+0000 7f1c7ee61640 1 -- 172.21.15.43:0/759349893 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1c640678c0 msgr2=0x7f1c64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.203+0000 7f1c7ee61640 1 --2- 172.21.15.43:0/759349893 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1c640678c0 0x7f1c64069d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c006aa0 tx=0x7f1c6c00f040 comp rx=0 tx=0).stop 2024-04-24T23:00:36.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.203+0000 7f1c7ee61640 1 -- 172.21.15.43:0/759349893 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c780ae0d0 msgr2=0x7f1c7806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.203+0000 7f1c7ee61640 1 --2- 172.21.15.43:0/759349893 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c780ae0d0 0x7f1c7806faa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1c700b0000 tx=0x7f1c7001df20 comp rx=0 tx=0).stop 2024-04-24T23:00:36.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.203+0000 7fa6ceffd640 1 -- 172.21.15.43:0/4078463638 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa6d401a070 con 0x7fa6e00b3590 2024-04-24T23:00:36.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.203+0000 7fa6ceffd640 1 --2- 172.21.15.43:0/4078463638 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa6c00678c0 0x7fa6c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.203+0000 7fa6ceffd640 1 -- 172.21.15.43:0/4078463638 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa6d4085950 con 0x7fa6e00b3590 2024-04-24T23:00:36.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.203+0000 7fa6ceffd640 1 --2- 172.21.15.43:0/4078463638 >> [v2:172.21.15.162:6806/4243337477,v1:172.21.15.162:6809/4243337477] conn(0x7fa6c0070fb0 0x7fa6c00733f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.203+0000 7fa6ceffd640 1 -- 172.21.15.43:0/4078463638 --> [v2:172.21.15.162:6806/4243337477,v1:172.21.15.162:6809/4243337477] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa6c0073ac0 con 0x7fa6c0070fb0 2024-04-24T23:00:36.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.203+0000 7fa6ceffd640 1 -- 172.21.15.43:0/4078463638 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa6d4085de0 con 0x7fa6e00b3590 2024-04-24T23:00:36.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.203+0000 7f1c7d3fe640 1 -- 172.21.15.43:0/759349893 reap_dead start 2024-04-24T23:00:36.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.203+0000 7fa6de59c640 1 --2- 172.21.15.43:0/4078463638 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa6c00678c0 0x7fa6c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.203+0000 7fa6ded9d640 1 --2- 172.21.15.43:0/4078463638 >> [v2:172.21.15.162:6806/4243337477,v1:172.21.15.162:6809/4243337477] conn(0x7fa6c0070fb0 0x7fa6c00733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.203+0000 7fa6de59c640 1 --2- 172.21.15.43:0/4078463638 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa6c00678c0 0x7fa6c0069d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00ad000 tx=0x7fa6d00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.203+0000 7fa6ded9d640 1 --2- 172.21.15.43:0/4078463638 >> [v2:172.21.15.162:6806/4243337477,v1:172.21.15.162:6809/4243337477] conn(0x7fa6c0070fb0 0x7fa6c00733f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.207+0000 7fa6ceffd640 1 -- 172.21.15.43:0/4078463638 <== osd.5 v2:172.21.15.162:6806/4243337477 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa6c0073ac0 con 0x7fa6c0070fb0 2024-04-24T23:00:36.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.207+0000 7f612e1ee640 1 -- 172.21.15.43:0/3119556994 --> [v2:172.21.15.162:6800/2854620223,v1:172.21.15.162:6801/2854620223] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f61281d2fa0 con 0x7f6114071040 2024-04-24T23:00:36.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.207+0000 7f1c7ee61640 1 -- 172.21.15.43:0/759349893 shutdown_connections 2024-04-24T23:00:36.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.207+0000 7f1c7ee61640 1 -- 172.21.15.43:0/759349893 >> 172.21.15.43:0/759349893 conn(0x7f1c780b5670 msgr2=0x7f1c780b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.207+0000 7f1c7ee61640 1 -- 172.21.15.43:0/759349893 shutdown_connections 2024-04-24T23:00:36.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.207+0000 7f1c7ee61640 1 -- 172.21.15.43:0/759349893 wait complete. 2024-04-24T23:00:36.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.207+0000 7f610ffff640 1 -- 172.21.15.43:0/3119556994 <== osd.4 v2:172.21.15.162:6800/2854620223 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f61281d2fa0 con 0x7f6114071040 2024-04-24T23:00:36.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.211+0000 7f612e1ee640 1 -- 172.21.15.43:0/3119556994 >> [v2:172.21.15.162:6800/2854620223,v1:172.21.15.162:6801/2854620223] conn(0x7f6114071040 msgr2=0x7f6114073480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.211+0000 7f612e1ee640 1 --2- 172.21.15.43:0/3119556994 >> [v2:172.21.15.162:6800/2854620223,v1:172.21.15.162:6801/2854620223] conn(0x7f6114071040 0x7f6114073480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.211+0000 7f612e1ee640 1 -- 172.21.15.43:0/3119556994 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f61140678c0 msgr2=0x7f6114069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.211+0000 7f612e1ee640 1 --2- 172.21.15.43:0/3119556994 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f61140678c0 0x7f6114069d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f61180ad000 tx=0x7f6118008040 comp rx=0 tx=0).stop 2024-04-24T23:00:36.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.211+0000 7f612e1ee640 1 -- 172.21.15.43:0/3119556994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f612814b4d0 msgr2=0x7f61281d32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.211+0000 7f612e1ee640 1 --2- 172.21.15.43:0/3119556994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f612814b4d0 0x7f61281d32f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f611c00faa0 tx=0x7f611c00ff60 comp rx=0 tx=0).stop 2024-04-24T23:00:36.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.211+0000 7f6127fff640 1 -- 172.21.15.43:0/3119556994 reap_dead start 2024-04-24T23:00:36.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.211+0000 7f612e1ee640 1 -- 172.21.15.43:0/3119556994 shutdown_connections 2024-04-24T23:00:36.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.211+0000 7f612e1ee640 1 -- 172.21.15.43:0/3119556994 >> 172.21.15.43:0/3119556994 conn(0x7f61280b5670 msgr2=0x7f612814a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.211+0000 7f612e1ee640 1 -- 172.21.15.43:0/3119556994 shutdown_connections 2024-04-24T23:00:36.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.211+0000 7f612e1ee640 1 -- 172.21.15.43:0/3119556994 wait complete. 2024-04-24T23:00:36.248 INFO:teuthology.orchestra.run.smithi043.stdout:60129542153 2024-04-24T23:00:36.248 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-24T23:00:36.249 INFO:teuthology.orchestra.run.smithi043.stdout:64424509448 2024-04-24T23:00:36.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T23:00:36.250 INFO:teuthology.orchestra.run.smithi043.stdout:64424509449 2024-04-24T23:00:36.250 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T23:00:36.251 INFO:teuthology.orchestra.run.smithi043.stdout:64424509449 2024-04-24T23:00:36.251 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T23:00:36.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.231+0000 7fa6e4d36640 1 -- 172.21.15.43:0/4078463638 --> [v2:172.21.15.162:6806/4243337477,v1:172.21.15.162:6809/4243337477] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa6e00aa4b0 con 0x7fa6c0070fb0 2024-04-24T23:00:36.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.235+0000 7fa6ceffd640 1 -- 172.21.15.43:0/4078463638 <== osd.5 v2:172.21.15.162:6806/4243337477 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa6e00aa4b0 con 0x7fa6c0070fb0 2024-04-24T23:00:36.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.235+0000 7fa6e4d36640 1 -- 172.21.15.43:0/4078463638 >> [v2:172.21.15.162:6806/4243337477,v1:172.21.15.162:6809/4243337477] conn(0x7fa6c0070fb0 msgr2=0x7fa6c00733f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.235+0000 7fa6e4d36640 1 --2- 172.21.15.43:0/4078463638 >> [v2:172.21.15.162:6806/4243337477,v1:172.21.15.162:6809/4243337477] conn(0x7fa6c0070fb0 0x7fa6c00733f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.235+0000 7fa6e4d36640 1 -- 172.21.15.43:0/4078463638 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa6c00678c0 msgr2=0x7fa6c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.235+0000 7fa6e4d36640 1 --2- 172.21.15.43:0/4078463638 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa6c00678c0 0x7fa6c0069d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00ad000 tx=0x7fa6d00a6000 comp rx=0 tx=0).stop 2024-04-24T23:00:36.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.235+0000 7fa6e4d36640 1 -- 172.21.15.43:0/4078463638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e00b3590 msgr2=0x7fa6e006fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.235+0000 7fa6e4d36640 1 --2- 172.21.15.43:0/4078463638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e00b3590 0x7fa6e006fdf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6d400c340 tx=0x7fa6d400c800 comp rx=0 tx=0).stop 2024-04-24T23:00:36.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.235+0000 7fa6ded9d640 1 -- 172.21.15.43:0/4078463638 reap_dead start 2024-04-24T23:00:36.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.235+0000 7fa6e4d36640 1 -- 172.21.15.43:0/4078463638 shutdown_connections 2024-04-24T23:00:36.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.235+0000 7fa6e4d36640 1 -- 172.21.15.43:0/4078463638 >> 172.21.15.43:0/4078463638 conn(0x7fa6e00b8d60 msgr2=0x7fa6e00b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.235+0000 7fa6e4d36640 1 -- 172.21.15.43:0/4078463638 shutdown_connections 2024-04-24T23:00:36.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.235+0000 7fa6e4d36640 1 -- 172.21.15.43:0/4078463638 wait complete. 2024-04-24T23:00:36.254 INFO:teuthology.orchestra.run.smithi043.stdout:64424509449 2024-04-24T23:00:36.254 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T23:00:36.255 INFO:teuthology.orchestra.run.smithi043.stdout:64424509448 2024-04-24T23:00:36.256 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-24T23:00:36.256 INFO:teuthology.orchestra.run.smithi043.stdout:64424509448 2024-04-24T23:00:36.257 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-24T23:00:36.258 INFO:teuthology.orchestra.run.smithi043.stdout:55834574857 2024-04-24T23:00:36.259 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-24T23:00:36.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f4245454640 1 Processor -- start 2024-04-24T23:00:36.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f4245454640 1 -- start start 2024-04-24T23:00:36.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f4245454640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f424006d360 0x7f4240145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f4245454640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4240146330 0x7f424014ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f4245454640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42400732e0 con 0x7f42400b47e0 2024-04-24T23:00:36.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f4245454640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f42400af7c0 con 0x7f424006d360 2024-04-24T23:00:36.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f4245454640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f42400b4bc0 con 0x7f4240146330 2024-04-24T23:00:36.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f423effd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f42400b47e0 0x7f424006cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54538/0 (socket says 172.21.15.43:54538) 2024-04-24T23:00:36.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f423effd640 1 -- 172.21.15.43:0/374168460 learned_addr learned my addr 172.21.15.43:0/374168460 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:36.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f423e7fc640 1 --2- 172.21.15.43:0/374168460 >> v2:172.21.15.162:3300/0 conn(0x7f424006d360 0x7f4240145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f423f7fe640 1 --2- 172.21.15.43:0/374168460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4240146330 0x7f424014ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f423dffb640 1 -- 172.21.15.43:0/374168460 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3108022759 0 0) 0x7f42400732e0 con 0x7f42400b47e0 2024-04-24T23:00:36.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f423dffb640 1 -- 172.21.15.43:0/374168460 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4228005740 con 0x7f42400b47e0 2024-04-24T23:00:36.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f423e7fc640 1 -- 172.21.15.43:0/374168460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4240146330 msgr2=0x7f424014ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f423e7fc640 1 --2- 172.21.15.43:0/374168460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4240146330 0x7f424014ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f423e7fc640 1 -- 172.21.15.43:0/374168460 >> v1:172.21.15.43:6789/0 conn(0x7f42400b47e0 legacy=0x7f424006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.395+0000 7f423e7fc640 1 -- 172.21.15.43:0/374168460 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f424006c750 con 0x7f424006d360 2024-04-24T23:00:36.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.399+0000 7f423e7fc640 1 --2- 172.21.15.43:0/374168460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f424006d360 0x7f4240145df0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4238009b10 tx=0x7f423801d660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc4ce3e846ddafa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.399+0000 7f423dffb640 1 -- 172.21.15.43:0/374168460 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42380b2070 con 0x7f424006d360 2024-04-24T23:00:36.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.399+0000 7f423dffb640 1 -- 172.21.15.43:0/374168460 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42380a5cf0 con 0x7f424006d360 2024-04-24T23:00:36.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.399+0000 7f423dffb640 1 -- 172.21.15.43:0/374168460 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42380ad660 con 0x7f424006d360 2024-04-24T23:00:36.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 -- 172.21.15.43:0/374168460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f424006d360 msgr2=0x7f4240145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 --2- 172.21.15.43:0/374168460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f424006d360 0x7f4240145df0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4238009b10 tx=0x7f423801d660 comp rx=0 tx=0).stop 2024-04-24T23:00:36.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 -- 172.21.15.43:0/374168460 shutdown_connections 2024-04-24T23:00:36.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 --2- 172.21.15.43:0/374168460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4240146330 0x7f424014ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 --2- 172.21.15.43:0/374168460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f424006d360 0x7f4240145df0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 -- 172.21.15.43:0/374168460 >> 172.21.15.43:0/374168460 conn(0x7f42400b5670 msgr2=0x7f42400b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 -- 172.21.15.43:0/374168460 shutdown_connections 2024-04-24T23:00:36.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 -- 172.21.15.43:0/374168460 wait complete. 2024-04-24T23:00:36.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 Processor -- start 2024-04-24T23:00:36.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 -- start start 2024-04-24T23:00:36.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424006d360 0x7f42400722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42400b47e0 0x7f42401452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4240146330 0x7f4240143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4240146740 con 0x7f424006d360 2024-04-24T23:00:36.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42400af440 con 0x7f42400b47e0 2024-04-24T23:00:36.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.403+0000 7f4245454640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4240150b20 con 0x7f4240146330 2024-04-24T23:00:36.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f423effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424006d360 0x7f42400722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f423effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424006d360 0x7f42400722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43000/0 (socket says 172.21.15.43:43000) 2024-04-24T23:00:36.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f423effd640 1 -- 172.21.15.43:0/2710787425 learned_addr learned my addr 172.21.15.43:0/2710787425 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f423f7fe640 1 --2- 172.21.15.43:0/2710787425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4240146330 0x7f4240143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f423effd640 1 -- 172.21.15.43:0/2710787425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4240146330 msgr2=0x7f4240143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f423effd640 1 --2- 172.21.15.43:0/2710787425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4240146330 0x7f4240143590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f423effd640 1 -- 172.21.15.43:0/2710787425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42400b47e0 msgr2=0x7f42401452d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f423effd640 1 --2- 172.21.15.43:0/2710787425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42400b47e0 0x7f42401452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f423effd640 1 -- 172.21.15.43:0/2710787425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4240145810 con 0x7f424006d360 2024-04-24T23:00:36.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f423effd640 1 --2- 172.21.15.43:0/2710787425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424006d360 0x7f42400722c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f423000c500 tx=0x7f423000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f42277fe640 1 -- 172.21.15.43:0/2710787425 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4230017070 con 0x7f424006d360 2024-04-24T23:00:36.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f4245454640 1 -- 172.21.15.43:0/2710787425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f424013fb90 con 0x7f424006d360 2024-04-24T23:00:36.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f4245454640 1 -- 172.21.15.43:0/2710787425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4240071b40 con 0x7f424006d360 2024-04-24T23:00:36.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f42277fe640 1 -- 172.21.15.43:0/2710787425 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4230005cf0 con 0x7f424006d360 2024-04-24T23:00:36.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f42277fe640 1 -- 172.21.15.43:0/2710787425 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42300072f0 con 0x7f424006d360 2024-04-24T23:00:36.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.407+0000 7f4245454640 1 -- 172.21.15.43:0/2710787425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42200052a0 con 0x7f424006d360 2024-04-24T23:00:36.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.411+0000 7f42277fe640 1 -- 172.21.15.43:0/2710787425 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f423001a070 con 0x7f424006d360 2024-04-24T23:00:36.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.411+0000 7f42277fe640 1 --2- 172.21.15.43:0/2710787425 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4228067e70 0x7f422806a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.411+0000 7f42277fe640 1 -- 172.21.15.43:0/2710787425 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4230085220 con 0x7f424006d360 2024-04-24T23:00:36.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.411+0000 7f423e7fc640 1 --2- 172.21.15.43:0/2710787425 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4228067e70 0x7f422806a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.411+0000 7f423e7fc640 1 --2- 172.21.15.43:0/2710787425 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4228067e70 0x7f422806a330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42380af000 tx=0x7f4238004a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.419+0000 7f42277fe640 1 -- 172.21.15.43:0/2710787425 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f4230055500 con 0x7f424006d360 2024-04-24T23:00:36.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.451+0000 7fe673b86640 1 Processor -- start 2024-04-24T23:00:36.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.451+0000 7fe673b86640 1 -- start start 2024-04-24T23:00:36.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.451+0000 7fe673b86640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe66c0b47e0 0x7fe66c06dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.451+0000 7fe673b86640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe66c0b2dc0 0x7fe66c08b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.451+0000 7fe673b86640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe66c0b5490 con 0x7fe66c06c5d0 2024-04-24T23:00:36.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.451+0000 7fe673b86640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fe66c06e530 con 0x7fe66c0b47e0 2024-04-24T23:00:36.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.451+0000 7fe673b86640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe66c06d7a0 con 0x7fe66c0b2dc0 2024-04-24T23:00:36.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.451+0000 7fe671922640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe66c0b47e0 0x7fe66c06dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.451+0000 7fe671922640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe66c0b47e0 0x7fe66c06dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43010/0 (socket says 172.21.15.43:43010) 2024-04-24T23:00:36.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.451+0000 7fe671922640 1 -- 172.21.15.43:0/1326986843 learned_addr learned my addr 172.21.15.43:0/1326986843 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.451+0000 7fe671121640 1 --2- 172.21.15.43:0/1326986843 >> v2:172.21.15.162:3300/0 conn(0x7fe66c0b2dc0 0x7fe66c08b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.451+0000 7fe671922640 1 -- 172.21.15.43:0/1326986843 >> v2:172.21.15.162:3300/0 conn(0x7fe66c0b2dc0 msgr2=0x7fe66c08b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.451+0000 7fe671922640 1 --2- 172.21.15.43:0/1326986843 >> v2:172.21.15.162:3300/0 conn(0x7fe66c0b2dc0 0x7fe66c08b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.451+0000 7fe671922640 1 -- 172.21.15.43:0/1326986843 >> v1:172.21.15.162:6789/0 conn(0x7fe66c06c5d0 legacy=0x7fe66c06ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.451+0000 7fe671922640 1 -- 172.21.15.43:0/1326986843 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66c0b4bc0 con 0x7fe66c0b47e0 2024-04-24T23:00:36.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.455+0000 7fe671922640 1 --2- 172.21.15.43:0/1326986843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe66c0b47e0 0x7fe66c06dff0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe66c06c0d0 tx=0x7fe65c01e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde243836bf74299 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.455+0000 7fe670920640 1 -- 172.21.15.43:0/1326986843 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c0ad070 con 0x7fe66c0b47e0 2024-04-24T23:00:36.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.455+0000 7fe670920640 1 -- 172.21.15.43:0/1326986843 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe65c0a7870 con 0x7fe66c0b47e0 2024-04-24T23:00:36.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.455+0000 7fe670920640 1 -- 172.21.15.43:0/1326986843 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c0ad070 con 0x7fe66c0b47e0 2024-04-24T23:00:36.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 -- 172.21.15.43:0/1326986843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe66c0b47e0 msgr2=0x7fe66c06dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 --2- 172.21.15.43:0/1326986843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe66c0b47e0 0x7fe66c06dff0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe66c06c0d0 tx=0x7fe65c01e9a0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 -- 172.21.15.43:0/1326986843 shutdown_connections 2024-04-24T23:00:36.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 --2- 172.21.15.43:0/1326986843 >> v2:172.21.15.162:3300/0 conn(0x7fe66c0b2dc0 0x7fe66c08b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 --2- 172.21.15.43:0/1326986843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe66c0b47e0 0x7fe66c06dff0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 -- 172.21.15.43:0/1326986843 >> 172.21.15.43:0/1326986843 conn(0x7fe66c0b5670 msgr2=0x7fe66c0b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 -- 172.21.15.43:0/1326986843 shutdown_connections 2024-04-24T23:00:36.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 -- 172.21.15.43:0/1326986843 wait complete. 2024-04-24T23:00:36.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 Processor -- start 2024-04-24T23:00:36.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 -- start start 2024-04-24T23:00:36.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe66c06c5d0 0x7fe66c15b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe66c0b2dc0 0x7fe66c09d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe66c0b47e0 0x7fe66c1f9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c0af6c0 con 0x7fe66c0b47e0 2024-04-24T23:00:36.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c0b5240 con 0x7fe66c0b2dc0 2024-04-24T23:00:36.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.459+0000 7fe673b86640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe66c0afb50 con 0x7fe66c06c5d0 2024-04-24T23:00:36.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe672123640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe66c0b47e0 0x7fe66c1f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe672123640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe66c0b47e0 0x7fe66c1f9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43014/0 (socket says 172.21.15.43:43014) 2024-04-24T23:00:36.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe672123640 1 -- 172.21.15.43:0/591757088 learned_addr learned my addr 172.21.15.43:0/591757088 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe671922640 1 --2- 172.21.15.43:0/591757088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe66c06c5d0 0x7fe66c15b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe671121640 1 --2- 172.21.15.43:0/591757088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe66c0b2dc0 0x7fe66c09d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe671121640 1 -- 172.21.15.43:0/591757088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe66c06c5d0 msgr2=0x7fe66c15b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe671121640 1 --2- 172.21.15.43:0/591757088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe66c06c5d0 0x7fe66c15b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe671121640 1 -- 172.21.15.43:0/591757088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe66c0b47e0 msgr2=0x7fe66c1f9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe671121640 1 --2- 172.21.15.43:0/591757088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe66c0b47e0 0x7fe66c1f9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe671121640 1 -- 172.21.15.43:0/591757088 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66c09c860 con 0x7fe66c0b2dc0 2024-04-24T23:00:36.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe671922640 1 --2- 172.21.15.43:0/591757088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe66c06c5d0 0x7fe66c15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:00:36.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe671121640 1 --2- 172.21.15.43:0/591757088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe66c0b2dc0 0x7fe66c09d690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe66800d5f0 tx=0x7fe66800dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe6627fc640 1 -- 172.21.15.43:0/591757088 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6680125f0 con 0x7fe66c0b2dc0 2024-04-24T23:00:36.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe673b86640 1 -- 172.21.15.43:0/591757088 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66c09dbd0 con 0x7fe66c0b2dc0 2024-04-24T23:00:36.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe673b86640 1 -- 172.21.15.43:0/591757088 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe66c09c350 con 0x7fe66c0b2dc0 2024-04-24T23:00:36.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe6627fc640 1 -- 172.21.15.43:0/591757088 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe668019070 con 0x7fe66c0b2dc0 2024-04-24T23:00:36.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.463+0000 7fe6627fc640 1 -- 172.21.15.43:0/591757088 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6680129b0 con 0x7fe66c0b2dc0 2024-04-24T23:00:36.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.467+0000 7fe673b86640 1 -- 172.21.15.43:0/591757088 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6540052a0 con 0x7fe66c0b2dc0 2024-04-24T23:00:36.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.467+0000 7fe6627fc640 1 -- 172.21.15.43:0/591757088 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe668012b50 con 0x7fe66c0b2dc0 2024-04-24T23:00:36.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.467+0000 7fe6627fc640 1 --2- 172.21.15.43:0/591757088 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe6500678c0 0x7fe650069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.467+0000 7fe6627fc640 1 -- 172.21.15.43:0/591757088 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe6680864c0 con 0x7fe66c0b2dc0 2024-04-24T23:00:36.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.467+0000 7fe671922640 1 --2- 172.21.15.43:0/591757088 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe6500678c0 0x7fe650069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.467+0000 7fe671922640 1 --2- 172.21.15.43:0/591757088 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe6500678c0 0x7fe650069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0b2000 tx=0x7fe65c00a040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a75bae640 1 Processor -- start 2024-04-24T23:00:36.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a75bae640 1 -- start start 2024-04-24T23:00:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f07cbc2a640 1 Processor -- start 2024-04-24T23:00:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a75bae640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3a700b5520 0x7f3a7014ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a75bae640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a70145c30 0x7f3a7014f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a75bae640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7006d6c0 con 0x7f3a7006e4c0 2024-04-24T23:00:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a75bae640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3a700b5900 con 0x7f3a700b5520 2024-04-24T23:00:36.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a75bae640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7006db00 con 0x7f3a70145c30 2024-04-24T23:00:36.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6ffff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3a7006e4c0 0x7f3a70145520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54540/0 (socket says 172.21.15.43:54540) 2024-04-24T23:00:36.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6ffff640 1 -- 172.21.15.43:0/2273170728 learned_addr learned my addr 172.21.15.43:0/2273170728 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:36.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f07cbc2a640 1 -- start start 2024-04-24T23:00:36.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a753ad640 1 --2- 172.21.15.43:0/2273170728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a70145c30 0x7f3a7014f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a74bac640 1 --2- 172.21.15.43:0/2273170728 >> v2:172.21.15.162:3300/0 conn(0x7f3a700b5520 0x7f3a7014ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7fc7132b3640 1 Processor -- start 2024-04-24T23:00:36.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 -- 172.21.15.43:0/2273170728 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1097825902 0 0) 0x7f3a7006d6c0 con 0x7f3a7006e4c0 2024-04-24T23:00:36.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7fc7132b3640 1 -- start start 2024-04-24T23:00:36.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 -- 172.21.15.43:0/2273170728 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a58003530 con 0x7f3a7006e4c0 2024-04-24T23:00:36.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 -- 172.21.15.43:0/2273170728 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2144984569 0 0) 0x7f3a58003530 con 0x7f3a7006e4c0 2024-04-24T23:00:36.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 -- 172.21.15.43:0/2273170728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a70145c30 msgr2=0x7f3a7014f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 --2- 172.21.15.43:0/2273170728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a70145c30 0x7f3a7014f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 -- 172.21.15.43:0/2273170728 >> v2:172.21.15.162:3300/0 conn(0x7f3a700b5520 msgr2=0x7f3a7014ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 --2- 172.21.15.43:0/2273170728 >> v2:172.21.15.162:3300/0 conn(0x7f3a700b5520 0x7f3a7014ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 -- 172.21.15.43:0/2273170728 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7006dde0 con 0x7f3a7006e4c0 2024-04-24T23:00:36.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 -- 172.21.15.43:0/2273170728 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f3a64001680 con 0x7f3a7006e4c0 2024-04-24T23:00:36.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 -- 172.21.15.43:0/2273170728 >> v1:172.21.15.43:6789/0 conn(0x7f3a7006e4c0 legacy=0x7f3a70145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 --2- 172.21.15.43:0/2273170728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a580039c0 0x7f3a58003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 --2- 172.21.15.43:0/2273170728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a58004810 0x7f3a58004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 --2- 172.21.15.43:0/2273170728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a580051d0 0x7f3a5800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 -- 172.21.15.43:0/2273170728 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3a700b5900 con 0x7f3a580039c0 2024-04-24T23:00:36.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 -- 172.21.15.43:0/2273170728 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7006db00 con 0x7f3a58004810 2024-04-24T23:00:36.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6f7fe640 1 -- 172.21.15.43:0/2273170728 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5800c040 con 0x7f3a580051d0 2024-04-24T23:00:36.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a74bac640 1 --2- 172.21.15.43:0/2273170728 >> v2:172.21.15.162:3300/0 conn(0x7f3a700b5520 0x7f3a7014ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:00:36.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f07cbc2a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f07c4073080 0x7f07c4145540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f07c99c6640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f07c406f430 0x7f07c40b17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54554/0 (socket says 172.21.15.43:54554) 2024-04-24T23:00:36.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f07c91c5640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f07c4073080 0x7f07c4145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f07c91c5640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f07c4073080 0x7f07c4145540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43018/0 (socket says 172.21.15.43:43018) 2024-04-24T23:00:36.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f07c99c6640 1 -- 172.21.15.43:0/325409121 learned_addr learned my addr 172.21.15.43:0/325409121 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:36.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a74bac640 1 --2- 172.21.15.43:0/2273170728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a580039c0 0x7f3a58003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f07cbc2a640 1 -- 172.21.15.43:0/325409121 --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07c40705f0 con 0x7f07c406f430 2024-04-24T23:00:36.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f07cbc2a640 1 -- 172.21.15.43:0/325409121 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07c40b6b00 con 0x7f07c4145a80 2024-04-24T23:00:36.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a6ffff640 1 --2- 172.21.15.43:0/2273170728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a58004810 0x7f3a58004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f07cbc2a640 1 -- 172.21.15.43:0/325409121 --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f07c40b68b0 con 0x7f07c4073080 2024-04-24T23:00:36.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7fc7132b3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc704039d30 0x7fc704035480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7fc7132b3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc704034370 0x7fc7040359c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7fc7132b3640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7040389d0 con 0x7fc7040385f0 2024-04-24T23:00:36.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7fc7132b3640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc704034e10 con 0x7fc704034370 2024-04-24T23:00:36.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7fc7132b3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc7040348e0 con 0x7fc704039d30 2024-04-24T23:00:36.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f3a753ad640 1 --2- 172.21.15.43:0/2273170728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a580051d0 0x7f3a5800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f07c89c4640 1 -- 172.21.15.43:0/325409121 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4175788451 0 0) 0x7f07c40705f0 con 0x7f07c406f430 2024-04-24T23:00:36.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f07c89c4640 1 -- 172.21.15.43:0/325409121 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07b0003530 con 0x7f07c406f430 2024-04-24T23:00:36.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f3a74bac640 1 -- 172.21.15.43:0/2273170728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a580051d0 msgr2=0x7f3a5800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f3a74bac640 1 --2- 172.21.15.43:0/2273170728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a580051d0 0x7f3a5800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f3a74bac640 1 -- 172.21.15.43:0/2273170728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a58004810 msgr2=0x7f3a58004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f3a74bac640 1 --2- 172.21.15.43:0/2273170728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a58004810 0x7f3a58004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7fc712ab2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc704034370 0x7fc7040359c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f3a74bac640 1 -- 172.21.15.43:0/2273170728 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a58003530 con 0x7f3a580039c0 2024-04-24T23:00:36.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7fc712ab2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc704034370 0x7fc7040359c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.43:45828/0 (socket says 172.21.15.43:45828) 2024-04-24T23:00:36.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7fc711ab0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc704039d30 0x7fc704035480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7fc712ab2640 1 -- 172.21.15.43:0/1216439453 learned_addr learned my addr 172.21.15.43:0/1216439453 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.471+0000 7f07c89c4640 1 -- 172.21.15.43:0/325409121 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1019850963 0 0) 0x7f07b0003530 con 0x7f07c406f430 2024-04-24T23:00:36.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c89c4640 1 -- 172.21.15.43:0/325409121 >> v2:172.21.15.43:3300/0 conn(0x7f07c4073080 msgr2=0x7f07c4145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c89c4640 1 --2- 172.21.15.43:0/325409121 >> v2:172.21.15.43:3300/0 conn(0x7f07c4073080 0x7f07c4145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c89c4640 1 -- 172.21.15.43:0/325409121 >> v1:172.21.15.162:6789/0 conn(0x7f07c4145a80 legacy=0x7f07c414fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c89c4640 1 -- 172.21.15.43:0/325409121 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c40b6de0 con 0x7f07c406f430 2024-04-24T23:00:36.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c89c4640 1 -- 172.21.15.43:0/325409121 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f07c0001680 con 0x7f07c406f430 2024-04-24T23:00:36.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c89c4640 1 -- 172.21.15.43:0/325409121 >> v1:172.21.15.43:6789/0 conn(0x7f07c406f430 legacy=0x7f07c40b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c89c4640 1 --2- 172.21.15.43:0/325409121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0003a10 0x7f07b0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c89c4640 1 --2- 172.21.15.43:0/325409121 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07b0004810 0x7f07b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c89c4640 1 --2- 172.21.15.43:0/325409121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07b00051d0 0x7f07b00145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c89c4640 1 -- 172.21.15.43:0/325409121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f07c40b68b0 con 0x7f07b00051d0 2024-04-24T23:00:36.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c89c4640 1 -- 172.21.15.43:0/325409121 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f07b0014b10 con 0x7f07b0003a10 2024-04-24T23:00:36.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c89c4640 1 -- 172.21.15.43:0/325409121 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f07b0014c90 con 0x7f07b0004810 2024-04-24T23:00:36.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c99c6640 1 --2- 172.21.15.43:0/325409121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0003a10 0x7f07b0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7fc712ab2640 1 -- 172.21.15.43:0/1216439453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc704039d30 msgr2=0x7fc704035480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7fc712ab2640 1 --2- 172.21.15.43:0/1216439453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc704039d30 0x7fc704035480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7fc712ab2640 1 -- 172.21.15.43:0/1216439453 >> v1:172.21.15.162:6789/0 conn(0x7fc7040385f0 legacy=0x7fc7040c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7fc712ab2640 1 -- 172.21.15.43:0/1216439453 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7040c93f0 con 0x7fc704034370 2024-04-24T23:00:36.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7fc711ab0640 1 --2- 172.21.15.43:0/1216439453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc704039d30 0x7fc704035480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:00:36.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f3a74bac640 1 --2- 172.21.15.43:0/2273170728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a580039c0 0x7f3a58003de0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009c90 tx=0x7f3a6001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6302998ef35993a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c99c6640 1 -- 172.21.15.43:0/325409121 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07b0004810 msgr2=0x7f07b0004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T23:00:36.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f3a6f7fe640 1 -- 172.21.15.43:0/2273170728 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60009860 con 0x7f3a580039c0 2024-04-24T23:00:36.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c99c6640 1 --2- 172.21.15.43:0/325409121 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07b0004810 0x7f07b0004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c99c6640 1 -- 172.21.15.43:0/325409121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07b00051d0 msgr2=0x7f07b00145d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T23:00:36.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c99c6640 1 --2- 172.21.15.43:0/325409121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07b00051d0 0x7f07b00145d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c99c6640 1 -- 172.21.15.43:0/325409121 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b0003530 con 0x7f07b0003a10 2024-04-24T23:00:36.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07c91c5640 1 --2- 172.21.15.43:0/325409121 >> v2:172.21.15.43:3300/0 conn(0x7f07c4073080 0x7f07c4145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:00:36.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f07ca1c7640 1 -- 172.21.15.43:0/325409121 reap_dead start 2024-04-24T23:00:36.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f3a6f7fe640 1 -- 172.21.15.43:0/2273170728 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a60004020 con 0x7f3a580039c0 2024-04-24T23:00:36.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f3a6f7fe640 1 -- 172.21.15.43:0/2273170728 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60004410 con 0x7f3a580039c0 2024-04-24T23:00:36.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f4113fff640 1 Processor -- start 2024-04-24T23:00:36.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f4113fff640 1 -- start start 2024-04-24T23:00:36.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f921e4e9640 1 Processor -- start 2024-04-24T23:00:36.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f4113fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f41140b1090 0x7f41140b5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f4113fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f411415ca60 0x7f411415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f4112ffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f41140b1090 0x7f41140b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f4112ffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f41140b1090 0x7f41140b5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43030/0 (socket says 172.21.15.43:43030) 2024-04-24T23:00:36.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f4112ffd640 1 -- 172.21.15.43:0/1996126911 learned_addr learned my addr 172.21.15.43:0/1996126911 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f4113fff640 1 -- 172.21.15.43:0/1996126911 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41140b2370 con 0x7f4114157b50 2024-04-24T23:00:36.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f4113fff640 1 -- 172.21.15.43:0/1996126911 --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f41140b25e0 con 0x7f41140b1090 2024-04-24T23:00:36.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f4113fff640 1 -- 172.21.15.43:0/1996126911 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f41140b1470 con 0x7f411415ca60 2024-04-24T23:00:36.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.475+0000 7f41137fe640 1 --2- 172.21.15.43:0/1996126911 >> v2:172.21.15.162:3300/0 conn(0x7f411415ca60 0x7f411415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f921e4e9640 1 -- start start 2024-04-24T23:00:36.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f4112ffd640 1 -- 172.21.15.43:0/1996126911 >> v2:172.21.15.162:3300/0 conn(0x7f411415ca60 msgr2=0x7f411415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f4112ffd640 1 --2- 172.21.15.43:0/1996126911 >> v2:172.21.15.162:3300/0 conn(0x7f411415ca60 0x7f411415ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f4112ffd640 1 -- 172.21.15.43:0/1996126911 >> v1:172.21.15.162:6789/0 conn(0x7f4114157b50 legacy=0x7f4114157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f4112ffd640 1 -- 172.21.15.43:0/1996126911 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41140b0080 con 0x7f41140b1090 2024-04-24T23:00:36.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a75bae640 1 -- 172.21.15.43:0/2273170728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a580039c0 msgr2=0x7f3a58003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a75bae640 1 --2- 172.21.15.43:0/2273170728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a580039c0 0x7f3a58003de0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009c90 tx=0x7f3a6001cc40 comp rx=0 tx=0).stop 2024-04-24T23:00:36.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a753ad640 1 -- 172.21.15.43:0/2273170728 reap_dead start 2024-04-24T23:00:36.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a75bae640 1 -- 172.21.15.43:0/2273170728 shutdown_connections 2024-04-24T23:00:36.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a75bae640 1 -- 172.21.15.43:0/2273170728 >> 172.21.15.43:0/2273170728 conn(0x7f3a700b63b0 msgr2=0x7f3a700b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f07c99c6640 1 --2- 172.21.15.43:0/325409121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0003a10 0x7f07b0003e30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07c000c160 tx=0x7f07c001cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c0f02028a5fa3b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a75bae640 1 -- 172.21.15.43:0/2273170728 shutdown_connections 2024-04-24T23:00:36.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a75bae640 1 -- 172.21.15.43:0/2273170728 wait complete. 2024-04-24T23:00:36.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f921e4e9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9210039ab0 0x7f9210006cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f921e4e9640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9210039e90 con 0x7f92100ce2d0 2024-04-24T23:00:36.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f921e4e9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f921003aee0 con 0x7f9210007210 2024-04-24T23:00:36.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f921e4e9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f921003b530 con 0x7f9210039ab0 2024-04-24T23:00:36.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f921ca86640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f92100ce2d0 0x7f9210038290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54570/0 (socket says 172.21.15.43:54570) 2024-04-24T23:00:36.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f921ca86640 1 -- 172.21.15.43:0/2058354101 learned_addr learned my addr 172.21.15.43:0/2058354101 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:36.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9216ffd640 1 -- 172.21.15.43:0/2058354101 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2400044718 0 0) 0x7f9210039e90 con 0x7f92100ce2d0 2024-04-24T23:00:36.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9216ffd640 1 -- 172.21.15.43:0/2058354101 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9208003530 con 0x7f92100ce2d0 2024-04-24T23:00:36.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a75bae640 1 Processor -- start 2024-04-24T23:00:36.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7fc712ab2640 1 --2- 172.21.15.43:0/1216439453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc704034370 0x7fc7040359c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0699d0 tx=0x7fc70c097ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73a5e96dd46a82ab server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a75bae640 1 -- start start 2024-04-24T23:00:36.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9216ffd640 1 -- 172.21.15.43:0/2058354101 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1810628450 0 0) 0x7f9208003530 con 0x7f92100ce2d0 2024-04-24T23:00:36.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9216ffd640 1 -- 172.21.15.43:0/2058354101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9210039ab0 msgr2=0x7f9210006cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9217fff640 1 --2- 172.21.15.43:0/2058354101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9210039ab0 0x7f9210006cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9216ffd640 1 --2- 172.21.15.43:0/2058354101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9210039ab0 0x7f9210006cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9216ffd640 1 -- 172.21.15.43:0/2058354101 >> v1:172.21.15.162:6789/0 conn(0x7f9210007210 legacy=0x7f92100cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9216ffd640 1 -- 172.21.15.43:0/2058354101 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921003b1c0 con 0x7f92100ce2d0 2024-04-24T23:00:36.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9216ffd640 1 -- 172.21.15.43:0/2058354101 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f9218069360 con 0x7f92100ce2d0 2024-04-24T23:00:36.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9216ffd640 1 -- 172.21.15.43:0/2058354101 >> v1:172.21.15.43:6789/0 conn(0x7f92100ce2d0 legacy=0x7f9210038290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9216ffd640 1 --2- 172.21.15.43:0/2058354101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92080039f0 0x7f9208003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9216ffd640 1 --2- 172.21.15.43:0/2058354101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9208004810 0x7f9208004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9216ffd640 1 --2- 172.21.15.43:0/2058354101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9210039ab0 0x7f920800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9216ffd640 1 -- 172.21.15.43:0/2058354101 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f921003b530 con 0x7f9208004810 2024-04-24T23:00:36.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9216ffd640 1 -- 172.21.15.43:0/2058354101 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9208005610 con 0x7f92080039f0 2024-04-24T23:00:36.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f9216ffd640 1 -- 172.21.15.43:0/2058354101 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f920800bf10 con 0x7f9210039ab0 2024-04-24T23:00:36.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f92177fe640 1 --2- 172.21.15.43:0/2058354101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9208004810 0x7f9208004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f921ca86640 1 --2- 172.21.15.43:0/2058354101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9210039ab0 0x7f920800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f4112ffd640 1 --2- 172.21.15.43:0/1996126911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41140b1090 0x7f41140b5640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f411408b430 tx=0x7f4104020940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efecf5d01c4c465d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f4111ffb640 1 -- 172.21.15.43:0/1996126911 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410400b040 con 0x7f41140b1090 2024-04-24T23:00:36.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a75bae640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a580039c0 0x7f3a70147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a75bae640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a7014dd90 0x7f3a701e4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a75bae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a700b31f0 0x7f3a700b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a75bae640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7006f4f0 con 0x7f3a7014dd90 2024-04-24T23:00:36.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f4111ffb640 1 -- 172.21.15.43:0/1996126911 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4104004230 con 0x7f41140b1090 2024-04-24T23:00:36.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f4111ffb640 1 -- 172.21.15.43:0/1996126911 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104003620 con 0x7f41140b1090 2024-04-24T23:00:36.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a75bae640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7006f370 con 0x7f3a700b31f0 2024-04-24T23:00:36.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a75bae640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3a70156820 con 0x7f3a580039c0 2024-04-24T23:00:36.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f92177fe640 1 -- 172.21.15.43:0/2058354101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9210039ab0 msgr2=0x7f920800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f92177fe640 1 --2- 172.21.15.43:0/2058354101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9210039ab0 0x7f920800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f92177fe640 1 -- 172.21.15.43:0/2058354101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92080039f0 msgr2=0x7f9208003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:36.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f92177fe640 1 --2- 172.21.15.43:0/2058354101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92080039f0 0x7f9208003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f92177fe640 1 -- 172.21.15.43:0/2058354101 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9208003530 con 0x7f9208004810 2024-04-24T23:00:36.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a74bac640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a580039c0 0x7f3a70147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a74bac640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a580039c0 0x7f3a70147f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.43:39610/0 (socket says 172.21.15.43:39610) 2024-04-24T23:00:36.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a74bac640 1 -- 172.21.15.43:0/2245239221 learned_addr learned my addr 172.21.15.43:0/2245239221 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a6ffff640 1 --2- 172.21.15.43:0/2245239221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a7014dd90 0x7f3a701e4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a74bac640 1 -- 172.21.15.43:0/2245239221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a700b31f0 msgr2=0x7f3a700b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a74bac640 1 --2- 172.21.15.43:0/2245239221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a700b31f0 0x7f3a700b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a74bac640 1 -- 172.21.15.43:0/2245239221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a7014dd90 msgr2=0x7f3a701e4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a74bac640 1 --2- 172.21.15.43:0/2245239221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a7014dd90 0x7f3a701e4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.479+0000 7f3a74bac640 1 -- 172.21.15.43:0/2245239221 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a70147740 con 0x7f3a580039c0 2024-04-24T23:00:36.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f3a74bac640 1 --2- 172.21.15.43:0/2245239221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a580039c0 0x7f3a70147f00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3a6001ca70 tx=0x7f3a58005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 -- 172.21.15.43:0/1996126911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41140b1090 msgr2=0x7f41140b5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 --2- 172.21.15.43:0/1996126911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41140b1090 0x7f41140b5640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f411408b430 tx=0x7f4104020940 comp rx=0 tx=0).stop 2024-04-24T23:00:36.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 -- 172.21.15.43:0/1996126911 shutdown_connections 2024-04-24T23:00:36.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 --2- 172.21.15.43:0/1996126911 >> v2:172.21.15.162:3300/0 conn(0x7f411415ca60 0x7f411415ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 --2- 172.21.15.43:0/1996126911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41140b1090 0x7f41140b5640 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 -- 172.21.15.43:0/1996126911 >> 172.21.15.43:0/1996126911 conn(0x7f411406c640 msgr2=0x7f411406ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 -- 172.21.15.43:0/1996126911 shutdown_connections 2024-04-24T23:00:36.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 -- 172.21.15.43:0/1996126911 wait complete. 2024-04-24T23:00:36.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f3a6d7fa640 1 -- 172.21.15.43:0/2245239221 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a600bb020 con 0x7f3a580039c0 2024-04-24T23:00:36.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f3a6d7fa640 1 -- 172.21.15.43:0/2245239221 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a60005ba0 con 0x7f3a580039c0 2024-04-24T23:00:36.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f3a6d7fa640 1 -- 172.21.15.43:0/2245239221 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a600a57f0 con 0x7f3a580039c0 2024-04-24T23:00:36.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f3a75bae640 1 -- 172.21.15.43:0/2245239221 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a700b1ce0 con 0x7f3a580039c0 2024-04-24T23:00:36.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f3a75bae640 1 -- 172.21.15.43:0/2245239221 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a701479e0 con 0x7f3a580039c0 2024-04-24T23:00:36.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 Processor -- start 2024-04-24T23:00:36.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 -- start start 2024-04-24T23:00:36.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f3a75bae640 1 -- 172.21.15.43:0/2245239221 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a7004f510 con 0x7f3a580039c0 2024-04-24T23:00:36.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41140b1090 0x7f411415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4114157b50 0x7f411415ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f411415ca60 0x7f4114158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f41140b4b00 con 0x7f4114157b50 2024-04-24T23:00:36.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f41140b5b80 con 0x7f41140b1090 2024-04-24T23:00:36.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f41140b4c80 con 0x7f411415ca60 2024-04-24T23:00:36.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f41127fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4114157b50 0x7f411415ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f92177fe640 1 --2- 172.21.15.43:0/2058354101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9208004810 0x7f9208004c90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f920c001680 tx=0x7f920c01c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39841f5dbc3ee978 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f41127fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4114157b50 0x7f411415ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43060/0 (socket says 172.21.15.43:43060) 2024-04-24T23:00:36.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f41127fc640 1 -- 172.21.15.43:0/846648827 learned_addr learned my addr 172.21.15.43:0/846648827 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f41137fe640 1 --2- 172.21.15.43:0/846648827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f411415ca60 0x7f4114158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f41127fc640 1 -- 172.21.15.43:0/846648827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f411415ca60 msgr2=0x7f4114158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f9216ffd640 1 -- 172.21.15.43:0/2058354101 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c001250 con 0x7f9208004810 2024-04-24T23:00:36.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f9216ffd640 1 -- 172.21.15.43:0/2058354101 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920c005270 con 0x7f9208004810 2024-04-24T23:00:36.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f9216ffd640 1 -- 172.21.15.43:0/2058354101 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c0054a0 con 0x7f9208004810 2024-04-24T23:00:36.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f41127fc640 1 --2- 172.21.15.43:0/846648827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f411415ca60 0x7f4114158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f41127fc640 1 -- 172.21.15.43:0/846648827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41140b1090 msgr2=0x7f411415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f41127fc640 1 --2- 172.21.15.43:0/846648827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41140b1090 0x7f411415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f41127fc640 1 -- 172.21.15.43:0/846648827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411415b380 con 0x7f4114157b50 2024-04-24T23:00:36.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f41137fe640 1 --2- 172.21.15.43:0/846648827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f411415ca60 0x7f4114158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:36.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f41127fc640 1 --2- 172.21.15.43:0/846648827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4114157b50 0x7f411415ae40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f410800c450 tx=0x7f410800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f40fb7fe640 1 -- 172.21.15.43:0/846648827 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4108016020 con 0x7f4114157b50 2024-04-24T23:00:36.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f40fb7fe640 1 -- 172.21.15.43:0/846648827 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41080052d0 con 0x7f4114157b50 2024-04-24T23:00:36.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f40fb7fe640 1 -- 172.21.15.43:0/846648827 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4108007260 con 0x7f4114157b50 2024-04-24T23:00:36.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 -- 172.21.15.43:0/846648827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4114159b10 con 0x7f4114157b50 2024-04-24T23:00:36.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f4113fff640 1 -- 172.21.15.43:0/846648827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f411415b8e0 con 0x7f4114157b50 2024-04-24T23:00:36.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f921e4e9640 1 -- 172.21.15.43:0/2058354101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9208004810 msgr2=0x7f9208004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f921e4e9640 1 --2- 172.21.15.43:0/2058354101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9208004810 0x7f9208004c90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f920c001680 tx=0x7f920c01c2a0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.483+0000 7f921ca86640 1 -- 172.21.15.43:0/2058354101 reap_dead start 2024-04-24T23:00:36.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f921e4e9640 1 -- 172.21.15.43:0/2058354101 shutdown_connections 2024-04-24T23:00:36.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f921e4e9640 1 -- 172.21.15.43:0/2058354101 >> 172.21.15.43:0/2058354101 conn(0x7f92100061b0 msgr2=0x7f92100065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f3a6d7fa640 1 -- 172.21.15.43:0/2245239221 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3a600be020 con 0x7f3a580039c0 2024-04-24T23:00:36.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f921e4e9640 1 -- 172.21.15.43:0/2058354101 shutdown_connections 2024-04-24T23:00:36.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f4113fff640 1 -- 172.21.15.43:0/846648827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f411404f510 con 0x7f4114157b50 2024-04-24T23:00:36.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f3a6d7fa640 1 --2- 172.21.15.43:0/2245239221 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3a5c0678c0 0x7f3a5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f3a6d7fa640 1 -- 172.21.15.43:0/2245239221 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3a60120860 con 0x7f3a580039c0 2024-04-24T23:00:36.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f921e4e9640 1 -- 172.21.15.43:0/2058354101 wait complete. 2024-04-24T23:00:36.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f3a6ffff640 1 --2- 172.21.15.43:0/2245239221 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3a5c0678c0 0x7f3a5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f3a6ffff640 1 --2- 172.21.15.43:0/2245239221 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3a5c0678c0 0x7f3a5c069d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3a64001130 tx=0x7f3a64001e10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f40fb7fe640 1 -- 172.21.15.43:0/846648827 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4108007400 con 0x7f4114157b50 2024-04-24T23:00:36.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f40fb7fe640 1 --2- 172.21.15.43:0/846648827 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f41000678c0 0x7f4100069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f4112ffd640 1 --2- 172.21.15.43:0/846648827 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f41000678c0 0x7f4100069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f40fb7fe640 1 -- 172.21.15.43:0/846648827 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4108085900 con 0x7f4114157b50 2024-04-24T23:00:36.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f4112ffd640 1 --2- 172.21.15.43:0/846648827 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f41000678c0 0x7f4100069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f41040b2000 tx=0x7f4104004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.487+0000 7f921e4e9640 1 Processor -- start 2024-04-24T23:00:36.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f921e4e9640 1 -- start start 2024-04-24T23:00:36.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f921e4e9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92100d4af0 0x7f92100d9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f921e4e9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92100d4ed0 0x7f92100da110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f921e4e9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92100daf60 0x7f921016cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f921e4e9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f92100dcf30 con 0x7f92100daf60 2024-04-24T23:00:36.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f921e4e9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f92100dcdb0 con 0x7f92100d4ed0 2024-04-24T23:00:36.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f921e4e9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f92100dd0b0 con 0x7f92100d4af0 2024-04-24T23:00:36.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f921ca86640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92100daf60 0x7f921016cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f921ca86640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92100daf60 0x7f921016cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43076/0 (socket says 172.21.15.43:43076) 2024-04-24T23:00:36.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f921ca86640 1 -- 172.21.15.43:0/309111025 learned_addr learned my addr 172.21.15.43:0/309111025 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f9217fff640 1 --2- 172.21.15.43:0/309111025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92100d4af0 0x7f92100d9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f40fb7fe640 1 -- 172.21.15.43:0/846648827 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f4108020020 con 0x7f4114157b50 2024-04-24T23:00:36.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f92177fe640 1 --2- 172.21.15.43:0/309111025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92100d4ed0 0x7f92100da110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f921ca86640 1 -- 172.21.15.43:0/309111025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92100d4af0 msgr2=0x7f92100d9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f921ca86640 1 --2- 172.21.15.43:0/309111025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92100d4af0 0x7f92100d9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f921ca86640 1 -- 172.21.15.43:0/309111025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92100d4ed0 msgr2=0x7f92100da110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f921ca86640 1 --2- 172.21.15.43:0/309111025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92100d4ed0 0x7f92100da110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.491+0000 7f921ca86640 1 -- 172.21.15.43:0/309111025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92100dacf0 con 0x7f92100daf60 2024-04-24T23:00:36.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.495+0000 7f921ca86640 1 --2- 172.21.15.43:0/309111025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92100daf60 0x7f921016cbf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9218062db0 tx=0x7f92180716e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.495+0000 7f9214ff9640 1 -- 172.21.15.43:0/309111025 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92180703c0 con 0x7f92100daf60 2024-04-24T23:00:36.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.495+0000 7f9214ff9640 1 -- 172.21.15.43:0/309111025 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9218070560 con 0x7f92100daf60 2024-04-24T23:00:36.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.495+0000 7f9214ff9640 1 -- 172.21.15.43:0/309111025 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218070930 con 0x7f92100daf60 2024-04-24T23:00:36.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.495+0000 7f921e4e9640 1 -- 172.21.15.43:0/309111025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92100d3cb0 con 0x7f92100daf60 2024-04-24T23:00:36.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.495+0000 7f921e4e9640 1 -- 172.21.15.43:0/309111025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92100d75a0 con 0x7f92100daf60 2024-04-24T23:00:36.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.495+0000 7f921e4e9640 1 -- 172.21.15.43:0/309111025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92100057f0 con 0x7f92100daf60 2024-04-24T23:00:36.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.495+0000 7f9214ff9640 1 -- 172.21.15.43:0/309111025 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9218070ad0 con 0x7f92100daf60 2024-04-24T23:00:36.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.495+0000 7f9214ff9640 1 --2- 172.21.15.43:0/309111025 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f91fc067910 0x7f91fc069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.495+0000 7f9217fff640 1 --2- 172.21.15.43:0/309111025 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f91fc067910 0x7f91fc069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.495+0000 7f9214ff9640 1 -- 172.21.15.43:0/309111025 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9218103510 con 0x7f92100daf60 2024-04-24T23:00:36.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.495+0000 7f9217fff640 1 --2- 172.21.15.43:0/309111025 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f91fc067910 0x7f91fc069dd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f92040047c0 tx=0x7f9204008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7f07c89c4640 1 -- 172.21.15.43:0/325409121 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0007c70 con 0x7f07b0003a10 2024-04-24T23:00:36.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7f07c89c4640 1 -- 172.21.15.43:0/325409121 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07c00a9020 con 0x7f07b0003a10 2024-04-24T23:00:36.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7f07c89c4640 1 -- 172.21.15.43:0/325409121 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c00058e0 con 0x7f07b0003a10 2024-04-24T23:00:36.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7fe6627fc640 1 -- 172.21.15.43:0/591757088 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe6680566e0 con 0x7fe66c0b2dc0 2024-04-24T23:00:36.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7fc7112af640 1 -- 172.21.15.43:0/1216439453 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c1205a0 con 0x7fc704034370 2024-04-24T23:00:36.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7fc7112af640 1 -- 172.21.15.43:0/1216439453 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c120780 con 0x7fc704034370 2024-04-24T23:00:36.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7f07cbc2a640 1 -- 172.21.15.43:0/325409121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0003a10 msgr2=0x7f07b0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7f07cbc2a640 1 --2- 172.21.15.43:0/325409121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0003a10 0x7f07b0003e30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07c000c160 tx=0x7f07c001cba0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7f07cbc2a640 1 -- 172.21.15.43:0/325409121 shutdown_connections 2024-04-24T23:00:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7f07cbc2a640 1 --2- 172.21.15.43:0/325409121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0003a10 0x7f07b0003e30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7f07cbc2a640 1 -- 172.21.15.43:0/325409121 >> 172.21.15.43:0/325409121 conn(0x7f07c40b7880 msgr2=0x7f07c40b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7f07cbc2a640 1 -- 172.21.15.43:0/325409121 shutdown_connections 2024-04-24T23:00:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7f07cbc2a640 1 -- 172.21.15.43:0/325409121 wait complete. 2024-04-24T23:00:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7fc7112af640 1 -- 172.21.15.43:0/1216439453 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c120bf0 con 0x7fc704034370 2024-04-24T23:00:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7fc7132b3640 1 -- 172.21.15.43:0/1216439453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc704034370 msgr2=0x7fc7040359c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7fc7132b3640 1 --2- 172.21.15.43:0/1216439453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc704034370 0x7fc7040359c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0699d0 tx=0x7fc70c097ab0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7fc7132b3640 1 -- 172.21.15.43:0/1216439453 shutdown_connections 2024-04-24T23:00:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7fc7132b3640 1 --2- 172.21.15.43:0/1216439453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc704039d30 0x7fc704035480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7fc7132b3640 1 --2- 172.21.15.43:0/1216439453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc704034370 0x7fc7040359c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7fc7132b3640 1 -- 172.21.15.43:0/1216439453 >> 172.21.15.43:0/1216439453 conn(0x7fc70403abd0 msgr2=0x7fc704005ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7f07cbc2a640 1 Processor -- start 2024-04-24T23:00:36.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.499+0000 7f07cbc2a640 1 -- start start 2024-04-24T23:00:36.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07cbc2a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0003a10 0x7f07c40b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07cbc2a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07c41db480 0x7f07c413ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07cbc2a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07c413b250 0x7f07c41dea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07cbc2a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f07c40701c0 con 0x7f07c41db480 2024-04-24T23:00:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07cbc2a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f07c40b1fe0 con 0x7f07b0003a10 2024-04-24T23:00:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07cbc2a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f07c4070340 con 0x7f07c413b250 2024-04-24T23:00:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07c91c5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07c41db480 0x7f07c413ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07c91c5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07c41db480 0x7f07c413ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43080/0 (socket says 172.21.15.43:43080) 2024-04-24T23:00:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07c91c5640 1 -- 172.21.15.43:0/1913676507 learned_addr learned my addr 172.21.15.43:0/1913676507 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07c99c6640 1 --2- 172.21.15.43:0/1913676507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0003a10 0x7f07c40b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07ca1c7640 1 --2- 172.21.15.43:0/1913676507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07c413b250 0x7f07c41dea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07c91c5640 1 -- 172.21.15.43:0/1913676507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07c413b250 msgr2=0x7f07c41dea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07c91c5640 1 --2- 172.21.15.43:0/1913676507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07c413b250 0x7f07c41dea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07c91c5640 1 -- 172.21.15.43:0/1913676507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0003a10 msgr2=0x7f07c40b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07c91c5640 1 --2- 172.21.15.43:0/1913676507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0003a10 0x7f07c40b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07c91c5640 1 -- 172.21.15.43:0/1913676507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c4140ff0 con 0x7f07c41db480 2024-04-24T23:00:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f07c91c5640 1 --2- 172.21.15.43:0/1913676507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07c41db480 0x7f07c413ad10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00ef90 tx=0x7f07bc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7f3a6d7fa640 1 -- 172.21.15.43:0/2245239221 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3a600c5030 con 0x7f3a580039c0 2024-04-24T23:00:36.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7fc7132b3640 1 -- 172.21.15.43:0/1216439453 shutdown_connections 2024-04-24T23:00:36.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.503+0000 7fc7132b3640 1 -- 172.21.15.43:0/1216439453 wait complete. 2024-04-24T23:00:36.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc7132b3640 1 Processor -- start 2024-04-24T23:00:36.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7f07ba7fc640 1 -- 172.21.15.43:0/1913676507 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc018020 con 0x7f07c41db480 2024-04-24T23:00:36.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7f07ba7fc640 1 -- 172.21.15.43:0/1913676507 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07bc014480 con 0x7f07c41db480 2024-04-24T23:00:36.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7f07ba7fc640 1 -- 172.21.15.43:0/1913676507 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc014870 con 0x7f07c41db480 2024-04-24T23:00:36.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7f9214ff9640 1 -- 172.21.15.43:0/309111025 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f92180d1f40 con 0x7f92100daf60 2024-04-24T23:00:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc7132b3640 1 -- start start 2024-04-24T23:00:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc7132b3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc704034370 0x7fc7040bbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc7132b3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7040385f0 0x7fc7040c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc7132b3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7040bc220 0x7fc7040c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc7132b3640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc7040d6710 con 0x7fc704034370 2024-04-24T23:00:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc7132b3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc7040d6590 con 0x7fc7040385f0 2024-04-24T23:00:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc7132b3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc7040d6890 con 0x7fc7040bc220 2024-04-24T23:00:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc712ab2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7040bc220 0x7fc7040c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc712ab2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7040bc220 0x7fc7040c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.43:39652/0 (socket says 172.21.15.43:39652) 2024-04-24T23:00:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc712ab2640 1 -- 172.21.15.43:0/1128669567 learned_addr learned my addr 172.21.15.43:0/1128669567 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc711ab0640 1 --2- 172.21.15.43:0/1128669567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7040385f0 0x7fc7040c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc7122b1640 1 --2- 172.21.15.43:0/1128669567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc704034370 0x7fc7040bbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc712ab2640 1 -- 172.21.15.43:0/1128669567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7040385f0 msgr2=0x7fc7040c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc712ab2640 1 --2- 172.21.15.43:0/1128669567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7040385f0 0x7fc7040c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc712ab2640 1 -- 172.21.15.43:0/1128669567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc704034370 msgr2=0x7fc7040bbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc712ab2640 1 --2- 172.21.15.43:0/1128669567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc704034370 0x7fc7040bbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc712ab2640 1 -- 172.21.15.43:0/1128669567 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc704171df0 con 0x7fc7040bc220 2024-04-24T23:00:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7fc712ab2640 1 --2- 172.21.15.43:0/1128669567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7040bc220 0x7fc7040c4700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc70c000b70 tx=0x7fc70c0948f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7f07cbc2a640 1 -- 172.21.15.43:0/1913676507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c41dba10 con 0x7f07c41db480 2024-04-24T23:00:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.507+0000 7f07cbc2a640 1 -- 172.21.15.43:0/1913676507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c4146f50 con 0x7f07c41db480 2024-04-24T23:00:36.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.511+0000 7fc702ffd640 1 -- 172.21.15.43:0/1128669567 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c120c00 con 0x7fc7040bc220 2024-04-24T23:00:36.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.511+0000 7fc702ffd640 1 -- 172.21.15.43:0/1128669567 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c120da0 con 0x7fc7040bc220 2024-04-24T23:00:36.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.511+0000 7fc702ffd640 1 -- 172.21.15.43:0/1128669567 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c128640 con 0x7fc7040bc220 2024-04-24T23:00:36.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.511+0000 7f07cbc2a640 1 -- 172.21.15.43:0/1913676507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c404f580 con 0x7f07c41db480 2024-04-24T23:00:36.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.511+0000 7fc7132b3640 1 -- 172.21.15.43:0/1128669567 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7041720d0 con 0x7fc7040bc220 2024-04-24T23:00:36.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.511+0000 7fc7132b3640 1 -- 172.21.15.43:0/1128669567 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7040b6700 con 0x7fc7040bc220 2024-04-24T23:00:36.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.511+0000 7fc7132b3640 1 -- 172.21.15.43:0/1128669567 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7040053a0 con 0x7fc7040bc220 2024-04-24T23:00:36.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.515+0000 7fc702ffd640 1 -- 172.21.15.43:0/1128669567 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc70c1287e0 con 0x7fc7040bc220 2024-04-24T23:00:36.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.515+0000 7fc702ffd640 1 --2- 172.21.15.43:0/1128669567 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc6f00678f0 0x7fc6f0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.515+0000 7fc702ffd640 1 -- 172.21.15.43:0/1128669567 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc70c19a2f0 con 0x7fc7040bc220 2024-04-24T23:00:36.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.511+0000 7f07ba7fc640 1 -- 172.21.15.43:0/1913676507 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f07bc01b020 con 0x7f07c41db480 2024-04-24T23:00:36.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.511+0000 7f07ba7fc640 1 --2- 172.21.15.43:0/1913676507 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f07a80678f0 0x7f07a8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.511+0000 7f07ba7fc640 1 -- 172.21.15.43:0/1913676507 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f07bc087280 con 0x7f07c41db480 2024-04-24T23:00:36.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.511+0000 7f07c99c6640 1 --2- 172.21.15.43:0/1913676507 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f07a80678f0 0x7f07a8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.515+0000 7f07c99c6640 1 --2- 172.21.15.43:0/1913676507 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f07a80678f0 0x7f07a8069db0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f07c00aa000 tx=0x7f07c40b6cd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.519+0000 7fc7122b1640 1 --2- 172.21.15.43:0/1128669567 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc6f00678f0 0x7fc6f0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.519+0000 7fc7122b1640 1 --2- 172.21.15.43:0/1128669567 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc6f00678f0 0x7fc6f0069db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc007fd0 tx=0x7fc6fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.519+0000 7f747b3a2640 1 Processor -- start 2024-04-24T23:00:36.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.519+0000 7f747b3a2640 1 -- start start 2024-04-24T23:00:36.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.519+0000 7f07ba7fc640 1 -- 172.21.15.43:0/1913676507 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f07bc022030 con 0x7f07c41db480 2024-04-24T23:00:36.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.519+0000 7f747b3a2640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f746c033920 0x7f746c036540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.519+0000 7f747a3a0640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f746c033920 0x7f746c036540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.523+0000 7f747a3a0640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f746c033920 0x7f746c036540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43104/0 (socket says 172.21.15.43:43104) 2024-04-24T23:00:36.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.523+0000 7f747aba1640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f746c0c8600 0x7f746c0d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54572/0 (socket says 172.21.15.43:54572) 2024-04-24T23:00:36.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.523+0000 7f747aba1640 1 -- 172.21.15.43:0/444977058 learned_addr learned my addr 172.21.15.43:0/444977058 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:36.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.523+0000 7f7479b9f640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f746c033d00 0x7f746c035560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.43:53592/0 (socket says 172.21.15.43:53592) 2024-04-24T23:00:36.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.523+0000 7f747b3a2640 1 -- 172.21.15.43:0/444977058 --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f746c035ed0 con 0x7f746c0c8600 2024-04-24T23:00:36.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.523+0000 7f747b3a2640 1 -- 172.21.15.43:0/444977058 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f746c0361b0 con 0x7f746c033d00 2024-04-24T23:00:36.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.523+0000 7f747b3a2640 1 -- 172.21.15.43:0/444977058 --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f746c036e00 con 0x7f746c033920 2024-04-24T23:00:36.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.523+0000 7f747a3a0640 1 -- 172.21.15.43:0/444977058 >> v1:172.21.15.162:6789/0 conn(0x7f746c033d00 legacy=0x7f746c035560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.523+0000 7f747a3a0640 1 -- 172.21.15.43:0/444977058 >> v1:172.21.15.43:6789/0 conn(0x7f746c0c8600 legacy=0x7f746c0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.523+0000 7f747a3a0640 1 -- 172.21.15.43:0/444977058 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746c034e10 con 0x7f746c033920 2024-04-24T23:00:36.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.527+0000 7f747a3a0640 1 --2- 172.21.15.43:0/444977058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c033920 0x7f746c036540 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7464009a20 tx=0x7f746401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc3d359cfc599fb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.527+0000 7f747939e640 1 -- 172.21.15.43:0/444977058 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74640b0070 con 0x7f746c033920 2024-04-24T23:00:36.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.527+0000 7fc702ffd640 1 -- 172.21.15.43:0/1128669567 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc70c0918d0 con 0x7fc7040bc220 2024-04-24T23:00:36.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.527+0000 7f747939e640 1 -- 172.21.15.43:0/444977058 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74640ab600 con 0x7f746c033920 2024-04-24T23:00:36.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.527+0000 7f747939e640 1 -- 172.21.15.43:0/444977058 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74640ab9d0 con 0x7f746c033920 2024-04-24T23:00:36.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.527+0000 7f747b3a2640 1 -- 172.21.15.43:0/444977058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c033920 msgr2=0x7f746c036540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.527+0000 7f747b3a2640 1 --2- 172.21.15.43:0/444977058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c033920 0x7f746c036540 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7464009a20 tx=0x7f746401c4c0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.527+0000 7f747b3a2640 1 -- 172.21.15.43:0/444977058 shutdown_connections 2024-04-24T23:00:36.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.527+0000 7f747b3a2640 1 --2- 172.21.15.43:0/444977058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c033920 0x7f746c036540 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.527+0000 7f747b3a2640 1 -- 172.21.15.43:0/444977058 >> 172.21.15.43:0/444977058 conn(0x7f746c03a860 msgr2=0x7f746c03ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.527+0000 7f747b3a2640 1 -- 172.21.15.43:0/444977058 shutdown_connections 2024-04-24T23:00:36.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.527+0000 7f747b3a2640 1 -- 172.21.15.43:0/444977058 wait complete. 2024-04-24T23:00:36.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.531+0000 7f747b3a2640 1 Processor -- start 2024-04-24T23:00:36.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.531+0000 7f747b3a2640 1 -- start start 2024-04-24T23:00:36.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.531+0000 7f747b3a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746c033d00 0x7f746c1624b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.531+0000 7f747b3a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746c0c8600 0x7f746c14fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.531+0000 7f747b3a2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c153690 0x7f746c1547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.531+0000 7f747a3a0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746c033d00 0x7f746c1624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.531+0000 7f747a3a0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746c033d00 0x7f746c1624b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.43:39662/0 (socket says 172.21.15.43:39662) 2024-04-24T23:00:36.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.531+0000 7f7479b9f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746c0c8600 0x7f746c14fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.531+0000 7f747aba1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c153690 0x7f746c1547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.531+0000 7f747aba1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c153690 0x7f746c1547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43114/0 (socket says 172.21.15.43:43114) 2024-04-24T23:00:36.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.531+0000 7f7479b9f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746c0c8600 0x7f746c14fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.43:45898/0 (socket says 172.21.15.43:45898) 2024-04-24T23:00:36.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.531+0000 7f747a3a0640 1 -- 172.21.15.43:0/1797272278 learned_addr learned my addr 172.21.15.43:0/1797272278 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:36.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.531+0000 7f747b3a2640 1 -- 172.21.15.43:0/1797272278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f746c035c70 con 0x7f746c153690 2024-04-24T23:00:36.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.531+0000 7f747b3a2640 1 -- 172.21.15.43:0/1797272278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f746c029fb0 con 0x7f746c0c8600 2024-04-24T23:00:36.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.535+0000 7f747b3a2640 1 -- 172.21.15.43:0/1797272278 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f746c006eb0 con 0x7f746c033d00 2024-04-24T23:00:36.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.535+0000 7f747aba1640 1 -- 172.21.15.43:0/1797272278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746c033d00 msgr2=0x7f746c1624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.535+0000 7f747aba1640 1 --2- 172.21.15.43:0/1797272278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746c033d00 0x7f746c1624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.535+0000 7f747aba1640 1 -- 172.21.15.43:0/1797272278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746c0c8600 msgr2=0x7f746c14fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.535+0000 7f747aba1640 1 --2- 172.21.15.43:0/1797272278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746c0c8600 0x7f746c14fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.535+0000 7f747aba1640 1 -- 172.21.15.43:0/1797272278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746c1532e0 con 0x7f746c153690 2024-04-24T23:00:36.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.535+0000 7f747aba1640 1 --2- 172.21.15.43:0/1797272278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c153690 0x7f746c1547f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f74740757d0 tx=0x7f7474070ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.535+0000 7f746affd640 1 -- 172.21.15.43:0/1797272278 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474098070 con 0x7f746c153690 2024-04-24T23:00:36.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.535+0000 7f746affd640 1 -- 172.21.15.43:0/1797272278 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7474073810 con 0x7f746c153690 2024-04-24T23:00:36.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.535+0000 7f746affd640 1 -- 172.21.15.43:0/1797272278 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474073c40 con 0x7f746c153690 2024-04-24T23:00:36.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.535+0000 7f747b3a2640 1 -- 172.21.15.43:0/1797272278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746c1542d0 con 0x7f746c153690 2024-04-24T23:00:36.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.535+0000 7f746affd640 1 -- 172.21.15.43:0/1797272278 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f74740946f0 con 0x7f746c153690 2024-04-24T23:00:36.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.539+0000 7f746affd640 1 --2- 172.21.15.43:0/1797272278 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f74580678c0 0x7f7458069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:36.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.539+0000 7f747b3a2640 1 -- 172.21.15.43:0/1797272278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746c0c0160 con 0x7f746c153690 2024-04-24T23:00:36.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.539+0000 7f746affd640 1 -- 172.21.15.43:0/1797272278 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f74740d65a0 con 0x7f746c153690 2024-04-24T23:00:36.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.539+0000 7f747a3a0640 1 --2- 172.21.15.43:0/1797272278 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f74580678c0 0x7f7458069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:36.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.539+0000 7f747a3a0640 1 --2- 172.21.15.43:0/1797272278 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f74580678c0 0x7f7458069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7464009a20 tx=0x7f74640a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:36.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.539+0000 7f747b3a2640 1 -- 172.21.15.43:0/1797272278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f746c0053a0 con 0x7f746c153690 2024-04-24T23:00:36.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.547+0000 7f746affd640 1 -- 172.21.15.43:0/1797272278 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f74740d8500 con 0x7f746c153690 2024-04-24T23:00:36.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.747+0000 7f4245454640 1 -- 172.21.15.43:0/2710787425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4220005590 con 0x7f424006d360 2024-04-24T23:00:36.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.747+0000 7f42277fe640 1 -- 172.21.15.43:0/2710787425 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4230059800 con 0x7f424006d360 2024-04-24T23:00:36.755 INFO:teuthology.orchestra.run.smithi043.stdout:60129542153 2024-04-24T23:00:36.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.755+0000 7f42257fa640 1 -- 172.21.15.43:0/2710787425 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4228067e70 msgr2=0x7f422806a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.755+0000 7f42257fa640 1 --2- 172.21.15.43:0/2710787425 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4228067e70 0x7f422806a330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42380af000 tx=0x7f4238004a50 comp rx=0 tx=0).stop 2024-04-24T23:00:36.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.755+0000 7f42257fa640 1 -- 172.21.15.43:0/2710787425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424006d360 msgr2=0x7f42400722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.755+0000 7f42257fa640 1 --2- 172.21.15.43:0/2710787425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424006d360 0x7f42400722c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f423000c500 tx=0x7f423000c9c0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.755+0000 7f42257fa640 1 -- 172.21.15.43:0/2710787425 shutdown_connections 2024-04-24T23:00:36.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.755+0000 7f42257fa640 1 --2- 172.21.15.43:0/2710787425 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4228067e70 0x7f422806a330 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.755+0000 7f42257fa640 1 --2- 172.21.15.43:0/2710787425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4240146330 0x7f4240143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.755+0000 7f42257fa640 1 --2- 172.21.15.43:0/2710787425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42400b47e0 0x7f42401452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.755+0000 7f42257fa640 1 --2- 172.21.15.43:0/2710787425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424006d360 0x7f42400722c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.755+0000 7f42257fa640 1 -- 172.21.15.43:0/2710787425 >> 172.21.15.43:0/2710787425 conn(0x7f42400b5670 msgr2=0x7f42400b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.755+0000 7f42257fa640 1 -- 172.21.15.43:0/2710787425 shutdown_connections 2024-04-24T23:00:36.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.755+0000 7f42257fa640 1 -- 172.21.15.43:0/2710787425 wait complete. 2024-04-24T23:00:36.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.6 2024-04-24T23:00:36.783 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:36.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.799+0000 7f4113fff640 1 -- 172.21.15.43:0/846648827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f411406cbc0 con 0x7f4114157b50 2024-04-24T23:00:36.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.799+0000 7f40fb7fe640 1 -- 172.21.15.43:0/846648827 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f411415b380 con 0x7f4114157b50 2024-04-24T23:00:36.806 INFO:teuthology.orchestra.run.smithi043.stdout:64424509449 2024-04-24T23:00:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.803+0000 7f4113fff640 1 -- 172.21.15.43:0/846648827 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f41000678c0 msgr2=0x7f4100069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.803+0000 7f4113fff640 1 --2- 172.21.15.43:0/846648827 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f41000678c0 0x7f4100069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f41040b2000 tx=0x7f4104004740 comp rx=0 tx=0).stop 2024-04-24T23:00:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.803+0000 7f4113fff640 1 -- 172.21.15.43:0/846648827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4114157b50 msgr2=0x7f411415ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.803+0000 7f4113fff640 1 --2- 172.21.15.43:0/846648827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4114157b50 0x7f411415ae40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f410800c450 tx=0x7f410800c910 comp rx=0 tx=0).stop 2024-04-24T23:00:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.803+0000 7f4113fff640 1 -- 172.21.15.43:0/846648827 shutdown_connections 2024-04-24T23:00:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.803+0000 7f4113fff640 1 --2- 172.21.15.43:0/846648827 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f41000678c0 0x7f4100069d80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.803+0000 7f4113fff640 1 --2- 172.21.15.43:0/846648827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f411415ca60 0x7f4114158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.803+0000 7f4113fff640 1 --2- 172.21.15.43:0/846648827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4114157b50 0x7f411415ae40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.803+0000 7f4113fff640 1 --2- 172.21.15.43:0/846648827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41140b1090 0x7f411415a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.803+0000 7f4113fff640 1 -- 172.21.15.43:0/846648827 >> 172.21.15.43:0/846648827 conn(0x7f411406c640 msgr2=0x7f41140b9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.803+0000 7f4113fff640 1 -- 172.21.15.43:0/846648827 shutdown_connections 2024-04-24T23:00:36.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.803+0000 7f4113fff640 1 -- 172.21.15.43:0/846648827 wait complete. 2024-04-24T23:00:36.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.815+0000 7fc7132b3640 1 -- 172.21.15.43:0/1128669567 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc7040c3440 con 0x7fc7040bc220 2024-04-24T23:00:36.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.815+0000 7fc702ffd640 1 -- 172.21.15.43:0/1128669567 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc70c16a480 con 0x7fc7040bc220 2024-04-24T23:00:36.823 INFO:teuthology.orchestra.run.smithi043.stdout:64424509448 2024-04-24T23:00:36.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.819+0000 7fc7132b3640 1 -- 172.21.15.43:0/1128669567 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc6f00678f0 msgr2=0x7fc6f0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.819+0000 7fc7132b3640 1 --2- 172.21.15.43:0/1128669567 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc6f00678f0 0x7fc6f0069db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc007fd0 tx=0x7fc6fc009040 comp rx=0 tx=0).stop 2024-04-24T23:00:36.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.819+0000 7fc7132b3640 1 -- 172.21.15.43:0/1128669567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7040bc220 msgr2=0x7fc7040c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.819+0000 7fc7132b3640 1 --2- 172.21.15.43:0/1128669567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7040bc220 0x7fc7040c4700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc70c000b70 tx=0x7fc70c0948f0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.819+0000 7fc7132b3640 1 -- 172.21.15.43:0/1128669567 shutdown_connections 2024-04-24T23:00:36.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.819+0000 7fc7132b3640 1 --2- 172.21.15.43:0/1128669567 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc6f00678f0 0x7fc6f0069db0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.819+0000 7fc7132b3640 1 --2- 172.21.15.43:0/1128669567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7040bc220 0x7fc7040c4700 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.819+0000 7fc7132b3640 1 --2- 172.21.15.43:0/1128669567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7040385f0 0x7fc7040c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.819+0000 7fc7132b3640 1 --2- 172.21.15.43:0/1128669567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc704034370 0x7fc7040bbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.819+0000 7fc7132b3640 1 -- 172.21.15.43:0/1128669567 >> 172.21.15.43:0/1128669567 conn(0x7fc70403abd0 msgr2=0x7fc704005de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.819+0000 7fc7132b3640 1 -- 172.21.15.43:0/1128669567 shutdown_connections 2024-04-24T23:00:36.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.819+0000 7fc7132b3640 1 -- 172.21.15.43:0/1128669567 wait complete. 2024-04-24T23:00:36.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-04-24T23:00:36.832 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:36.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.831+0000 7f3a75bae640 1 -- 172.21.15.43:0/2245239221 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3a700b1a00 con 0x7f3a580039c0 2024-04-24T23:00:36.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.831+0000 7f07cbc2a640 1 -- 172.21.15.43:0/1913676507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f07c406c020 con 0x7f07c41db480 2024-04-24T23:00:36.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.831+0000 7f07ba7fc640 1 -- 172.21.15.43:0/1913676507 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f07bc010040 con 0x7f07c41db480 2024-04-24T23:00:36.838 INFO:teuthology.orchestra.run.smithi043.stdout:64424509449 2024-04-24T23:00:36.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.831+0000 7f3a6d7fa640 1 -- 172.21.15.43:0/2245239221 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3a60016980 con 0x7f3a580039c0 2024-04-24T23:00:36.839 INFO:teuthology.orchestra.run.smithi043.stdout:64424509448 2024-04-24T23:00:36.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f07cbc2a640 1 -- 172.21.15.43:0/1913676507 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f07a80678f0 msgr2=0x7f07a8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f07cbc2a640 1 --2- 172.21.15.43:0/1913676507 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f07a80678f0 0x7f07a8069db0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f07c00aa000 tx=0x7f07c40b6cd0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f07cbc2a640 1 -- 172.21.15.43:0/1913676507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07c41db480 msgr2=0x7f07c413ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f07cbc2a640 1 --2- 172.21.15.43:0/1913676507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07c41db480 0x7f07c413ad10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00ef90 tx=0x7f07bc009f90 comp rx=0 tx=0).stop 2024-04-24T23:00:36.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f07cbc2a640 1 -- 172.21.15.43:0/1913676507 shutdown_connections 2024-04-24T23:00:36.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f07cbc2a640 1 --2- 172.21.15.43:0/1913676507 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f07a80678f0 0x7f07a8069db0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f07cbc2a640 1 --2- 172.21.15.43:0/1913676507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07c413b250 0x7f07c41dea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f07cbc2a640 1 --2- 172.21.15.43:0/1913676507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07c41db480 0x7f07c413ad10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f07cbc2a640 1 --2- 172.21.15.43:0/1913676507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0003a10 0x7f07c40b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f07cbc2a640 1 -- 172.21.15.43:0/1913676507 >> 172.21.15.43:0/1913676507 conn(0x7f07c40b7880 msgr2=0x7f07c40b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f07cbc2a640 1 -- 172.21.15.43:0/1913676507 shutdown_connections 2024-04-24T23:00:36.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f07cbc2a640 1 -- 172.21.15.43:0/1913676507 wait complete. 2024-04-24T23:00:36.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2024-04-24T23:00:36.843 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:36.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f3a75bae640 1 -- 172.21.15.43:0/2245239221 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3a5c0678c0 msgr2=0x7f3a5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f3a75bae640 1 --2- 172.21.15.43:0/2245239221 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3a5c0678c0 0x7f3a5c069d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3a64001130 tx=0x7f3a64001e10 comp rx=0 tx=0).stop 2024-04-24T23:00:36.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f3a75bae640 1 -- 172.21.15.43:0/2245239221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a580039c0 msgr2=0x7f3a70147f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f3a75bae640 1 --2- 172.21.15.43:0/2245239221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a580039c0 0x7f3a70147f00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3a6001ca70 tx=0x7f3a58005840 comp rx=0 tx=0).stop 2024-04-24T23:00:36.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f3a75bae640 1 -- 172.21.15.43:0/2245239221 shutdown_connections 2024-04-24T23:00:36.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f3a75bae640 1 --2- 172.21.15.43:0/2245239221 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f3a5c0678c0 0x7f3a5c069d80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f3a75bae640 1 --2- 172.21.15.43:0/2245239221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a700b31f0 0x7f3a700b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f3a75bae640 1 --2- 172.21.15.43:0/2245239221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a7014dd90 0x7f3a701e4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f3a75bae640 1 --2- 172.21.15.43:0/2245239221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a580039c0 0x7f3a70147f00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f3a75bae640 1 -- 172.21.15.43:0/2245239221 >> 172.21.15.43:0/2245239221 conn(0x7f3a700b63b0 msgr2=0x7f3a70144130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f3a75bae640 1 -- 172.21.15.43:0/2245239221 shutdown_connections 2024-04-24T23:00:36.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.835+0000 7f3a75bae640 1 -- 172.21.15.43:0/2245239221 wait complete. 2024-04-24T23:00:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.851+0000 7fe673b86640 1 -- 172.21.15.43:0/591757088 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe654005860 con 0x7fe66c0b2dc0 2024-04-24T23:00:36.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.851+0000 7fe6627fc640 1 -- 172.21.15.43:0/591757088 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe66805a9e0 con 0x7fe66c0b2dc0 2024-04-24T23:00:36.856 INFO:teuthology.orchestra.run.smithi043.stdout:64424509448 2024-04-24T23:00:36.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2024-04-24T23:00:36.858 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.851+0000 7fe673b86640 1 -- 172.21.15.43:0/591757088 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe6500678c0 msgr2=0x7fe650069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.851+0000 7fe673b86640 1 --2- 172.21.15.43:0/591757088 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe6500678c0 0x7fe650069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0b2000 tx=0x7fe65c00a040 comp rx=0 tx=0).stop 2024-04-24T23:00:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.851+0000 7fe673b86640 1 -- 172.21.15.43:0/591757088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe66c0b2dc0 msgr2=0x7fe66c09d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.851+0000 7fe673b86640 1 --2- 172.21.15.43:0/591757088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe66c0b2dc0 0x7fe66c09d690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe66800d5f0 tx=0x7fe66800dab0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.851+0000 7fe673b86640 1 -- 172.21.15.43:0/591757088 shutdown_connections 2024-04-24T23:00:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.851+0000 7fe673b86640 1 --2- 172.21.15.43:0/591757088 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe6500678c0 0x7fe650069d80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.851+0000 7fe673b86640 1 --2- 172.21.15.43:0/591757088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe66c0b47e0 0x7fe66c1f9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.851+0000 7fe673b86640 1 --2- 172.21.15.43:0/591757088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe66c0b2dc0 0x7fe66c09d690 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.851+0000 7fe673b86640 1 --2- 172.21.15.43:0/591757088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe66c06c5d0 0x7fe66c15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.851+0000 7fe673b86640 1 -- 172.21.15.43:0/591757088 >> 172.21.15.43:0/591757088 conn(0x7fe66c0b5670 msgr2=0x7fe66c0b82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.851+0000 7fe673b86640 1 -- 172.21.15.43:0/591757088 shutdown_connections 2024-04-24T23:00:36.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.851+0000 7fe673b86640 1 -- 172.21.15.43:0/591757088 wait complete. 2024-04-24T23:00:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.855+0000 7f921e4e9640 1 -- 172.21.15.43:0/309111025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f921003a1c0 con 0x7f92100daf60 2024-04-24T23:00:36.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.855+0000 7f9214ff9640 1 -- 172.21.15.43:0/309111025 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f92180d6240 con 0x7f92100daf60 2024-04-24T23:00:36.861 INFO:teuthology.orchestra.run.smithi043.stdout:64424509449 2024-04-24T23:00:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.855+0000 7f921e4e9640 1 -- 172.21.15.43:0/309111025 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f91fc067910 msgr2=0x7f91fc069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.855+0000 7f921e4e9640 1 --2- 172.21.15.43:0/309111025 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f91fc067910 0x7f91fc069dd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f92040047c0 tx=0x7f9204008040 comp rx=0 tx=0).stop 2024-04-24T23:00:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.855+0000 7f921e4e9640 1 -- 172.21.15.43:0/309111025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92100daf60 msgr2=0x7f921016cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.855+0000 7f921e4e9640 1 --2- 172.21.15.43:0/309111025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92100daf60 0x7f921016cbf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9218062db0 tx=0x7f92180716e0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.855+0000 7f921e4e9640 1 -- 172.21.15.43:0/309111025 shutdown_connections 2024-04-24T23:00:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.855+0000 7f921e4e9640 1 --2- 172.21.15.43:0/309111025 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f91fc067910 0x7f91fc069dd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.855+0000 7f921e4e9640 1 --2- 172.21.15.43:0/309111025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92100daf60 0x7f921016cbf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.855+0000 7f921e4e9640 1 --2- 172.21.15.43:0/309111025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92100d4ed0 0x7f92100da110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.855+0000 7f921e4e9640 1 --2- 172.21.15.43:0/309111025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92100d4af0 0x7f92100d9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.855+0000 7f921e4e9640 1 -- 172.21.15.43:0/309111025 >> 172.21.15.43:0/309111025 conn(0x7f92100061b0 msgr2=0x7f9210041520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.855+0000 7f921e4e9640 1 -- 172.21.15.43:0/309111025 shutdown_connections 2024-04-24T23:00:36.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.855+0000 7f921e4e9640 1 -- 172.21.15.43:0/309111025 wait complete. 2024-04-24T23:00:36.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2024-04-24T23:00:36.869 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:36.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.871+0000 7f747b3a2640 1 -- 172.21.15.43:0/1797272278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f746c153be0 con 0x7f746c153690 2024-04-24T23:00:36.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.871+0000 7f746affd640 1 -- 172.21.15.43:0/1797272278 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f74740dc800 con 0x7f746c153690 2024-04-24T23:00:36.876 INFO:teuthology.orchestra.run.smithi043.stdout:55834574857 2024-04-24T23:00:36.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.0 2024-04-24T23:00:36.877 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:36.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.871+0000 7f747b3a2640 1 -- 172.21.15.43:0/1797272278 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f74580678c0 msgr2=0x7f7458069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.871+0000 7f747b3a2640 1 --2- 172.21.15.43:0/1797272278 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f74580678c0 0x7f7458069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7464009a20 tx=0x7f74640a6000 comp rx=0 tx=0).stop 2024-04-24T23:00:36.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.871+0000 7f747b3a2640 1 -- 172.21.15.43:0/1797272278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c153690 msgr2=0x7f746c1547f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:36.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.871+0000 7f747b3a2640 1 --2- 172.21.15.43:0/1797272278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c153690 0x7f746c1547f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f74740757d0 tx=0x7f7474070ba0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.871+0000 7f747b3a2640 1 -- 172.21.15.43:0/1797272278 shutdown_connections 2024-04-24T23:00:36.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.871+0000 7f747b3a2640 1 --2- 172.21.15.43:0/1797272278 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f74580678c0 0x7f7458069d80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.871+0000 7f747b3a2640 1 --2- 172.21.15.43:0/1797272278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c153690 0x7f746c1547f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.871+0000 7f747b3a2640 1 --2- 172.21.15.43:0/1797272278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746c0c8600 0x7f746c14fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.871+0000 7f747b3a2640 1 --2- 172.21.15.43:0/1797272278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746c033d00 0x7f746c1624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:36.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.871+0000 7f747b3a2640 1 -- 172.21.15.43:0/1797272278 >> 172.21.15.43:0/1797272278 conn(0x7f746c03a860 msgr2=0x7f746c006650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:36.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.871+0000 7f747b3a2640 1 -- 172.21.15.43:0/1797272278 shutdown_connections 2024-04-24T23:00:36.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:36.871+0000 7f747b3a2640 1 -- 172.21.15.43:0/1797272278 wait complete. 2024-04-24T23:00:36.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.1 2024-04-24T23:00:36.880 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:36.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-04-24T23:00:36.893 DEBUG:teuthology.parallel:result is None 2024-04-24T23:00:36.893 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T23:00:36.893 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:00:37.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.035+0000 7f1c51887640 1 Processor -- start 2024-04-24T23:00:37.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.035+0000 7f1c51887640 1 -- start start 2024-04-24T23:00:37.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c51887640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1c4c1443b0 0x7f1c4c1434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c51887640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c4c0b2ed0 con 0x7f1c4c0b4080 2024-04-24T23:00:37.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c51887640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c4c0b4460 con 0x7f1c4c0afa00 2024-04-24T23:00:37.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c51887640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f1c4c0b1a10 con 0x7f1c4c1443b0 2024-04-24T23:00:37.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c4b7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1c4c1443b0 0x7f1c4c1434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c4affd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1c4c0b4080 0x7f1c4c143ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54588/0 (socket says 172.21.15.43:54588) 2024-04-24T23:00:37.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c4affd640 1 -- 172.21.15.43:0/2502203743 learned_addr learned my addr 172.21.15.43:0/2502203743 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:37.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c4b7fe640 1 -- 172.21.15.43:0/2502203743 >> v1:172.21.15.162:6789/0 conn(0x7f1c4c0afa00 legacy=0x7f1c4c142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c4b7fe640 1 -- 172.21.15.43:0/2502203743 >> v1:172.21.15.43:6789/0 conn(0x7f1c4c0b4080 legacy=0x7f1c4c143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c4b7fe640 1 -- 172.21.15.43:0/2502203743 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4c0b1c60 con 0x7f1c4c1443b0 2024-04-24T23:00:37.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c4b7fe640 1 --2- 172.21.15.43:0/2502203743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4c1443b0 0x7f1c4c1434f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1c440097c0 tx=0x7f1c4401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b987e0d9295916df server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c49ffb640 1 -- 172.21.15.43:0/2502203743 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c440b0070 con 0x7f1c4c1443b0 2024-04-24T23:00:37.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c49ffb640 1 -- 172.21.15.43:0/2502203743 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c440ab600 con 0x7f1c4c1443b0 2024-04-24T23:00:37.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c49ffb640 1 -- 172.21.15.43:0/2502203743 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c440ab9d0 con 0x7f1c4c1443b0 2024-04-24T23:00:37.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c51887640 1 -- 172.21.15.43:0/2502203743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4c1443b0 msgr2=0x7f1c4c1434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c51887640 1 --2- 172.21.15.43:0/2502203743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4c1443b0 0x7f1c4c1434f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1c440097c0 tx=0x7f1c4401c410 comp rx=0 tx=0).stop 2024-04-24T23:00:37.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c51887640 1 -- 172.21.15.43:0/2502203743 shutdown_connections 2024-04-24T23:00:37.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.039+0000 7f1c51887640 1 --2- 172.21.15.43:0/2502203743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4c1443b0 0x7f1c4c1434f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c51887640 1 -- 172.21.15.43:0/2502203743 >> 172.21.15.43:0/2502203743 conn(0x7f1c4c0b5690 msgr2=0x7f1c4c0b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:37.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c51887640 1 -- 172.21.15.43:0/2502203743 shutdown_connections 2024-04-24T23:00:37.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c51887640 1 -- 172.21.15.43:0/2502203743 wait complete. 2024-04-24T23:00:37.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c51887640 1 Processor -- start 2024-04-24T23:00:37.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c51887640 1 -- start start 2024-04-24T23:00:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c51887640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c4c0afa00 0x7f1c4c1e11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c51887640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c4c0b4080 0x7f1c4c13f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c51887640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4c1443b0 0x7f1c4c140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c51887640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c152570 con 0x7f1c4c1443b0 2024-04-24T23:00:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c51887640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c1523f0 con 0x7f1c4c0afa00 2024-04-24T23:00:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c51887640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1c4c1526f0 con 0x7f1c4c0b4080 2024-04-24T23:00:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c4b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4c1443b0 0x7f1c4c140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c4b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4c1443b0 0x7f1c4c140400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43128/0 (socket says 172.21.15.43:43128) 2024-04-24T23:00:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c4b7fe640 1 -- 172.21.15.43:0/1918779183 learned_addr learned my addr 172.21.15.43:0/1918779183 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c4affd640 1 --2- 172.21.15.43:0/1918779183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c4c0afa00 0x7f1c4c1e11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c4b7fe640 1 -- 172.21.15.43:0/1918779183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c4c0b4080 msgr2=0x7f1c4c13f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c4b7fe640 1 --2- 172.21.15.43:0/1918779183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c4c0b4080 0x7f1c4c13f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c4b7fe640 1 -- 172.21.15.43:0/1918779183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c4c0afa00 msgr2=0x7f1c4c1e11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c4b7fe640 1 --2- 172.21.15.43:0/1918779183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c4c0afa00 0x7f1c4c1e11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c4b7fe640 1 -- 172.21.15.43:0/1918779183 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4c141eb0 con 0x7f1c4c1443b0 2024-04-24T23:00:37.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c4b7fe640 1 --2- 172.21.15.43:0/1918779183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4c1443b0 0x7f1c4c140400 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1c440ae040 tx=0x7f1c440191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c33fff640 1 -- 172.21.15.43:0/1918779183 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c440b8020 con 0x7f1c4c1443b0 2024-04-24T23:00:37.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c33fff640 1 -- 172.21.15.43:0/1918779183 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c440b4410 con 0x7f1c4c1443b0 2024-04-24T23:00:37.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c33fff640 1 -- 172.21.15.43:0/1918779183 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c440b0040 con 0x7f1c4c1443b0 2024-04-24T23:00:37.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c51887640 1 -- 172.21.15.43:0/1918779183 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4c13e130 con 0x7f1c4c1443b0 2024-04-24T23:00:37.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c51887640 1 -- 172.21.15.43:0/1918779183 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c4c0aed20 con 0x7f1c4c1443b0 2024-04-24T23:00:37.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.043+0000 7f1c51887640 1 -- 172.21.15.43:0/1918779183 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4c04f580 con 0x7f1c4c1443b0 2024-04-24T23:00:37.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.047+0000 7f1c33fff640 1 -- 172.21.15.43:0/1918779183 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c440bb020 con 0x7f1c4c1443b0 2024-04-24T23:00:37.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.047+0000 7f1c33fff640 1 --2- 172.21.15.43:0/1918779183 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1c380678c0 0x7f1c38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.047+0000 7f1c33fff640 1 -- 172.21.15.43:0/1918779183 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1c4411fc10 con 0x7f1c4c1443b0 2024-04-24T23:00:37.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.047+0000 7f1c4affd640 1 --2- 172.21.15.43:0/1918779183 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1c380678c0 0x7f1c38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.047+0000 7f1c4affd640 1 --2- 172.21.15.43:0/1918779183 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1c380678c0 0x7f1c38069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c005c10 tx=0x7f1c3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.051+0000 7f1c33fff640 1 -- 172.21.15.43:0/1918779183 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f1c440c2030 con 0x7f1c4c1443b0 2024-04-24T23:00:37.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.199+0000 7f1c51887640 1 -- 172.21.15.43:0/1918779183 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1c4c0b6560 con 0x7f1c380678c0 2024-04-24T23:00:37.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.223+0000 7f1c33fff640 1 -- 172.21.15.43:0/1918779183 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332607 (secure 0 0 0) 0x7f1c4c0b6560 con 0x7f1c380678c0 2024-04-24T23:00:37.232 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:37.234 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-24T23:00:37.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.227+0000 7f1c51887640 1 -- 172.21.15.43:0/1918779183 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1c380678c0 msgr2=0x7f1c38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.227+0000 7f1c51887640 1 --2- 172.21.15.43:0/1918779183 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1c380678c0 0x7f1c38069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c005c10 tx=0x7f1c3c009040 comp rx=0 tx=0).stop 2024-04-24T23:00:37.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.227+0000 7f1c51887640 1 -- 172.21.15.43:0/1918779183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4c1443b0 msgr2=0x7f1c4c140400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.227+0000 7f1c51887640 1 --2- 172.21.15.43:0/1918779183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4c1443b0 0x7f1c4c140400 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1c440ae040 tx=0x7f1c440191b0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.227+0000 7f1c51887640 1 -- 172.21.15.43:0/1918779183 shutdown_connections 2024-04-24T23:00:37.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.227+0000 7f1c51887640 1 --2- 172.21.15.43:0/1918779183 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f1c380678c0 0x7f1c38069d80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.227+0000 7f1c51887640 1 --2- 172.21.15.43:0/1918779183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c4c1443b0 0x7f1c4c140400 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.227+0000 7f1c51887640 1 --2- 172.21.15.43:0/1918779183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c4c0b4080 0x7f1c4c13f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.227+0000 7f1c51887640 1 --2- 172.21.15.43:0/1918779183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c4c0afa00 0x7f1c4c1e11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.227+0000 7f1c51887640 1 -- 172.21.15.43:0/1918779183 >> 172.21.15.43:0/1918779183 conn(0x7f1c4c0b5690 msgr2=0x7f1c4c1512e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:37.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.227+0000 7f1c51887640 1 -- 172.21.15.43:0/1918779183 shutdown_connections 2024-04-24T23:00:37.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.227+0000 7f1c51887640 1 -- 172.21.15.43:0/1918779183 wait complete. 2024-04-24T23:00:37.249 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-24T23:00:36.267708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235020,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739700,"statfs":{"total":773094113280,"available":772853452800,"internally_reserved":0,"allocated":2260992,"data_stored":2002040,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004482"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492662+0000","last_change":"2024-04-24T23:00:15.425241+0000","last_active":"2024-04-24T23:00:21.492662+0000","last_peered":"2024-04-24T23:00:21.492662+0000","last_clean":"2024-04-24T23:00:21.492662+0000","last_became_active":"2024-04-24T23:00:15.417152+0000","last_became_peered":"2024-04-24T23:00:15.417152+0000","last_unstale":"2024-04-24T23:00:21.492662+0000","last_undegraded":"2024-04-24T23:00:21.492662+0000","last_fullsized":"2024-04-24T23:00:21.492662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492334+0000","last_change":"2024-04-24T23:00:16.450360+0000","last_active":"2024-04-24T23:00:21.492334+0000","last_peered":"2024-04-24T23:00:21.492334+0000","last_clean":"2024-04-24T23:00:21.492334+0000","last_became_active":"2024-04-24T23:00:16.449631+0000","last_became_peered":"2024-04-24T23:00:16.449631+0000","last_unstale":"2024-04-24T23:00:21.492334+0000","last_undegraded":"2024-04-24T23:00:21.492334+0000","last_fullsized":"2024-04-24T23:00:21.492334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:03:09.773642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363750+0000","last_change":"2024-04-24T23:00:20.537107+0000","last_active":"2024-04-24T23:00:22.363750+0000","last_peered":"2024-04-24T23:00:22.363750+0000","last_clean":"2024-04-24T23:00:22.363750+0000","last_became_active":"2024-04-24T23:00:20.535916+0000","last_became_peered":"2024-04-24T23:00:20.535916+0000","last_unstale":"2024-04-24T23:00:22.363750+0000","last_undegraded":"2024-04-24T23:00:22.363750+0000","last_fullsized":"2024-04-24T23:00:22.363750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.364772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492571+0000","last_change":"2024-04-24T23:00:15.418251+0000","last_active":"2024-04-24T23:00:21.492571+0000","last_peered":"2024-04-24T23:00:21.492571+0000","last_clean":"2024-04-24T23:00:21.492571+0000","last_became_active":"2024-04-24T23:00:15.417502+0000","last_became_peered":"2024-04-24T23:00:15.417502+0000","last_unstale":"2024-04-24T23:00:21.492571+0000","last_undegraded":"2024-04-24T23:00:21.492571+0000","last_fullsized":"2024-04-24T23:00:21.492571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:50:53.490837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491649+0000","last_change":"2024-04-24T23:00:16.452960+0000","last_active":"2024-04-24T23:00:21.491649+0000","last_peered":"2024-04-24T23:00:21.491649+0000","last_clean":"2024-04-24T23:00:21.491649+0000","last_became_active":"2024-04-24T23:00:16.452212+0000","last_became_peered":"2024-04-24T23:00:16.452212+0000","last_unstale":"2024-04-24T23:00:21.491649+0000","last_undegraded":"2024-04-24T23:00:21.491649+0000","last_fullsized":"2024-04-24T23:00:21.491649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:26.361607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361169+0000","last_change":"2024-04-24T23:00:20.518435+0000","last_active":"2024-04-24T23:00:22.361169+0000","last_peered":"2024-04-24T23:00:22.361169+0000","last_clean":"2024-04-24T23:00:22.361169+0000","last_became_active":"2024-04-24T23:00:20.517975+0000","last_became_peered":"2024-04-24T23:00:20.517975+0000","last_unstale":"2024-04-24T23:00:22.361169+0000","last_undegraded":"2024-04-24T23:00:22.361169+0000","last_fullsized":"2024-04-24T23:00:22.361169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:36.410688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361368+0000","last_change":"2024-04-24T23:00:15.401804+0000","last_active":"2024-04-24T23:00:22.361368+0000","last_peered":"2024-04-24T23:00:22.361368+0000","last_clean":"2024-04-24T23:00:22.361368+0000","last_became_active":"2024-04-24T23:00:15.400064+0000","last_became_peered":"2024-04-24T23:00:15.400064+0000","last_unstale":"2024-04-24T23:00:22.361368+0000","last_undegraded":"2024-04-24T23:00:22.361368+0000","last_fullsized":"2024-04-24T23:00:22.361368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:26.588514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.748494+0000","last_change":"2024-04-24T23:00:16.451873+0000","last_active":"2024-04-24T23:00:21.748494+0000","last_peered":"2024-04-24T23:00:21.748494+0000","last_clean":"2024-04-24T23:00:21.748494+0000","last_became_active":"2024-04-24T23:00:16.451601+0000","last_became_peered":"2024-04-24T23:00:16.451601+0000","last_unstale":"2024-04-24T23:00:21.748494+0000","last_undegraded":"2024-04-24T23:00:21.748494+0000","last_fullsized":"2024-04-24T23:00:21.748494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:14.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361787+0000","last_change":"2024-04-24T23:00:20.518757+0000","last_active":"2024-04-24T23:00:22.361787+0000","last_peered":"2024-04-24T23:00:22.361787+0000","last_clean":"2024-04-24T23:00:22.361787+0000","last_became_active":"2024-04-24T23:00:20.518002+0000","last_became_peered":"2024-04-24T23:00:20.518002+0000","last_unstale":"2024-04-24T23:00:22.361787+0000","last_undegraded":"2024-04-24T23:00:22.361787+0000","last_fullsized":"2024-04-24T23:00:22.361787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361059+0000","last_change":"2024-04-24T23:00:15.398338+0000","last_active":"2024-04-24T23:00:22.361059+0000","last_peered":"2024-04-24T23:00:22.361059+0000","last_clean":"2024-04-24T23:00:22.361059+0000","last_became_active":"2024-04-24T23:00:15.395766+0000","last_became_peered":"2024-04-24T23:00:15.395766+0000","last_unstale":"2024-04-24T23:00:22.361059+0000","last_undegraded":"2024-04-24T23:00:22.361059+0000","last_fullsized":"2024-04-24T23:00:22.361059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:30.228280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487678+0000","last_change":"2024-04-24T23:00:16.458641+0000","last_active":"2024-04-24T23:00:21.487678+0000","last_peered":"2024-04-24T23:00:21.487678+0000","last_clean":"2024-04-24T23:00:21.487678+0000","last_became_active":"2024-04-24T23:00:16.458237+0000","last_became_peered":"2024-04-24T23:00:16.458237+0000","last_unstale":"2024-04-24T23:00:21.487678+0000","last_undegraded":"2024-04-24T23:00:21.487678+0000","last_fullsized":"2024-04-24T23:00:21.487678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:22:17.631542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361245+0000","last_change":"2024-04-24T23:00:20.518742+0000","last_active":"2024-04-24T23:00:22.361245+0000","last_peered":"2024-04-24T23:00:22.361245+0000","last_clean":"2024-04-24T23:00:22.361245+0000","last_became_active":"2024-04-24T23:00:20.518163+0000","last_became_peered":"2024-04-24T23:00:20.518163+0000","last_unstale":"2024-04-24T23:00:22.361245+0000","last_undegraded":"2024-04-24T23:00:22.361245+0000","last_fullsized":"2024-04-24T23:00:22.361245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:35.156511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486896+0000","last_change":"2024-04-24T23:00:16.448014+0000","last_active":"2024-04-24T23:00:21.486896+0000","last_peered":"2024-04-24T23:00:21.486896+0000","last_clean":"2024-04-24T23:00:21.486896+0000","last_became_active":"2024-04-24T23:00:16.447488+0000","last_became_peered":"2024-04-24T23:00:16.447488+0000","last_unstale":"2024-04-24T23:00:21.486896+0000","last_undegraded":"2024-04-24T23:00:21.486896+0000","last_fullsized":"2024-04-24T23:00:21.486896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:29.852278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487660+0000","last_change":"2024-04-24T23:00:15.408781+0000","last_active":"2024-04-24T23:00:21.487660+0000","last_peered":"2024-04-24T23:00:21.487660+0000","last_clean":"2024-04-24T23:00:21.487660+0000","last_became_active":"2024-04-24T23:00:15.408120+0000","last_became_peered":"2024-04-24T23:00:15.408120+0000","last_unstale":"2024-04-24T23:00:21.487660+0000","last_undegraded":"2024-04-24T23:00:21.487660+0000","last_fullsized":"2024-04-24T23:00:21.487660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:38.560562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487495+0000","last_change":"2024-04-24T23:00:20.503964+0000","last_active":"2024-04-24T23:00:21.487495+0000","last_peered":"2024-04-24T23:00:21.487495+0000","last_clean":"2024-04-24T23:00:21.487495+0000","last_became_active":"2024-04-24T23:00:20.501703+0000","last_became_peered":"2024-04-24T23:00:20.501703+0000","last_unstale":"2024-04-24T23:00:21.487495+0000","last_undegraded":"2024-04-24T23:00:21.487495+0000","last_fullsized":"2024-04-24T23:00:21.487495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:40.258673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365366+0000","last_change":"2024-04-24T23:00:16.472987+0000","last_active":"2024-04-24T23:00:22.365366+0000","last_peered":"2024-04-24T23:00:22.365366+0000","last_clean":"2024-04-24T23:00:22.365366+0000","last_became_active":"2024-04-24T23:00:16.472226+0000","last_became_peered":"2024-04-24T23:00:16.472226+0000","last_unstale":"2024-04-24T23:00:22.365366+0000","last_undegraded":"2024-04-24T23:00:22.365366+0000","last_fullsized":"2024-04-24T23:00:22.365366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364010+0000","last_change":"2024-04-24T23:00:15.422963+0000","last_active":"2024-04-24T23:00:22.364010+0000","last_peered":"2024-04-24T23:00:22.364010+0000","last_clean":"2024-04-24T23:00:22.364010+0000","last_became_active":"2024-04-24T23:00:15.422121+0000","last_became_peered":"2024-04-24T23:00:15.422121+0000","last_unstale":"2024-04-24T23:00:22.364010+0000","last_undegraded":"2024-04-24T23:00:22.364010+0000","last_fullsized":"2024-04-24T23:00:22.364010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360721+0000","last_change":"2024-04-24T23:00:20.540688+0000","last_active":"2024-04-24T23:00:22.360721+0000","last_peered":"2024-04-24T23:00:22.360721+0000","last_clean":"2024-04-24T23:00:22.360721+0000","last_became_active":"2024-04-24T23:00:20.540220+0000","last_became_peered":"2024-04-24T23:00:20.540220+0000","last_unstale":"2024-04-24T23:00:22.360721+0000","last_undegraded":"2024-04-24T23:00:22.360721+0000","last_fullsized":"2024-04-24T23:00:22.360721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:33.931661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489044+0000","last_change":"2024-04-24T23:00:16.488633+0000","last_active":"2024-04-24T23:00:21.489044+0000","last_peered":"2024-04-24T23:00:21.489044+0000","last_clean":"2024-04-24T23:00:21.489044+0000","last_became_active":"2024-04-24T23:00:16.487476+0000","last_became_peered":"2024-04-24T23:00:16.487476+0000","last_unstale":"2024-04-24T23:00:21.489044+0000","last_undegraded":"2024-04-24T23:00:21.489044+0000","last_fullsized":"2024-04-24T23:00:21.489044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:06.907656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489774+0000","last_change":"2024-04-24T23:00:15.397973+0000","last_active":"2024-04-24T23:00:21.489774+0000","last_peered":"2024-04-24T23:00:21.489774+0000","last_clean":"2024-04-24T23:00:21.489774+0000","last_became_active":"2024-04-24T23:00:15.396600+0000","last_became_peered":"2024-04-24T23:00:15.396600+0000","last_unstale":"2024-04-24T23:00:21.489774+0000","last_undegraded":"2024-04-24T23:00:21.489774+0000","last_fullsized":"2024-04-24T23:00:21.489774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:22.932046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364875+0000","last_change":"2024-04-24T23:00:20.511547+0000","last_active":"2024-04-24T23:00:22.364875+0000","last_peered":"2024-04-24T23:00:22.364875+0000","last_clean":"2024-04-24T23:00:22.364875+0000","last_became_active":"2024-04-24T23:00:20.510602+0000","last_became_peered":"2024-04-24T23:00:20.510602+0000","last_unstale":"2024-04-24T23:00:22.364875+0000","last_undegraded":"2024-04-24T23:00:22.364875+0000","last_fullsized":"2024-04-24T23:00:22.364875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:17.847434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486773+0000","last_change":"2024-04-24T23:00:16.483393+0000","last_active":"2024-04-24T23:00:21.486773+0000","last_peered":"2024-04-24T23:00:21.486773+0000","last_clean":"2024-04-24T23:00:21.486773+0000","last_became_active":"2024-04-24T23:00:16.483092+0000","last_became_peered":"2024-04-24T23:00:16.483092+0000","last_unstale":"2024-04-24T23:00:21.486773+0000","last_undegraded":"2024-04-24T23:00:21.486773+0000","last_fullsized":"2024-04-24T23:00:21.486773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:38.429072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360305+0000","last_change":"2024-04-24T23:00:15.398005+0000","last_active":"2024-04-24T23:00:22.360305+0000","last_peered":"2024-04-24T23:00:22.360305+0000","last_clean":"2024-04-24T23:00:22.360305+0000","last_became_active":"2024-04-24T23:00:15.397638+0000","last_became_peered":"2024-04-24T23:00:15.397638+0000","last_unstale":"2024-04-24T23:00:22.360305+0000","last_undegraded":"2024-04-24T23:00:22.360305+0000","last_fullsized":"2024-04-24T23:00:22.360305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362139+0000","last_change":"2024-04-24T23:00:20.505995+0000","last_active":"2024-04-24T23:00:22.362139+0000","last_peered":"2024-04-24T23:00:22.362139+0000","last_clean":"2024-04-24T23:00:22.362139+0000","last_became_active":"2024-04-24T23:00:20.505532+0000","last_became_peered":"2024-04-24T23:00:20.505532+0000","last_unstale":"2024-04-24T23:00:22.362139+0000","last_undegraded":"2024-04-24T23:00:22.362139+0000","last_fullsized":"2024-04-24T23:00:22.362139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:42.508455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491149+0000","last_change":"2024-04-24T23:00:16.484306+0000","last_active":"2024-04-24T23:00:21.491149+0000","last_peered":"2024-04-24T23:00:21.491149+0000","last_clean":"2024-04-24T23:00:21.491149+0000","last_became_active":"2024-04-24T23:00:16.483585+0000","last_became_peered":"2024-04-24T23:00:16.483585+0000","last_unstale":"2024-04-24T23:00:21.491149+0000","last_undegraded":"2024-04-24T23:00:21.491149+0000","last_fullsized":"2024-04-24T23:00:21.491149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:53.051451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488704+0000","last_change":"2024-04-24T23:00:15.421158+0000","last_active":"2024-04-24T23:00:21.488704+0000","last_peered":"2024-04-24T23:00:21.488704+0000","last_clean":"2024-04-24T23:00:21.488704+0000","last_became_active":"2024-04-24T23:00:15.420839+0000","last_became_peered":"2024-04-24T23:00:15.420839+0000","last_unstale":"2024-04-24T23:00:21.488704+0000","last_undegraded":"2024-04-24T23:00:21.488704+0000","last_fullsized":"2024-04-24T23:00:21.488704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:03.276247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361402+0000","last_change":"2024-04-24T23:00:20.519755+0000","last_active":"2024-04-24T23:00:22.361402+0000","last_peered":"2024-04-24T23:00:22.361402+0000","last_clean":"2024-04-24T23:00:22.361402+0000","last_became_active":"2024-04-24T23:00:20.518470+0000","last_became_peered":"2024-04-24T23:00:20.518470+0000","last_unstale":"2024-04-24T23:00:22.361402+0000","last_undegraded":"2024-04-24T23:00:22.361402+0000","last_fullsized":"2024-04-24T23:00:22.361402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:14.639189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492639+0000","last_change":"2024-04-24T23:00:16.464487+0000","last_active":"2024-04-24T23:00:21.492639+0000","last_peered":"2024-04-24T23:00:21.492639+0000","last_clean":"2024-04-24T23:00:21.492639+0000","last_became_active":"2024-04-24T23:00:16.463565+0000","last_became_peered":"2024-04-24T23:00:16.463565+0000","last_unstale":"2024-04-24T23:00:21.492639+0000","last_undegraded":"2024-04-24T23:00:21.492639+0000","last_fullsized":"2024-04-24T23:00:21.492639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491680+0000","last_change":"2024-04-24T23:00:15.400228+0000","last_active":"2024-04-24T23:00:21.491680+0000","last_peered":"2024-04-24T23:00:21.491680+0000","last_clean":"2024-04-24T23:00:21.491680+0000","last_became_active":"2024-04-24T23:00:15.397465+0000","last_became_peered":"2024-04-24T23:00:15.397465+0000","last_unstale":"2024-04-24T23:00:21.491680+0000","last_undegraded":"2024-04-24T23:00:21.491680+0000","last_fullsized":"2024-04-24T23:00:21.491680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488900+0000","last_change":"2024-04-24T23:00:20.516766+0000","last_active":"2024-04-24T23:00:21.488900+0000","last_peered":"2024-04-24T23:00:21.488900+0000","last_clean":"2024-04-24T23:00:21.488900+0000","last_became_active":"2024-04-24T23:00:20.515972+0000","last_became_peered":"2024-04-24T23:00:20.515972+0000","last_unstale":"2024-04-24T23:00:21.488900+0000","last_undegraded":"2024-04-24T23:00:21.488900+0000","last_fullsized":"2024-04-24T23:00:21.488900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365547+0000","last_change":"2024-04-24T23:00:16.480627+0000","last_active":"2024-04-24T23:00:22.365547+0000","last_peered":"2024-04-24T23:00:22.365547+0000","last_clean":"2024-04-24T23:00:22.365547+0000","last_became_active":"2024-04-24T23:00:16.480021+0000","last_became_peered":"2024-04-24T23:00:16.480021+0000","last_unstale":"2024-04-24T23:00:22.365547+0000","last_undegraded":"2024-04-24T23:00:22.365547+0000","last_fullsized":"2024-04-24T23:00:22.365547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:04.285389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488322+0000","last_change":"2024-04-24T23:00:15.428375+0000","last_active":"2024-04-24T23:00:21.488322+0000","last_peered":"2024-04-24T23:00:21.488322+0000","last_clean":"2024-04-24T23:00:21.488322+0000","last_became_active":"2024-04-24T23:00:15.428016+0000","last_became_peered":"2024-04-24T23:00:15.428016+0000","last_unstale":"2024-04-24T23:00:21.488322+0000","last_undegraded":"2024-04-24T23:00:21.488322+0000","last_fullsized":"2024-04-24T23:00:21.488322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:24.759195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363541+0000","last_change":"2024-04-24T23:00:20.535274+0000","last_active":"2024-04-24T23:00:22.363541+0000","last_peered":"2024-04-24T23:00:22.363541+0000","last_clean":"2024-04-24T23:00:22.363541+0000","last_became_active":"2024-04-24T23:00:20.524747+0000","last_became_peered":"2024-04-24T23:00:20.524747+0000","last_unstale":"2024-04-24T23:00:22.363541+0000","last_undegraded":"2024-04-24T23:00:22.363541+0000","last_fullsized":"2024-04-24T23:00:22.363541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.814128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361971+0000","last_change":"2024-04-24T23:00:16.456641+0000","last_active":"2024-04-24T23:00:22.361971+0000","last_peered":"2024-04-24T23:00:22.361971+0000","last_clean":"2024-04-24T23:00:22.361971+0000","last_became_active":"2024-04-24T23:00:16.456268+0000","last_became_peered":"2024-04-24T23:00:16.456268+0000","last_unstale":"2024-04-24T23:00:22.361971+0000","last_undegraded":"2024-04-24T23:00:22.361971+0000","last_fullsized":"2024-04-24T23:00:22.361971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491288+0000","last_change":"2024-04-24T23:00:15.429119+0000","last_active":"2024-04-24T23:00:21.491288+0000","last_peered":"2024-04-24T23:00:21.491288+0000","last_clean":"2024-04-24T23:00:21.491288+0000","last_became_active":"2024-04-24T23:00:15.428374+0000","last_became_peered":"2024-04-24T23:00:15.428374+0000","last_unstale":"2024-04-24T23:00:21.491288+0000","last_undegraded":"2024-04-24T23:00:21.491288+0000","last_fullsized":"2024-04-24T23:00:21.491288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:13:30.412685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363356+0000","last_change":"2024-04-24T23:00:20.535730+0000","last_active":"2024-04-24T23:00:22.363356+0000","last_peered":"2024-04-24T23:00:22.363356+0000","last_clean":"2024-04-24T23:00:22.363356+0000","last_became_active":"2024-04-24T23:00:20.534430+0000","last_became_peered":"2024-04-24T23:00:20.534430+0000","last_unstale":"2024-04-24T23:00:22.363356+0000","last_undegraded":"2024-04-24T23:00:22.363356+0000","last_fullsized":"2024-04-24T23:00:22.363356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:35.156511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360697+0000","last_change":"2024-04-24T23:00:16.444070+0000","last_active":"2024-04-24T23:00:22.360697+0000","last_peered":"2024-04-24T23:00:22.360697+0000","last_clean":"2024-04-24T23:00:22.360697+0000","last_became_active":"2024-04-24T23:00:16.443620+0000","last_became_peered":"2024-04-24T23:00:16.443620+0000","last_unstale":"2024-04-24T23:00:22.360697+0000","last_undegraded":"2024-04-24T23:00:22.360697+0000","last_fullsized":"2024-04-24T23:00:22.360697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:31.077128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487637+0000","last_change":"2024-04-24T23:00:15.422571+0000","last_active":"2024-04-24T23:00:21.487637+0000","last_peered":"2024-04-24T23:00:21.487637+0000","last_clean":"2024-04-24T23:00:21.487637+0000","last_became_active":"2024-04-24T23:00:15.422167+0000","last_became_peered":"2024-04-24T23:00:15.422167+0000","last_unstale":"2024-04-24T23:00:21.487637+0000","last_undegraded":"2024-04-24T23:00:21.487637+0000","last_fullsized":"2024-04-24T23:00:21.487637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:29.417228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365058+0000","last_change":"2024-04-24T23:00:20.540587+0000","last_active":"2024-04-24T23:00:22.365058+0000","last_peered":"2024-04-24T23:00:22.365058+0000","last_clean":"2024-04-24T23:00:22.365058+0000","last_became_active":"2024-04-24T23:00:20.524719+0000","last_became_peered":"2024-04-24T23:00:20.524719+0000","last_unstale":"2024-04-24T23:00:22.365058+0000","last_undegraded":"2024-04-24T23:00:22.365058+0000","last_fullsized":"2024-04-24T23:00:22.365058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488063+0000","last_change":"2024-04-24T23:00:16.471678+0000","last_active":"2024-04-24T23:00:21.488063+0000","last_peered":"2024-04-24T23:00:21.488063+0000","last_clean":"2024-04-24T23:00:21.488063+0000","last_became_active":"2024-04-24T23:00:16.469390+0000","last_became_peered":"2024-04-24T23:00:16.469390+0000","last_unstale":"2024-04-24T23:00:21.488063+0000","last_undegraded":"2024-04-24T23:00:21.488063+0000","last_fullsized":"2024-04-24T23:00:21.488063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:31:59.778549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363883+0000","last_change":"2024-04-24T23:00:15.423024+0000","last_active":"2024-04-24T23:00:22.363883+0000","last_peered":"2024-04-24T23:00:22.363883+0000","last_clean":"2024-04-24T23:00:22.363883+0000","last_became_active":"2024-04-24T23:00:15.422275+0000","last_became_peered":"2024-04-24T23:00:15.422275+0000","last_unstale":"2024-04-24T23:00:22.363883+0000","last_undegraded":"2024-04-24T23:00:22.363883+0000","last_fullsized":"2024-04-24T23:00:22.363883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365241+0000","last_change":"2024-04-24T23:00:20.535131+0000","last_active":"2024-04-24T23:00:22.365241+0000","last_peered":"2024-04-24T23:00:22.365241+0000","last_clean":"2024-04-24T23:00:22.365241+0000","last_became_active":"2024-04-24T23:00:20.534325+0000","last_became_peered":"2024-04-24T23:00:20.534325+0000","last_unstale":"2024-04-24T23:00:22.365241+0000","last_undegraded":"2024-04-24T23:00:22.365241+0000","last_fullsized":"2024-04-24T23:00:22.365241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363140+0000","last_change":"2024-04-24T23:00:16.451991+0000","last_active":"2024-04-24T23:00:22.363140+0000","last_peered":"2024-04-24T23:00:22.363140+0000","last_clean":"2024-04-24T23:00:22.363140+0000","last_became_active":"2024-04-24T23:00:16.451226+0000","last_became_peered":"2024-04-24T23:00:16.451226+0000","last_unstale":"2024-04-24T23:00:22.363140+0000","last_undegraded":"2024-04-24T23:00:22.363140+0000","last_fullsized":"2024-04-24T23:00:22.363140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:30.426371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487107+0000","last_change":"2024-04-24T23:00:15.414535+0000","last_active":"2024-04-24T23:00:21.487107+0000","last_peered":"2024-04-24T23:00:21.487107+0000","last_clean":"2024-04-24T23:00:21.487107+0000","last_became_active":"2024-04-24T23:00:15.414224+0000","last_became_peered":"2024-04-24T23:00:15.414224+0000","last_unstale":"2024-04-24T23:00:21.487107+0000","last_undegraded":"2024-04-24T23:00:21.487107+0000","last_fullsized":"2024-04-24T23:00:21.487107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:30.228280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491178+0000","last_change":"2024-04-24T23:00:20.531159+0000","last_active":"2024-04-24T23:00:21.491178+0000","last_peered":"2024-04-24T23:00:21.491178+0000","last_clean":"2024-04-24T23:00:21.491178+0000","last_became_active":"2024-04-24T23:00:20.530682+0000","last_became_peered":"2024-04-24T23:00:20.530682+0000","last_unstale":"2024-04-24T23:00:21.491178+0000","last_undegraded":"2024-04-24T23:00:21.491178+0000","last_fullsized":"2024-04-24T23:00:21.491178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:45.629364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490334+0000","last_change":"2024-04-24T23:00:16.481649+0000","last_active":"2024-04-24T23:00:21.490334+0000","last_peered":"2024-04-24T23:00:21.490334+0000","last_clean":"2024-04-24T23:00:21.490334+0000","last_became_active":"2024-04-24T23:00:16.477192+0000","last_became_peered":"2024-04-24T23:00:16.477192+0000","last_unstale":"2024-04-24T23:00:21.490334+0000","last_undegraded":"2024-04-24T23:00:21.490334+0000","last_fullsized":"2024-04-24T23:00:21.490334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:13.768051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487760+0000","last_change":"2024-04-24T23:00:15.407927+0000","last_active":"2024-04-24T23:00:21.487760+0000","last_peered":"2024-04-24T23:00:21.487760+0000","last_clean":"2024-04-24T23:00:21.487760+0000","last_became_active":"2024-04-24T23:00:15.407609+0000","last_became_peered":"2024-04-24T23:00:15.407609+0000","last_unstale":"2024-04-24T23:00:21.487760+0000","last_undegraded":"2024-04-24T23:00:21.487760+0000","last_fullsized":"2024-04-24T23:00:21.487760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:13.689340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.747953+0000","last_change":"2024-04-24T23:00:03.344529+0000","last_active":"2024-04-24T23:00:21.747953+0000","last_peered":"2024-04-24T23:00:21.747953+0000","last_clean":"2024-04-24T23:00:21.747953+0000","last_became_active":"2024-04-24T23:00:03.344074+0000","last_became_peered":"2024-04-24T23:00:03.344074+0000","last_unstale":"2024-04-24T23:00:21.747953+0000","last_undegraded":"2024-04-24T23:00:21.747953+0000","last_fullsized":"2024-04-24T23:00:21.747953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:02.322380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:02.322380+0000","last_clean_scrub_stamp":"2024-04-24T23:00:02.322380+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:40.550881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488278+0000","last_change":"2024-04-24T23:00:20.492015+0000","last_active":"2024-04-24T23:00:21.488278+0000","last_peered":"2024-04-24T23:00:21.488278+0000","last_clean":"2024-04-24T23:00:21.488278+0000","last_became_active":"2024-04-24T23:00:20.491092+0000","last_became_peered":"2024-04-24T23:00:20.491092+0000","last_unstale":"2024-04-24T23:00:21.488278+0000","last_undegraded":"2024-04-24T23:00:21.488278+0000","last_fullsized":"2024-04-24T23:00:21.488278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:49:22.306663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487732+0000","last_change":"2024-04-24T23:00:16.448759+0000","last_active":"2024-04-24T23:00:21.487732+0000","last_peered":"2024-04-24T23:00:21.487732+0000","last_clean":"2024-04-24T23:00:21.487732+0000","last_became_active":"2024-04-24T23:00:16.448187+0000","last_became_peered":"2024-04-24T23:00:16.448187+0000","last_unstale":"2024-04-24T23:00:21.487732+0000","last_undegraded":"2024-04-24T23:00:21.487732+0000","last_fullsized":"2024-04-24T23:00:21.487732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:08:59.708506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365797+0000","last_change":"2024-04-24T23:00:15.436270+0000","last_active":"2024-04-24T23:00:22.365797+0000","last_peered":"2024-04-24T23:00:22.365797+0000","last_clean":"2024-04-24T23:00:22.365797+0000","last_became_active":"2024-04-24T23:00:15.425134+0000","last_became_peered":"2024-04-24T23:00:15.425134+0000","last_unstale":"2024-04-24T23:00:22.365797+0000","last_undegraded":"2024-04-24T23:00:22.365797+0000","last_fullsized":"2024-04-24T23:00:22.365797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361374+0000","last_change":"2024-04-24T23:00:20.500617+0000","last_active":"2024-04-24T23:00:22.361374+0000","last_peered":"2024-04-24T23:00:22.361374+0000","last_clean":"2024-04-24T23:00:22.361374+0000","last_became_active":"2024-04-24T23:00:20.500158+0000","last_became_peered":"2024-04-24T23:00:20.500158+0000","last_unstale":"2024-04-24T23:00:22.361374+0000","last_undegraded":"2024-04-24T23:00:22.361374+0000","last_fullsized":"2024-04-24T23:00:22.361374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.814128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360974+0000","last_change":"2024-04-24T23:00:16.471754+0000","last_active":"2024-04-24T23:00:22.360974+0000","last_peered":"2024-04-24T23:00:22.360974+0000","last_clean":"2024-04-24T23:00:22.360974+0000","last_became_active":"2024-04-24T23:00:16.471497+0000","last_became_peered":"2024-04-24T23:00:16.471497+0000","last_unstale":"2024-04-24T23:00:22.360974+0000","last_undegraded":"2024-04-24T23:00:22.360974+0000","last_fullsized":"2024-04-24T23:00:22.360974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:27.760709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491588+0000","last_change":"2024-04-24T23:00:15.406401+0000","last_active":"2024-04-24T23:00:21.491588+0000","last_peered":"2024-04-24T23:00:21.491588+0000","last_clean":"2024-04-24T23:00:21.491588+0000","last_became_active":"2024-04-24T23:00:15.405636+0000","last_became_peered":"2024-04-24T23:00:15.405636+0000","last_unstale":"2024-04-24T23:00:21.491588+0000","last_undegraded":"2024-04-24T23:00:21.491588+0000","last_fullsized":"2024-04-24T23:00:21.491588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:02.654515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491774+0000","last_change":"2024-04-24T23:00:20.502050+0000","last_active":"2024-04-24T23:00:21.491774+0000","last_peered":"2024-04-24T23:00:21.491774+0000","last_clean":"2024-04-24T23:00:21.491774+0000","last_became_active":"2024-04-24T23:00:20.500153+0000","last_became_peered":"2024-04-24T23:00:20.500153+0000","last_unstale":"2024-04-24T23:00:21.491774+0000","last_undegraded":"2024-04-24T23:00:21.491774+0000","last_fullsized":"2024-04-24T23:00:21.491774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:51.285256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361451+0000","last_change":"2024-04-24T23:00:16.446762+0000","last_active":"2024-04-24T23:00:22.361451+0000","last_peered":"2024-04-24T23:00:22.361451+0000","last_clean":"2024-04-24T23:00:22.361451+0000","last_became_active":"2024-04-24T23:00:16.446170+0000","last_became_peered":"2024-04-24T23:00:16.446170+0000","last_unstale":"2024-04-24T23:00:22.361451+0000","last_undegraded":"2024-04-24T23:00:22.361451+0000","last_fullsized":"2024-04-24T23:00:22.361451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.801913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491407+0000","last_change":"2024-04-24T23:00:15.423703+0000","last_active":"2024-04-24T23:00:21.491407+0000","last_peered":"2024-04-24T23:00:21.491407+0000","last_clean":"2024-04-24T23:00:21.491407+0000","last_became_active":"2024-04-24T23:00:15.414863+0000","last_became_peered":"2024-04-24T23:00:15.414863+0000","last_unstale":"2024-04-24T23:00:21.491407+0000","last_undegraded":"2024-04-24T23:00:21.491407+0000","last_fullsized":"2024-04-24T23:00:21.491407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:26.588514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486409+0000","last_change":"2024-04-24T23:00:20.499277+0000","last_active":"2024-04-24T23:00:21.486409+0000","last_peered":"2024-04-24T23:00:21.486409+0000","last_clean":"2024-04-24T23:00:21.486409+0000","last_became_active":"2024-04-24T23:00:20.498802+0000","last_became_peered":"2024-04-24T23:00:20.498802+0000","last_unstale":"2024-04-24T23:00:21.486409+0000","last_undegraded":"2024-04-24T23:00:21.486409+0000","last_fullsized":"2024-04-24T23:00:21.486409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:32.166063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362253+0000","last_change":"2024-04-24T23:00:16.448112+0000","last_active":"2024-04-24T23:00:22.362253+0000","last_peered":"2024-04-24T23:00:22.362253+0000","last_clean":"2024-04-24T23:00:22.362253+0000","last_became_active":"2024-04-24T23:00:16.447838+0000","last_became_peered":"2024-04-24T23:00:16.447838+0000","last_unstale":"2024-04-24T23:00:22.362253+0000","last_undegraded":"2024-04-24T23:00:22.362253+0000","last_fullsized":"2024-04-24T23:00:22.362253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:24.143678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361996+0000","last_change":"2024-04-24T23:00:15.420914+0000","last_active":"2024-04-24T23:00:22.361996+0000","last_peered":"2024-04-24T23:00:22.361996+0000","last_clean":"2024-04-24T23:00:22.361996+0000","last_became_active":"2024-04-24T23:00:15.420590+0000","last_became_peered":"2024-04-24T23:00:15.420590+0000","last_unstale":"2024-04-24T23:00:22.361996+0000","last_undegraded":"2024-04-24T23:00:22.361996+0000","last_fullsized":"2024-04-24T23:00:22.361996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:53.443962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.748466+0000","last_change":"2024-04-24T23:00:20.494192+0000","last_active":"2024-04-24T23:00:21.748466+0000","last_peered":"2024-04-24T23:00:21.748466+0000","last_clean":"2024-04-24T23:00:21.748466+0000","last_became_active":"2024-04-24T23:00:20.493784+0000","last_became_peered":"2024-04-24T23:00:20.493784+0000","last_unstale":"2024-04-24T23:00:21.748466+0000","last_undegraded":"2024-04-24T23:00:21.748466+0000","last_fullsized":"2024-04-24T23:00:21.748466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:10.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486486+0000","last_change":"2024-04-24T23:00:16.452682+0000","last_active":"2024-04-24T23:00:21.486486+0000","last_peered":"2024-04-24T23:00:21.486486+0000","last_clean":"2024-04-24T23:00:21.486486+0000","last_became_active":"2024-04-24T23:00:16.447742+0000","last_became_peered":"2024-04-24T23:00:16.447742+0000","last_unstale":"2024-04-24T23:00:21.486486+0000","last_undegraded":"2024-04-24T23:00:21.486486+0000","last_fullsized":"2024-04-24T23:00:21.486486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.801913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489312+0000","last_change":"2024-04-24T23:00:15.416986+0000","last_active":"2024-04-24T23:00:21.489312+0000","last_peered":"2024-04-24T23:00:21.489312+0000","last_clean":"2024-04-24T23:00:21.489312+0000","last_became_active":"2024-04-24T23:00:15.416198+0000","last_became_peered":"2024-04-24T23:00:15.416198+0000","last_unstale":"2024-04-24T23:00:21.489312+0000","last_undegraded":"2024-04-24T23:00:21.489312+0000","last_fullsized":"2024-04-24T23:00:21.489312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:27.810443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492094+0000","last_change":"2024-04-24T23:00:20.526621+0000","last_active":"2024-04-24T23:00:21.492094+0000","last_peered":"2024-04-24T23:00:21.492094+0000","last_clean":"2024-04-24T23:00:21.492094+0000","last_became_active":"2024-04-24T23:00:20.525782+0000","last_became_peered":"2024-04-24T23:00:20.525782+0000","last_unstale":"2024-04-24T23:00:21.492094+0000","last_undegraded":"2024-04-24T23:00:21.492094+0000","last_fullsized":"2024-04-24T23:00:21.492094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:38:28.209697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.747735+0000","last_change":"2024-04-24T23:00:16.454748+0000","last_active":"2024-04-24T23:00:21.747735+0000","last_peered":"2024-04-24T23:00:21.747735+0000","last_clean":"2024-04-24T23:00:21.747735+0000","last_became_active":"2024-04-24T23:00:16.454031+0000","last_became_peered":"2024-04-24T23:00:16.454031+0000","last_unstale":"2024-04-24T23:00:21.747735+0000","last_undegraded":"2024-04-24T23:00:21.747735+0000","last_fullsized":"2024-04-24T23:00:21.747735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:31.237423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360689+0000","last_change":"2024-04-24T23:00:15.420149+0000","last_active":"2024-04-24T23:00:22.360689+0000","last_peered":"2024-04-24T23:00:22.360689+0000","last_clean":"2024-04-24T23:00:22.360689+0000","last_became_active":"2024-04-24T23:00:15.416688+0000","last_became_peered":"2024-04-24T23:00:15.416688+0000","last_unstale":"2024-04-24T23:00:22.360689+0000","last_undegraded":"2024-04-24T23:00:22.360689+0000","last_fullsized":"2024-04-24T23:00:22.360689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:27.810443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491371+0000","last_change":"2024-04-24T23:00:20.517137+0000","last_active":"2024-04-24T23:00:21.491371+0000","last_peered":"2024-04-24T23:00:21.491371+0000","last_clean":"2024-04-24T23:00:21.491371+0000","last_became_active":"2024-04-24T23:00:20.516152+0000","last_became_peered":"2024-04-24T23:00:20.516152+0000","last_unstale":"2024-04-24T23:00:21.491371+0000","last_undegraded":"2024-04-24T23:00:21.491371+0000","last_fullsized":"2024-04-24T23:00:21.491371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:29.452352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487144+0000","last_change":"2024-04-24T23:00:16.458939+0000","last_active":"2024-04-24T23:00:21.487144+0000","last_peered":"2024-04-24T23:00:21.487144+0000","last_clean":"2024-04-24T23:00:21.487144+0000","last_became_active":"2024-04-24T23:00:16.458081+0000","last_became_peered":"2024-04-24T23:00:16.458081+0000","last_unstale":"2024-04-24T23:00:21.487144+0000","last_undegraded":"2024-04-24T23:00:21.487144+0000","last_fullsized":"2024-04-24T23:00:21.487144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:27.760709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487474+0000","last_change":"2024-04-24T23:00:15.413409+0000","last_active":"2024-04-24T23:00:21.487474+0000","last_peered":"2024-04-24T23:00:21.487474+0000","last_clean":"2024-04-24T23:00:21.487474+0000","last_became_active":"2024-04-24T23:00:15.412847+0000","last_became_peered":"2024-04-24T23:00:15.412847+0000","last_unstale":"2024-04-24T23:00:21.487474+0000","last_undegraded":"2024-04-24T23:00:21.487474+0000","last_fullsized":"2024-04-24T23:00:21.487474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:35.114960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364628+0000","last_change":"2024-04-24T23:00:20.536112+0000","last_active":"2024-04-24T23:00:22.364628+0000","last_peered":"2024-04-24T23:00:22.364628+0000","last_clean":"2024-04-24T23:00:22.364628+0000","last_became_active":"2024-04-24T23:00:20.529427+0000","last_became_peered":"2024-04-24T23:00:20.529427+0000","last_unstale":"2024-04-24T23:00:22.364628+0000","last_undegraded":"2024-04-24T23:00:22.364628+0000","last_fullsized":"2024-04-24T23:00:22.364628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:14.639189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363813+0000","last_change":"2024-04-24T23:00:16.465373+0000","last_active":"2024-04-24T23:00:22.363813+0000","last_peered":"2024-04-24T23:00:22.363813+0000","last_clean":"2024-04-24T23:00:22.363813+0000","last_became_active":"2024-04-24T23:00:16.464653+0000","last_became_peered":"2024-04-24T23:00:16.464653+0000","last_unstale":"2024-04-24T23:00:22.363813+0000","last_undegraded":"2024-04-24T23:00:22.363813+0000","last_fullsized":"2024-04-24T23:00:22.363813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:24.143678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365627+0000","last_change":"2024-04-24T23:00:15.427483+0000","last_active":"2024-04-24T23:00:22.365627+0000","last_peered":"2024-04-24T23:00:22.365627+0000","last_clean":"2024-04-24T23:00:22.365627+0000","last_became_active":"2024-04-24T23:00:15.426641+0000","last_became_peered":"2024-04-24T23:00:15.426641+0000","last_unstale":"2024-04-24T23:00:22.365627+0000","last_undegraded":"2024-04-24T23:00:22.365627+0000","last_fullsized":"2024-04-24T23:00:22.365627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487531+0000","last_change":"2024-04-24T23:00:20.518479+0000","last_active":"2024-04-24T23:00:21.487531+0000","last_peered":"2024-04-24T23:00:21.487531+0000","last_clean":"2024-04-24T23:00:21.487531+0000","last_became_active":"2024-04-24T23:00:20.517950+0000","last_became_peered":"2024-04-24T23:00:20.517950+0000","last_unstale":"2024-04-24T23:00:21.487531+0000","last_undegraded":"2024-04-24T23:00:21.487531+0000","last_fullsized":"2024-04-24T23:00:21.487531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:37:10.220625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361194+0000","last_change":"2024-04-24T23:00:16.456931+0000","last_active":"2024-04-24T23:00:22.361194+0000","last_peered":"2024-04-24T23:00:22.361194+0000","last_clean":"2024-04-24T23:00:22.361194+0000","last_became_active":"2024-04-24T23:00:16.456636+0000","last_became_peered":"2024-04-24T23:00:16.456636+0000","last_unstale":"2024-04-24T23:00:22.361194+0000","last_undegraded":"2024-04-24T23:00:22.361194+0000","last_fullsized":"2024-04-24T23:00:22.361194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:10.559806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:26.746469+0000","last_change":"2024-04-24T23:00:15.428189+0000","last_active":"2024-04-24T23:00:26.746469+0000","last_peered":"2024-04-24T23:00:26.746469+0000","last_clean":"2024-04-24T23:00:26.746469+0000","last_became_active":"2024-04-24T23:00:15.427837+0000","last_became_peered":"2024-04-24T23:00:15.427837+0000","last_unstale":"2024-04-24T23:00:26.746469+0000","last_undegraded":"2024-04-24T23:00:26.746469+0000","last_fullsized":"2024-04-24T23:00:26.746469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490499+0000","last_change":"2024-04-24T23:00:20.501448+0000","last_active":"2024-04-24T23:00:21.490499+0000","last_peered":"2024-04-24T23:00:21.490499+0000","last_clean":"2024-04-24T23:00:21.490499+0000","last_became_active":"2024-04-24T23:00:20.499677+0000","last_became_peered":"2024-04-24T23:00:20.499677+0000","last_unstale":"2024-04-24T23:00:21.490499+0000","last_undegraded":"2024-04-24T23:00:21.490499+0000","last_fullsized":"2024-04-24T23:00:21.490499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:42.508455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487010+0000","last_change":"2024-04-24T23:00:16.453438+0000","last_active":"2024-04-24T23:00:21.487010+0000","last_peered":"2024-04-24T23:00:21.487010+0000","last_clean":"2024-04-24T23:00:21.487010+0000","last_became_active":"2024-04-24T23:00:16.453033+0000","last_became_peered":"2024-04-24T23:00:16.453033+0000","last_unstale":"2024-04-24T23:00:21.487010+0000","last_undegraded":"2024-04-24T23:00:21.487010+0000","last_fullsized":"2024-04-24T23:00:21.487010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:52:36.324979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364820+0000","last_change":"2024-04-24T23:00:15.431369+0000","last_active":"2024-04-24T23:00:22.364820+0000","last_peered":"2024-04-24T23:00:22.364820+0000","last_clean":"2024-04-24T23:00:22.364820+0000","last_became_active":"2024-04-24T23:00:15.430254+0000","last_became_peered":"2024-04-24T23:00:15.430254+0000","last_unstale":"2024-04-24T23:00:22.364820+0000","last_undegraded":"2024-04-24T23:00:22.364820+0000","last_fullsized":"2024-04-24T23:00:22.364820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361853+0000","last_change":"2024-04-24T23:00:20.503369+0000","last_active":"2024-04-24T23:00:22.361853+0000","last_peered":"2024-04-24T23:00:22.361853+0000","last_clean":"2024-04-24T23:00:22.361853+0000","last_became_active":"2024-04-24T23:00:20.502285+0000","last_became_peered":"2024-04-24T23:00:20.502285+0000","last_unstale":"2024-04-24T23:00:22.361853+0000","last_undegraded":"2024-04-24T23:00:22.361853+0000","last_fullsized":"2024-04-24T23:00:22.361853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491903+0000","last_change":"2024-04-24T23:00:16.452958+0000","last_active":"2024-04-24T23:00:21.491903+0000","last_peered":"2024-04-24T23:00:21.491903+0000","last_clean":"2024-04-24T23:00:21.491903+0000","last_became_active":"2024-04-24T23:00:16.451611+0000","last_became_peered":"2024-04-24T23:00:16.451611+0000","last_unstale":"2024-04-24T23:00:21.491903+0000","last_undegraded":"2024-04-24T23:00:21.491903+0000","last_fullsized":"2024-04-24T23:00:21.491903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:06.283705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361667+0000","last_change":"2024-04-24T23:00:15.397614+0000","last_active":"2024-04-24T23:00:22.361667+0000","last_peered":"2024-04-24T23:00:22.361667+0000","last_clean":"2024-04-24T23:00:22.361667+0000","last_became_active":"2024-04-24T23:00:15.397253+0000","last_became_peered":"2024-04-24T23:00:15.397253+0000","last_unstale":"2024-04-24T23:00:22.361667+0000","last_undegraded":"2024-04-24T23:00:22.361667+0000","last_fullsized":"2024-04-24T23:00:22.361667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:38.560562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363337+0000","last_change":"2024-04-24T23:00:20.506736+0000","last_active":"2024-04-24T23:00:22.363337+0000","last_peered":"2024-04-24T23:00:22.363337+0000","last_clean":"2024-04-24T23:00:22.363337+0000","last_became_active":"2024-04-24T23:00:20.505504+0000","last_became_peered":"2024-04-24T23:00:20.505504+0000","last_unstale":"2024-04-24T23:00:22.363337+0000","last_undegraded":"2024-04-24T23:00:22.363337+0000","last_fullsized":"2024-04-24T23:00:22.363337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:10.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362210+0000","last_change":"2024-04-24T23:00:16.451217+0000","last_active":"2024-04-24T23:00:22.362210+0000","last_peered":"2024-04-24T23:00:22.362210+0000","last_clean":"2024-04-24T23:00:22.362210+0000","last_became_active":"2024-04-24T23:00:16.450149+0000","last_became_peered":"2024-04-24T23:00:16.450149+0000","last_unstale":"2024-04-24T23:00:22.362210+0000","last_undegraded":"2024-04-24T23:00:22.362210+0000","last_fullsized":"2024-04-24T23:00:22.362210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:36.124103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.749533+0000","last_change":"2024-04-24T23:00:15.428164+0000","last_active":"2024-04-24T23:00:21.749533+0000","last_peered":"2024-04-24T23:00:21.749533+0000","last_clean":"2024-04-24T23:00:21.749533+0000","last_became_active":"2024-04-24T23:00:15.427857+0000","last_became_peered":"2024-04-24T23:00:15.427857+0000","last_unstale":"2024-04-24T23:00:21.749533+0000","last_undegraded":"2024-04-24T23:00:21.749533+0000","last_fullsized":"2024-04-24T23:00:21.749533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489396+0000","last_change":"2024-04-24T23:00:20.507135+0000","last_active":"2024-04-24T23:00:21.489396+0000","last_peered":"2024-04-24T23:00:21.489396+0000","last_clean":"2024-04-24T23:00:21.489396+0000","last_became_active":"2024-04-24T23:00:20.506257+0000","last_became_peered":"2024-04-24T23:00:20.506257+0000","last_unstale":"2024-04-24T23:00:21.489396+0000","last_undegraded":"2024-04-24T23:00:21.489396+0000","last_fullsized":"2024-04-24T23:00:21.489396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491003+0000","last_change":"2024-04-24T23:00:20.497645+0000","last_active":"2024-04-24T23:00:21.491003+0000","last_peered":"2024-04-24T23:00:21.491003+0000","last_clean":"2024-04-24T23:00:21.491003+0000","last_became_active":"2024-04-24T23:00:20.496598+0000","last_became_peered":"2024-04-24T23:00:20.496598+0000","last_unstale":"2024-04-24T23:00:21.491003+0000","last_undegraded":"2024-04-24T23:00:21.491003+0000","last_fullsized":"2024-04-24T23:00:21.491003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:59.881296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489530+0000","last_change":"2024-04-24T23:00:16.478734+0000","last_active":"2024-04-24T23:00:21.489530+0000","last_peered":"2024-04-24T23:00:21.489530+0000","last_clean":"2024-04-24T23:00:21.489530+0000","last_became_active":"2024-04-24T23:00:16.477474+0000","last_became_peered":"2024-04-24T23:00:16.477474+0000","last_unstale":"2024-04-24T23:00:21.489530+0000","last_undegraded":"2024-04-24T23:00:21.489530+0000","last_fullsized":"2024-04-24T23:00:21.489530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.178504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486799+0000","last_change":"2024-04-24T23:00:15.405948+0000","last_active":"2024-04-24T23:00:21.486799+0000","last_peered":"2024-04-24T23:00:21.486799+0000","last_clean":"2024-04-24T23:00:21.486799+0000","last_became_active":"2024-04-24T23:00:15.405608+0000","last_became_peered":"2024-04-24T23:00:15.405608+0000","last_unstale":"2024-04-24T23:00:21.486799+0000","last_undegraded":"2024-04-24T23:00:21.486799+0000","last_fullsized":"2024-04-24T23:00:21.486799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488596+0000","last_change":"2024-04-24T23:00:20.493810+0000","last_active":"2024-04-24T23:00:21.488596+0000","last_peered":"2024-04-24T23:00:21.488596+0000","last_clean":"2024-04-24T23:00:21.488596+0000","last_became_active":"2024-04-24T23:00:20.492303+0000","last_became_peered":"2024-04-24T23:00:20.492303+0000","last_unstale":"2024-04-24T23:00:21.488596+0000","last_undegraded":"2024-04-24T23:00:21.488596+0000","last_fullsized":"2024-04-24T23:00:21.488596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:58:38.649805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489593+0000","last_change":"2024-04-24T23:00:16.465460+0000","last_active":"2024-04-24T23:00:21.489593+0000","last_peered":"2024-04-24T23:00:21.489593+0000","last_clean":"2024-04-24T23:00:21.489593+0000","last_became_active":"2024-04-24T23:00:16.457311+0000","last_became_peered":"2024-04-24T23:00:16.457311+0000","last_unstale":"2024-04-24T23:00:21.489593+0000","last_undegraded":"2024-04-24T23:00:21.489593+0000","last_fullsized":"2024-04-24T23:00:21.489593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:43:08.876496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363401+0000","last_change":"2024-04-24T23:00:15.436608+0000","last_active":"2024-04-24T23:00:22.363401+0000","last_peered":"2024-04-24T23:00:22.363401+0000","last_clean":"2024-04-24T23:00:22.363401+0000","last_became_active":"2024-04-24T23:00:15.435730+0000","last_became_peered":"2024-04-24T23:00:15.435730+0000","last_unstale":"2024-04-24T23:00:22.363401+0000","last_undegraded":"2024-04-24T23:00:22.363401+0000","last_fullsized":"2024-04-24T23:00:22.363401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487390+0000","last_change":"2024-04-24T23:00:15.417533+0000","last_active":"2024-04-24T23:00:21.487390+0000","last_peered":"2024-04-24T23:00:21.487390+0000","last_clean":"2024-04-24T23:00:21.487390+0000","last_became_active":"2024-04-24T23:00:15.417226+0000","last_became_peered":"2024-04-24T23:00:15.417226+0000","last_unstale":"2024-04-24T23:00:21.487390+0000","last_undegraded":"2024-04-24T23:00:21.487390+0000","last_fullsized":"2024-04-24T23:00:21.487390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:05.898513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490640+0000","last_change":"2024-04-24T23:00:16.483374+0000","last_active":"2024-04-24T23:00:21.490640+0000","last_peered":"2024-04-24T23:00:21.490640+0000","last_clean":"2024-04-24T23:00:21.490640+0000","last_became_active":"2024-04-24T23:00:16.482676+0000","last_became_peered":"2024-04-24T23:00:16.482676+0000","last_unstale":"2024-04-24T23:00:21.490640+0000","last_undegraded":"2024-04-24T23:00:21.490640+0000","last_fullsized":"2024-04-24T23:00:21.490640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:05.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491288+0000","last_change":"2024-04-24T23:00:20.542916+0000","last_active":"2024-04-24T23:00:21.491288+0000","last_peered":"2024-04-24T23:00:21.491288+0000","last_clean":"2024-04-24T23:00:21.491288+0000","last_became_active":"2024-04-24T23:00:20.541822+0000","last_became_peered":"2024-04-24T23:00:20.541822+0000","last_unstale":"2024-04-24T23:00:21.491288+0000","last_undegraded":"2024-04-24T23:00:21.491288+0000","last_fullsized":"2024-04-24T23:00:21.491288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:31.840092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492280+0000","last_change":"2024-04-24T23:00:15.425495+0000","last_active":"2024-04-24T23:00:21.492280+0000","last_peered":"2024-04-24T23:00:21.492280+0000","last_clean":"2024-04-24T23:00:21.492280+0000","last_became_active":"2024-04-24T23:00:15.424739+0000","last_became_peered":"2024-04-24T23:00:15.424739+0000","last_unstale":"2024-04-24T23:00:21.492280+0000","last_undegraded":"2024-04-24T23:00:21.492280+0000","last_fullsized":"2024-04-24T23:00:21.492280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:49.740745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.748176+0000","last_change":"2024-04-24T23:00:16.454250+0000","last_active":"2024-04-24T23:00:21.748176+0000","last_peered":"2024-04-24T23:00:21.748176+0000","last_clean":"2024-04-24T23:00:21.748176+0000","last_became_active":"2024-04-24T23:00:16.453965+0000","last_became_peered":"2024-04-24T23:00:16.453965+0000","last_unstale":"2024-04-24T23:00:21.748176+0000","last_undegraded":"2024-04-24T23:00:21.748176+0000","last_fullsized":"2024-04-24T23:00:21.748176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364268+0000","last_change":"2024-04-24T23:00:20.510475+0000","last_active":"2024-04-24T23:00:22.364268+0000","last_peered":"2024-04-24T23:00:22.364268+0000","last_clean":"2024-04-24T23:00:22.364268+0000","last_became_active":"2024-04-24T23:00:20.509269+0000","last_became_peered":"2024-04-24T23:00:20.509269+0000","last_unstale":"2024-04-24T23:00:22.364268+0000","last_undegraded":"2024-04-24T23:00:22.364268+0000","last_fullsized":"2024-04-24T23:00:22.364268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:09.596902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361286+0000","last_change":"2024-04-24T23:00:16.456976+0000","last_active":"2024-04-24T23:00:22.361286+0000","last_peered":"2024-04-24T23:00:22.361286+0000","last_clean":"2024-04-24T23:00:22.361286+0000","last_became_active":"2024-04-24T23:00:16.456289+0000","last_became_peered":"2024-04-24T23:00:16.456289+0000","last_unstale":"2024-04-24T23:00:22.361286+0000","last_undegraded":"2024-04-24T23:00:22.361286+0000","last_fullsized":"2024-04-24T23:00:22.361286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363709+0000","last_change":"2024-04-24T23:00:16.471774+0000","last_active":"2024-04-24T23:00:22.363709+0000","last_peered":"2024-04-24T23:00:22.363709+0000","last_clean":"2024-04-24T23:00:22.363709+0000","last_became_active":"2024-04-24T23:00:16.466134+0000","last_became_peered":"2024-04-24T23:00:16.466134+0000","last_unstale":"2024-04-24T23:00:22.363709+0000","last_undegraded":"2024-04-24T23:00:22.363709+0000","last_fullsized":"2024-04-24T23:00:22.363709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:31.237423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486774+0000","last_change":"2024-04-24T23:00:16.465926+0000","last_active":"2024-04-24T23:00:21.486774+0000","last_peered":"2024-04-24T23:00:21.486774+0000","last_clean":"2024-04-24T23:00:21.486774+0000","last_became_active":"2024-04-24T23:00:16.465659+0000","last_became_peered":"2024-04-24T23:00:16.465659+0000","last_unstale":"2024-04-24T23:00:21.486774+0000","last_undegraded":"2024-04-24T23:00:21.486774+0000","last_fullsized":"2024-04-24T23:00:21.486774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:09:47.001195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492033+0000","last_change":"2024-04-24T23:00:16.474929+0000","last_active":"2024-04-24T23:00:21.492033+0000","last_peered":"2024-04-24T23:00:21.492033+0000","last_clean":"2024-04-24T23:00:21.492033+0000","last_became_active":"2024-04-24T23:00:16.474181+0000","last_became_peered":"2024-04-24T23:00:16.474181+0000","last_unstale":"2024-04-24T23:00:21.492033+0000","last_undegraded":"2024-04-24T23:00:21.492033+0000","last_fullsized":"2024-04-24T23:00:21.492033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:56.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365315+0000","last_change":"2024-04-24T23:00:16.458411+0000","last_active":"2024-04-24T23:00:22.365315+0000","last_peered":"2024-04-24T23:00:22.365315+0000","last_clean":"2024-04-24T23:00:22.365315+0000","last_became_active":"2024-04-24T23:00:16.457641+0000","last_became_peered":"2024-04-24T23:00:16.457641+0000","last_unstale":"2024-04-24T23:00:22.365315+0000","last_undegraded":"2024-04-24T23:00:22.365315+0000","last_fullsized":"2024-04-24T23:00:22.365315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:06.907656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364328+0000","last_change":"2024-04-24T23:00:16.470324+0000","last_active":"2024-04-24T23:00:22.364328+0000","last_peered":"2024-04-24T23:00:22.364328+0000","last_clean":"2024-04-24T23:00:22.364328+0000","last_became_active":"2024-04-24T23:00:16.469614+0000","last_became_peered":"2024-04-24T23:00:16.469614+0000","last_unstale":"2024-04-24T23:00:22.364328+0000","last_undegraded":"2024-04-24T23:00:22.364328+0000","last_fullsized":"2024-04-24T23:00:22.364328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:05.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362165+0000","last_change":"2024-04-24T23:00:16.450764+0000","last_active":"2024-04-24T23:00:22.362165+0000","last_peered":"2024-04-24T23:00:22.362165+0000","last_clean":"2024-04-24T23:00:22.362165+0000","last_became_active":"2024-04-24T23:00:16.450561+0000","last_became_peered":"2024-04-24T23:00:16.450561+0000","last_unstale":"2024-04-24T23:00:22.362165+0000","last_undegraded":"2024-04-24T23:00:22.362165+0000","last_fullsized":"2024-04-24T23:00:22.362165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:30.426371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490926+0000","last_change":"2024-04-24T23:00:16.453953+0000","last_active":"2024-04-24T23:00:21.490926+0000","last_peered":"2024-04-24T23:00:21.490926+0000","last_clean":"2024-04-24T23:00:21.490926+0000","last_became_active":"2024-04-24T23:00:16.452345+0000","last_became_peered":"2024-04-24T23:00:16.452345+0000","last_unstale":"2024-04-24T23:00:21.490926+0000","last_undegraded":"2024-04-24T23:00:21.490926+0000","last_fullsized":"2024-04-24T23:00:21.490926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:58.273719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486575+0000","last_change":"2024-04-24T23:00:16.459030+0000","last_active":"2024-04-24T23:00:21.486575+0000","last_peered":"2024-04-24T23:00:21.486575+0000","last_clean":"2024-04-24T23:00:21.486575+0000","last_became_active":"2024-04-24T23:00:16.458402+0000","last_became_peered":"2024-04-24T23:00:16.458402+0000","last_unstale":"2024-04-24T23:00:21.486575+0000","last_undegraded":"2024-04-24T23:00:21.486575+0000","last_fullsized":"2024-04-24T23:00:21.486575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:33.558529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488396+0000","last_change":"2024-04-24T23:00:16.456818+0000","last_active":"2024-04-24T23:00:21.488396+0000","last_peered":"2024-04-24T23:00:21.488396+0000","last_clean":"2024-04-24T23:00:21.488396+0000","last_became_active":"2024-04-24T23:00:16.453065+0000","last_became_peered":"2024-04-24T23:00:16.453065+0000","last_unstale":"2024-04-24T23:00:21.488396+0000","last_undegraded":"2024-04-24T23:00:21.488396+0000","last_fullsized":"2024-04-24T23:00:21.488396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:02.728439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.747938+0000","last_change":"2024-04-24T23:00:16.447668+0000","last_active":"2024-04-24T23:00:21.747938+0000","last_peered":"2024-04-24T23:00:21.747938+0000","last_clean":"2024-04-24T23:00:21.747938+0000","last_became_active":"2024-04-24T23:00:16.447370+0000","last_became_peered":"2024-04-24T23:00:16.447370+0000","last_unstale":"2024-04-24T23:00:21.747938+0000","last_undegraded":"2024-04-24T23:00:21.747938+0000","last_fullsized":"2024-04-24T23:00:21.747938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490570+0000","last_change":"2024-04-24T23:00:16.478716+0000","last_active":"2024-04-24T23:00:21.490570+0000","last_peered":"2024-04-24T23:00:21.490570+0000","last_clean":"2024-04-24T23:00:21.490570+0000","last_became_active":"2024-04-24T23:00:16.477982+0000","last_became_peered":"2024-04-24T23:00:16.477982+0000","last_unstale":"2024-04-24T23:00:21.490570+0000","last_undegraded":"2024-04-24T23:00:21.490570+0000","last_fullsized":"2024-04-24T23:00:21.490570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:04.285389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360946+0000","last_change":"2024-04-24T23:00:16.449265+0000","last_active":"2024-04-24T23:00:22.360946+0000","last_peered":"2024-04-24T23:00:22.360946+0000","last_clean":"2024-04-24T23:00:22.360946+0000","last_became_active":"2024-04-24T23:00:16.446583+0000","last_became_peered":"2024-04-24T23:00:16.446583+0000","last_unstale":"2024-04-24T23:00:22.360946+0000","last_undegraded":"2024-04-24T23:00:22.360946+0000","last_fullsized":"2024-04-24T23:00:22.360946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:38.429072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488019+0000","last_change":"2024-04-24T23:00:16.483354+0000","last_active":"2024-04-24T23:00:21.488019+0000","last_peered":"2024-04-24T23:00:21.488019+0000","last_clean":"2024-04-24T23:00:21.488019+0000","last_became_active":"2024-04-24T23:00:16.483079+0000","last_became_peered":"2024-04-24T23:00:16.483079+0000","last_unstale":"2024-04-24T23:00:21.488019+0000","last_undegraded":"2024-04-24T23:00:21.488019+0000","last_fullsized":"2024-04-24T23:00:21.488019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:57:02.861698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364543+0000","last_change":"2024-04-24T23:00:16.472605+0000","last_active":"2024-04-24T23:00:22.364543+0000","last_peered":"2024-04-24T23:00:22.364543+0000","last_clean":"2024-04-24T23:00:22.364543+0000","last_became_active":"2024-04-24T23:00:16.466076+0000","last_became_peered":"2024-04-24T23:00:16.466076+0000","last_unstale":"2024-04-24T23:00:22.364543+0000","last_undegraded":"2024-04-24T23:00:22.364543+0000","last_fullsized":"2024-04-24T23:00:22.364543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488702+0000","last_change":"2024-04-24T23:00:16.457737+0000","last_active":"2024-04-24T23:00:21.488702+0000","last_peered":"2024-04-24T23:00:21.488702+0000","last_clean":"2024-04-24T23:00:21.488702+0000","last_became_active":"2024-04-24T23:00:16.453949+0000","last_became_peered":"2024-04-24T23:00:16.453949+0000","last_unstale":"2024-04-24T23:00:21.488702+0000","last_undegraded":"2024-04-24T23:00:21.488702+0000","last_fullsized":"2024-04-24T23:00:21.488702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:08.928463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486501+0000","last_change":"2024-04-24T23:00:16.452839+0000","last_active":"2024-04-24T23:00:21.486501+0000","last_peered":"2024-04-24T23:00:21.486501+0000","last_clean":"2024-04-24T23:00:21.486501+0000","last_became_active":"2024-04-24T23:00:16.445253+0000","last_became_peered":"2024-04-24T23:00:16.445253+0000","last_unstale":"2024-04-24T23:00:21.486501+0000","last_undegraded":"2024-04-24T23:00:21.486501+0000","last_fullsized":"2024-04-24T23:00:21.486501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:23.938299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488118+0000","last_change":"2024-04-24T23:00:16.455784+0000","last_active":"2024-04-24T23:00:21.488118+0000","last_peered":"2024-04-24T23:00:21.488118+0000","last_clean":"2024-04-24T23:00:21.488118+0000","last_became_active":"2024-04-24T23:00:16.454953+0000","last_became_peered":"2024-04-24T23:00:16.454953+0000","last_unstale":"2024-04-24T23:00:21.488118+0000","last_undegraded":"2024-04-24T23:00:21.488118+0000","last_fullsized":"2024-04-24T23:00:21.488118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:32.545524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363621+0000","last_change":"2024-04-24T23:00:16.468365+0000","last_active":"2024-04-24T23:00:22.363621+0000","last_peered":"2024-04-24T23:00:22.363621+0000","last_clean":"2024-04-24T23:00:22.363621+0000","last_became_active":"2024-04-24T23:00:16.467630+0000","last_became_peered":"2024-04-24T23:00:16.467630+0000","last_unstale":"2024-04-24T23:00:22.363621+0000","last_undegraded":"2024-04-24T23:00:22.363621+0000","last_fullsized":"2024-04-24T23:00:22.363621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363514+0000","last_change":"2024-04-24T23:00:16.456188+0000","last_active":"2024-04-24T23:00:22.363514+0000","last_peered":"2024-04-24T23:00:22.363514+0000","last_clean":"2024-04-24T23:00:22.363514+0000","last_became_active":"2024-04-24T23:00:16.455114+0000","last_became_peered":"2024-04-24T23:00:16.455114+0000","last_unstale":"2024-04-24T23:00:22.363514+0000","last_undegraded":"2024-04-24T23:00:22.363514+0000","last_fullsized":"2024-04-24T23:00:22.363514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:36.124103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360885+0000","last_change":"2024-04-24T23:00:16.450776+0000","last_active":"2024-04-24T23:00:22.360885+0000","last_peered":"2024-04-24T23:00:22.360885+0000","last_clean":"2024-04-24T23:00:22.360885+0000","last_became_active":"2024-04-24T23:00:16.450466+0000","last_became_peered":"2024-04-24T23:00:16.450466+0000","last_unstale":"2024-04-24T23:00:22.360885+0000","last_undegraded":"2024-04-24T23:00:22.360885+0000","last_fullsized":"2024-04-24T23:00:22.360885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:32.331306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361100+0000","last_change":"2024-04-24T23:00:16.450743+0000","last_active":"2024-04-24T23:00:22.361100+0000","last_peered":"2024-04-24T23:00:22.361100+0000","last_clean":"2024-04-24T23:00:22.361100+0000","last_became_active":"2024-04-24T23:00:16.450279+0000","last_became_peered":"2024-04-24T23:00:16.450279+0000","last_unstale":"2024-04-24T23:00:22.361100+0000","last_undegraded":"2024-04-24T23:00:22.361100+0000","last_fullsized":"2024-04-24T23:00:22.361100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:00.869015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361531+0000","last_change":"2024-04-24T23:00:16.446745+0000","last_active":"2024-04-24T23:00:22.361531+0000","last_peered":"2024-04-24T23:00:22.361531+0000","last_clean":"2024-04-24T23:00:22.361531+0000","last_became_active":"2024-04-24T23:00:16.446317+0000","last_became_peered":"2024-04-24T23:00:16.446317+0000","last_unstale":"2024-04-24T23:00:22.361531+0000","last_undegraded":"2024-04-24T23:00:22.361531+0000","last_fullsized":"2024-04-24T23:00:22.361531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:47.110869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.749496+0000","last_change":"2024-04-24T23:00:16.446352+0000","last_active":"2024-04-24T23:00:21.749496+0000","last_peered":"2024-04-24T23:00:21.749496+0000","last_clean":"2024-04-24T23:00:21.749496+0000","last_became_active":"2024-04-24T23:00:16.445839+0000","last_became_peered":"2024-04-24T23:00:16.445839+0000","last_unstale":"2024-04-24T23:00:21.749496+0000","last_undegraded":"2024-04-24T23:00:21.749496+0000","last_fullsized":"2024-04-24T23:00:21.749496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487985+0000","last_change":"2024-04-24T23:00:16.451439+0000","last_active":"2024-04-24T23:00:21.487985+0000","last_peered":"2024-04-24T23:00:21.487985+0000","last_clean":"2024-04-24T23:00:21.487985+0000","last_became_active":"2024-04-24T23:00:16.450293+0000","last_became_peered":"2024-04-24T23:00:16.450293+0000","last_unstale":"2024-04-24T23:00:21.487985+0000","last_undegraded":"2024-04-24T23:00:21.487985+0000","last_fullsized":"2024-04-24T23:00:21.487985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:19.586817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360593+0000","last_change":"2024-04-24T23:00:16.482222+0000","last_active":"2024-04-24T23:00:22.360593+0000","last_peered":"2024-04-24T23:00:22.360593+0000","last_clean":"2024-04-24T23:00:22.360593+0000","last_became_active":"2024-04-24T23:00:16.481897+0000","last_became_peered":"2024-04-24T23:00:16.481897+0000","last_unstale":"2024-04-24T23:00:22.360593+0000","last_undegraded":"2024-04-24T23:00:22.360593+0000","last_fullsized":"2024-04-24T23:00:22.360593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361442+0000","last_change":"2024-04-24T23:00:16.482100+0000","last_active":"2024-04-24T23:00:22.361442+0000","last_peered":"2024-04-24T23:00:22.361442+0000","last_clean":"2024-04-24T23:00:22.361442+0000","last_became_active":"2024-04-24T23:00:16.481832+0000","last_became_peered":"2024-04-24T23:00:16.481832+0000","last_unstale":"2024-04-24T23:00:22.361442+0000","last_undegraded":"2024-04-24T23:00:22.361442+0000","last_fullsized":"2024-04-24T23:00:22.361442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360651+0000","last_change":"2024-04-24T23:00:16.466121+0000","last_active":"2024-04-24T23:00:22.360651+0000","last_peered":"2024-04-24T23:00:22.360651+0000","last_clean":"2024-04-24T23:00:22.360651+0000","last_became_active":"2024-04-24T23:00:16.465749+0000","last_became_peered":"2024-04-24T23:00:16.465749+0000","last_unstale":"2024-04-24T23:00:22.360651+0000","last_undegraded":"2024-04-24T23:00:22.360651+0000","last_fullsized":"2024-04-24T23:00:22.360651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:05.734745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361597+0000","last_change":"2024-04-24T23:00:16.481682+0000","last_active":"2024-04-24T23:00:22.361597+0000","last_peered":"2024-04-24T23:00:22.361597+0000","last_clean":"2024-04-24T23:00:22.361597+0000","last_became_active":"2024-04-24T23:00:16.481381+0000","last_became_peered":"2024-04-24T23:00:16.481381+0000","last_unstale":"2024-04-24T23:00:22.361597+0000","last_undegraded":"2024-04-24T23:00:22.361597+0000","last_fullsized":"2024-04-24T23:00:22.361597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:14.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491105+0000","last_change":"2024-04-24T23:00:16.461984+0000","last_active":"2024-04-24T23:00:21.491105+0000","last_peered":"2024-04-24T23:00:21.491105+0000","last_clean":"2024-04-24T23:00:21.491105+0000","last_became_active":"2024-04-24T23:00:16.461267+0000","last_became_peered":"2024-04-24T23:00:16.461267+0000","last_unstale":"2024-04-24T23:00:21.491105+0000","last_undegraded":"2024-04-24T23:00:21.491105+0000","last_fullsized":"2024-04-24T23:00:21.491105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:53:00.776972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491640+0000","last_change":"2024-04-24T23:00:16.460191+0000","last_active":"2024-04-24T23:00:21.491640+0000","last_peered":"2024-04-24T23:00:21.491640+0000","last_clean":"2024-04-24T23:00:21.491640+0000","last_became_active":"2024-04-24T23:00:16.459445+0000","last_became_peered":"2024-04-24T23:00:16.459445+0000","last_unstale":"2024-04-24T23:00:21.491640+0000","last_undegraded":"2024-04-24T23:00:21.491640+0000","last_fullsized":"2024-04-24T23:00:21.491640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:12.313822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361195+0000","last_change":"2024-04-24T23:00:16.450409+0000","last_active":"2024-04-24T23:00:22.361195+0000","last_peered":"2024-04-24T23:00:22.361195+0000","last_clean":"2024-04-24T23:00:22.361195+0000","last_became_active":"2024-04-24T23:00:16.450061+0000","last_became_peered":"2024-04-24T23:00:16.450061+0000","last_unstale":"2024-04-24T23:00:22.361195+0000","last_undegraded":"2024-04-24T23:00:22.361195+0000","last_fullsized":"2024-04-24T23:00:22.361195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:23.938299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":101627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":102085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":327680,"data_stored":691941,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":101559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":101503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":691963,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:00:37.256 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:00:37.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.395+0000 7f98739c8640 1 Processor -- start 2024-04-24T23:00:37.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.395+0000 7f98739c8640 1 -- start start 2024-04-24T23:00:37.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f98739c8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0733a0 0x7f986c144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f98739c8640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c0b3bd0 con 0x7f986c0b37f0 2024-04-24T23:00:37.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f98739c8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c0b2980 con 0x7f986c0b4fe0 2024-04-24T23:00:37.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f98739c8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f986c0b24f0 con 0x7f986c0733a0 2024-04-24T23:00:37.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9871764640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f986c0b37f0 0x7f986c072820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54594/0 (socket says 172.21.15.43:54594) 2024-04-24T23:00:37.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9871764640 1 -- 172.21.15.43:0/1350890288 learned_addr learned my addr 172.21.15.43:0/1350890288 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:37.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 -- 172.21.15.43:0/1350890288 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2751295614 0 0) 0x7f986c0b3bd0 con 0x7f986c0b37f0 2024-04-24T23:00:37.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9870f63640 1 --2- 172.21.15.43:0/1350890288 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0733a0 0x7f986c144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 -- 172.21.15.43:0/1350890288 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9858003530 con 0x7f986c0b37f0 2024-04-24T23:00:37.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 -- 172.21.15.43:0/1350890288 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1419887074 0 0) 0x7f9858003530 con 0x7f986c0b37f0 2024-04-24T23:00:37.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 -- 172.21.15.43:0/1350890288 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0733a0 msgr2=0x7f986c144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 --2- 172.21.15.43:0/1350890288 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0733a0 0x7f986c144260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 -- 172.21.15.43:0/1350890288 >> v1:172.21.15.162:6789/0 conn(0x7f986c0b4fe0 legacy=0x7f986c14eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 -- 172.21.15.43:0/1350890288 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c06fdd0 con 0x7f986c0b37f0 2024-04-24T23:00:37.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 -- 172.21.15.43:0/1350890288 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f985c001680 con 0x7f986c0b37f0 2024-04-24T23:00:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 -- 172.21.15.43:0/1350890288 >> v1:172.21.15.43:6789/0 conn(0x7f986c0b37f0 legacy=0x7f986c072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 --2- 172.21.15.43:0/1350890288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98580039f0 0x7f9858003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 --2- 172.21.15.43:0/1350890288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9858004810 0x7f9858004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 --2- 172.21.15.43:0/1350890288 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0733a0 0x7f985800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 -- 172.21.15.43:0/1350890288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f986c0b24f0 con 0x7f9858004810 2024-04-24T23:00:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 -- 172.21.15.43:0/1350890288 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9858005530 con 0x7f98580039f0 2024-04-24T23:00:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 -- 172.21.15.43:0/1350890288 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f985800bf10 con 0x7f986c0733a0 2024-04-24T23:00:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9870f63640 1 --2- 172.21.15.43:0/1350890288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9858004810 0x7f9858004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9871764640 1 --2- 172.21.15.43:0/1350890288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98580039f0 0x7f9858003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9870f63640 1 -- 172.21.15.43:0/1350890288 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0733a0 msgr2=0x7f985800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9871f65640 1 --2- 172.21.15.43:0/1350890288 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0733a0 0x7f985800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9870f63640 1 --2- 172.21.15.43:0/1350890288 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0733a0 0x7f985800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9870f63640 1 -- 172.21.15.43:0/1350890288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98580039f0 msgr2=0x7f9858003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9870f63640 1 --2- 172.21.15.43:0/1350890288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98580039f0 0x7f9858003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9870f63640 1 -- 172.21.15.43:0/1350890288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9858003530 con 0x7f9858004810 2024-04-24T23:00:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9871f65640 1 --2- 172.21.15.43:0/1350890288 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0733a0 0x7f985800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:37.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9870f63640 1 --2- 172.21.15.43:0/1350890288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9858004810 0x7f9858004c90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f986800ba30 tx=0x7f986801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618ce544cc0dff9b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 -- 172.21.15.43:0/1350890288 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986800b600 con 0x7f9858004810 2024-04-24T23:00:37.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 -- 172.21.15.43:0/1350890288 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98680b1070 con 0x7f9858004810 2024-04-24T23:00:37.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.399+0000 7f9863fff640 1 -- 172.21.15.43:0/1350890288 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680ac860 con 0x7f9858004810 2024-04-24T23:00:37.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 -- 172.21.15.43:0/1350890288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9858004810 msgr2=0x7f9858004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 --2- 172.21.15.43:0/1350890288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9858004810 0x7f9858004c90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f986800ba30 tx=0x7f986801c6a0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9871f65640 1 -- 172.21.15.43:0/1350890288 reap_dead start 2024-04-24T23:00:37.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 -- 172.21.15.43:0/1350890288 shutdown_connections 2024-04-24T23:00:37.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 -- 172.21.15.43:0/1350890288 >> 172.21.15.43:0/1350890288 conn(0x7f986c0b5690 msgr2=0x7f986c0b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:37.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 -- 172.21.15.43:0/1350890288 shutdown_connections 2024-04-24T23:00:37.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 -- 172.21.15.43:0/1350890288 wait complete. 2024-04-24T23:00:37.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 Processor -- start 2024-04-24T23:00:37.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 -- start start 2024-04-24T23:00:37.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9858004810 0x7f986c14f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f986c1453c0 0x7f986c1410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c13a910 0x7f986c13ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f986c1503a0 con 0x7f986c1453c0 2024-04-24T23:00:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f986c150220 con 0x7f9858004810 2024-04-24T23:00:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f986c150520 con 0x7f986c13a910 2024-04-24T23:00:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9870f63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f986c1453c0 0x7f986c1410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9870f63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f986c1453c0 0x7f986c1410f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43154/0 (socket says 172.21.15.43:43154) 2024-04-24T23:00:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9870f63640 1 -- 172.21.15.43:0/2153330582 learned_addr learned my addr 172.21.15.43:0/2153330582 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9871f65640 1 --2- 172.21.15.43:0/2153330582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c13a910 0x7f986c13ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9871764640 1 --2- 172.21.15.43:0/2153330582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9858004810 0x7f986c14f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9870f63640 1 -- 172.21.15.43:0/2153330582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c13a910 msgr2=0x7f986c13ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9870f63640 1 --2- 172.21.15.43:0/2153330582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c13a910 0x7f986c13ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9870f63640 1 -- 172.21.15.43:0/2153330582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9858004810 msgr2=0x7f986c14f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9870f63640 1 --2- 172.21.15.43:0/2153330582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9858004810 0x7f986c14f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9870f63640 1 -- 172.21.15.43:0/2153330582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c145c20 con 0x7f986c1453c0 2024-04-24T23:00:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9871764640 1 --2- 172.21.15.43:0/2153330582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9858004810 0x7f986c14f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9870f63640 1 --2- 172.21.15.43:0/2153330582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f986c1453c0 0x7f986c1410f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9868097f80 tx=0x7f9858005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9861ffb640 1 -- 172.21.15.43:0/2153330582 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680bb070 con 0x7f986c1453c0 2024-04-24T23:00:37.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9861ffb640 1 -- 172.21.15.43:0/2153330582 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9868004220 con 0x7f986c1453c0 2024-04-24T23:00:37.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 -- 172.21.15.43:0/2153330582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f986c1408f0 con 0x7f986c1453c0 2024-04-24T23:00:37.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f9861ffb640 1 -- 172.21.15.43:0/2153330582 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868003620 con 0x7f986c1453c0 2024-04-24T23:00:37.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 -- 172.21.15.43:0/2153330582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f986c141a20 con 0x7f986c1453c0 2024-04-24T23:00:37.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.403+0000 7f98739c8640 1 -- 172.21.15.43:0/2153330582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f986c06faf0 con 0x7f986c1453c0 2024-04-24T23:00:37.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.407+0000 7f9861ffb640 1 -- 172.21.15.43:0/2153330582 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f98680037c0 con 0x7f986c1453c0 2024-04-24T23:00:37.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.407+0000 7f9861ffb640 1 --2- 172.21.15.43:0/2153330582 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98500678f0 0x7f9850069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.407+0000 7f9861ffb640 1 -- 172.21.15.43:0/2153330582 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9868120560 con 0x7f986c1453c0 2024-04-24T23:00:37.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.407+0000 7f9871764640 1 --2- 172.21.15.43:0/2153330582 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98500678f0 0x7f9850069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.407+0000 7f9871764640 1 --2- 172.21.15.43:0/2153330582 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98500678f0 0x7f9850069db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f985c001ec0 tx=0x7f985c001db0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.411+0000 7f9861ffb640 1 -- 172.21.15.43:0/2153330582 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f98680a7070 con 0x7f986c1453c0 2024-04-24T23:00:37.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.563+0000 7f98739c8640 1 -- 172.21.15.43:0/2153330582 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f986c13fde0 con 0x7f98500678f0 2024-04-24T23:00:37.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.583+0000 7f9861ffb640 1 -- 172.21.15.43:0/2153330582 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332607 (secure 0 0 0) 0x7f985c00f7c0 con 0x7f98500678f0 2024-04-24T23:00:37.594 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:37.596 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-24T23:00:37.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.591+0000 7f98739c8640 1 -- 172.21.15.43:0/2153330582 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98500678f0 msgr2=0x7f9850069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.591+0000 7f98739c8640 1 --2- 172.21.15.43:0/2153330582 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98500678f0 0x7f9850069db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f985c001ec0 tx=0x7f985c001db0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.591+0000 7f98739c8640 1 -- 172.21.15.43:0/2153330582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f986c1453c0 msgr2=0x7f986c1410f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.591+0000 7f98739c8640 1 --2- 172.21.15.43:0/2153330582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f986c1453c0 0x7f986c1410f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9868097f80 tx=0x7f9858005840 comp rx=0 tx=0).stop 2024-04-24T23:00:37.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.591+0000 7f98739c8640 1 -- 172.21.15.43:0/2153330582 shutdown_connections 2024-04-24T23:00:37.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.591+0000 7f98739c8640 1 --2- 172.21.15.43:0/2153330582 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98500678f0 0x7f9850069db0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.591+0000 7f98739c8640 1 --2- 172.21.15.43:0/2153330582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c13a910 0x7f986c13ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.591+0000 7f98739c8640 1 --2- 172.21.15.43:0/2153330582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f986c1453c0 0x7f986c1410f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.591+0000 7f98739c8640 1 --2- 172.21.15.43:0/2153330582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9858004810 0x7f986c14f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.591+0000 7f98739c8640 1 -- 172.21.15.43:0/2153330582 >> 172.21.15.43:0/2153330582 conn(0x7f986c0b5690 msgr2=0x7f986c0b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:37.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.591+0000 7f98739c8640 1 -- 172.21.15.43:0/2153330582 shutdown_connections 2024-04-24T23:00:37.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.591+0000 7f98739c8640 1 -- 172.21.15.43:0/2153330582 wait complete. 2024-04-24T23:00:37.611 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-24T23:00:36.267708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235020,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739700,"statfs":{"total":773094113280,"available":772853452800,"internally_reserved":0,"allocated":2260992,"data_stored":2002040,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004482"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492662+0000","last_change":"2024-04-24T23:00:15.425241+0000","last_active":"2024-04-24T23:00:21.492662+0000","last_peered":"2024-04-24T23:00:21.492662+0000","last_clean":"2024-04-24T23:00:21.492662+0000","last_became_active":"2024-04-24T23:00:15.417152+0000","last_became_peered":"2024-04-24T23:00:15.417152+0000","last_unstale":"2024-04-24T23:00:21.492662+0000","last_undegraded":"2024-04-24T23:00:21.492662+0000","last_fullsized":"2024-04-24T23:00:21.492662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492334+0000","last_change":"2024-04-24T23:00:16.450360+0000","last_active":"2024-04-24T23:00:21.492334+0000","last_peered":"2024-04-24T23:00:21.492334+0000","last_clean":"2024-04-24T23:00:21.492334+0000","last_became_active":"2024-04-24T23:00:16.449631+0000","last_became_peered":"2024-04-24T23:00:16.449631+0000","last_unstale":"2024-04-24T23:00:21.492334+0000","last_undegraded":"2024-04-24T23:00:21.492334+0000","last_fullsized":"2024-04-24T23:00:21.492334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:03:09.773642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363750+0000","last_change":"2024-04-24T23:00:20.537107+0000","last_active":"2024-04-24T23:00:22.363750+0000","last_peered":"2024-04-24T23:00:22.363750+0000","last_clean":"2024-04-24T23:00:22.363750+0000","last_became_active":"2024-04-24T23:00:20.535916+0000","last_became_peered":"2024-04-24T23:00:20.535916+0000","last_unstale":"2024-04-24T23:00:22.363750+0000","last_undegraded":"2024-04-24T23:00:22.363750+0000","last_fullsized":"2024-04-24T23:00:22.363750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.364772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492571+0000","last_change":"2024-04-24T23:00:15.418251+0000","last_active":"2024-04-24T23:00:21.492571+0000","last_peered":"2024-04-24T23:00:21.492571+0000","last_clean":"2024-04-24T23:00:21.492571+0000","last_became_active":"2024-04-24T23:00:15.417502+0000","last_became_peered":"2024-04-24T23:00:15.417502+0000","last_unstale":"2024-04-24T23:00:21.492571+0000","last_undegraded":"2024-04-24T23:00:21.492571+0000","last_fullsized":"2024-04-24T23:00:21.492571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:50:53.490837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491649+0000","last_change":"2024-04-24T23:00:16.452960+0000","last_active":"2024-04-24T23:00:21.491649+0000","last_peered":"2024-04-24T23:00:21.491649+0000","last_clean":"2024-04-24T23:00:21.491649+0000","last_became_active":"2024-04-24T23:00:16.452212+0000","last_became_peered":"2024-04-24T23:00:16.452212+0000","last_unstale":"2024-04-24T23:00:21.491649+0000","last_undegraded":"2024-04-24T23:00:21.491649+0000","last_fullsized":"2024-04-24T23:00:21.491649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:26.361607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361169+0000","last_change":"2024-04-24T23:00:20.518435+0000","last_active":"2024-04-24T23:00:22.361169+0000","last_peered":"2024-04-24T23:00:22.361169+0000","last_clean":"2024-04-24T23:00:22.361169+0000","last_became_active":"2024-04-24T23:00:20.517975+0000","last_became_peered":"2024-04-24T23:00:20.517975+0000","last_unstale":"2024-04-24T23:00:22.361169+0000","last_undegraded":"2024-04-24T23:00:22.361169+0000","last_fullsized":"2024-04-24T23:00:22.361169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:36.410688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361368+0000","last_change":"2024-04-24T23:00:15.401804+0000","last_active":"2024-04-24T23:00:22.361368+0000","last_peered":"2024-04-24T23:00:22.361368+0000","last_clean":"2024-04-24T23:00:22.361368+0000","last_became_active":"2024-04-24T23:00:15.400064+0000","last_became_peered":"2024-04-24T23:00:15.400064+0000","last_unstale":"2024-04-24T23:00:22.361368+0000","last_undegraded":"2024-04-24T23:00:22.361368+0000","last_fullsized":"2024-04-24T23:00:22.361368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:26.588514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.748494+0000","last_change":"2024-04-24T23:00:16.451873+0000","last_active":"2024-04-24T23:00:21.748494+0000","last_peered":"2024-04-24T23:00:21.748494+0000","last_clean":"2024-04-24T23:00:21.748494+0000","last_became_active":"2024-04-24T23:00:16.451601+0000","last_became_peered":"2024-04-24T23:00:16.451601+0000","last_unstale":"2024-04-24T23:00:21.748494+0000","last_undegraded":"2024-04-24T23:00:21.748494+0000","last_fullsized":"2024-04-24T23:00:21.748494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:14.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361787+0000","last_change":"2024-04-24T23:00:20.518757+0000","last_active":"2024-04-24T23:00:22.361787+0000","last_peered":"2024-04-24T23:00:22.361787+0000","last_clean":"2024-04-24T23:00:22.361787+0000","last_became_active":"2024-04-24T23:00:20.518002+0000","last_became_peered":"2024-04-24T23:00:20.518002+0000","last_unstale":"2024-04-24T23:00:22.361787+0000","last_undegraded":"2024-04-24T23:00:22.361787+0000","last_fullsized":"2024-04-24T23:00:22.361787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361059+0000","last_change":"2024-04-24T23:00:15.398338+0000","last_active":"2024-04-24T23:00:22.361059+0000","last_peered":"2024-04-24T23:00:22.361059+0000","last_clean":"2024-04-24T23:00:22.361059+0000","last_became_active":"2024-04-24T23:00:15.395766+0000","last_became_peered":"2024-04-24T23:00:15.395766+0000","last_unstale":"2024-04-24T23:00:22.361059+0000","last_undegraded":"2024-04-24T23:00:22.361059+0000","last_fullsized":"2024-04-24T23:00:22.361059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:30.228280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487678+0000","last_change":"2024-04-24T23:00:16.458641+0000","last_active":"2024-04-24T23:00:21.487678+0000","last_peered":"2024-04-24T23:00:21.487678+0000","last_clean":"2024-04-24T23:00:21.487678+0000","last_became_active":"2024-04-24T23:00:16.458237+0000","last_became_peered":"2024-04-24T23:00:16.458237+0000","last_unstale":"2024-04-24T23:00:21.487678+0000","last_undegraded":"2024-04-24T23:00:21.487678+0000","last_fullsized":"2024-04-24T23:00:21.487678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:22:17.631542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361245+0000","last_change":"2024-04-24T23:00:20.518742+0000","last_active":"2024-04-24T23:00:22.361245+0000","last_peered":"2024-04-24T23:00:22.361245+0000","last_clean":"2024-04-24T23:00:22.361245+0000","last_became_active":"2024-04-24T23:00:20.518163+0000","last_became_peered":"2024-04-24T23:00:20.518163+0000","last_unstale":"2024-04-24T23:00:22.361245+0000","last_undegraded":"2024-04-24T23:00:22.361245+0000","last_fullsized":"2024-04-24T23:00:22.361245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:35.156511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486896+0000","last_change":"2024-04-24T23:00:16.448014+0000","last_active":"2024-04-24T23:00:21.486896+0000","last_peered":"2024-04-24T23:00:21.486896+0000","last_clean":"2024-04-24T23:00:21.486896+0000","last_became_active":"2024-04-24T23:00:16.447488+0000","last_became_peered":"2024-04-24T23:00:16.447488+0000","last_unstale":"2024-04-24T23:00:21.486896+0000","last_undegraded":"2024-04-24T23:00:21.486896+0000","last_fullsized":"2024-04-24T23:00:21.486896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:29.852278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487660+0000","last_change":"2024-04-24T23:00:15.408781+0000","last_active":"2024-04-24T23:00:21.487660+0000","last_peered":"2024-04-24T23:00:21.487660+0000","last_clean":"2024-04-24T23:00:21.487660+0000","last_became_active":"2024-04-24T23:00:15.408120+0000","last_became_peered":"2024-04-24T23:00:15.408120+0000","last_unstale":"2024-04-24T23:00:21.487660+0000","last_undegraded":"2024-04-24T23:00:21.487660+0000","last_fullsized":"2024-04-24T23:00:21.487660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:38.560562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487495+0000","last_change":"2024-04-24T23:00:20.503964+0000","last_active":"2024-04-24T23:00:21.487495+0000","last_peered":"2024-04-24T23:00:21.487495+0000","last_clean":"2024-04-24T23:00:21.487495+0000","last_became_active":"2024-04-24T23:00:20.501703+0000","last_became_peered":"2024-04-24T23:00:20.501703+0000","last_unstale":"2024-04-24T23:00:21.487495+0000","last_undegraded":"2024-04-24T23:00:21.487495+0000","last_fullsized":"2024-04-24T23:00:21.487495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:40.258673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365366+0000","last_change":"2024-04-24T23:00:16.472987+0000","last_active":"2024-04-24T23:00:22.365366+0000","last_peered":"2024-04-24T23:00:22.365366+0000","last_clean":"2024-04-24T23:00:22.365366+0000","last_became_active":"2024-04-24T23:00:16.472226+0000","last_became_peered":"2024-04-24T23:00:16.472226+0000","last_unstale":"2024-04-24T23:00:22.365366+0000","last_undegraded":"2024-04-24T23:00:22.365366+0000","last_fullsized":"2024-04-24T23:00:22.365366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364010+0000","last_change":"2024-04-24T23:00:15.422963+0000","last_active":"2024-04-24T23:00:22.364010+0000","last_peered":"2024-04-24T23:00:22.364010+0000","last_clean":"2024-04-24T23:00:22.364010+0000","last_became_active":"2024-04-24T23:00:15.422121+0000","last_became_peered":"2024-04-24T23:00:15.422121+0000","last_unstale":"2024-04-24T23:00:22.364010+0000","last_undegraded":"2024-04-24T23:00:22.364010+0000","last_fullsized":"2024-04-24T23:00:22.364010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360721+0000","last_change":"2024-04-24T23:00:20.540688+0000","last_active":"2024-04-24T23:00:22.360721+0000","last_peered":"2024-04-24T23:00:22.360721+0000","last_clean":"2024-04-24T23:00:22.360721+0000","last_became_active":"2024-04-24T23:00:20.540220+0000","last_became_peered":"2024-04-24T23:00:20.540220+0000","last_unstale":"2024-04-24T23:00:22.360721+0000","last_undegraded":"2024-04-24T23:00:22.360721+0000","last_fullsized":"2024-04-24T23:00:22.360721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:33.931661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489044+0000","last_change":"2024-04-24T23:00:16.488633+0000","last_active":"2024-04-24T23:00:21.489044+0000","last_peered":"2024-04-24T23:00:21.489044+0000","last_clean":"2024-04-24T23:00:21.489044+0000","last_became_active":"2024-04-24T23:00:16.487476+0000","last_became_peered":"2024-04-24T23:00:16.487476+0000","last_unstale":"2024-04-24T23:00:21.489044+0000","last_undegraded":"2024-04-24T23:00:21.489044+0000","last_fullsized":"2024-04-24T23:00:21.489044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:06.907656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489774+0000","last_change":"2024-04-24T23:00:15.397973+0000","last_active":"2024-04-24T23:00:21.489774+0000","last_peered":"2024-04-24T23:00:21.489774+0000","last_clean":"2024-04-24T23:00:21.489774+0000","last_became_active":"2024-04-24T23:00:15.396600+0000","last_became_peered":"2024-04-24T23:00:15.396600+0000","last_unstale":"2024-04-24T23:00:21.489774+0000","last_undegraded":"2024-04-24T23:00:21.489774+0000","last_fullsized":"2024-04-24T23:00:21.489774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:22.932046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364875+0000","last_change":"2024-04-24T23:00:20.511547+0000","last_active":"2024-04-24T23:00:22.364875+0000","last_peered":"2024-04-24T23:00:22.364875+0000","last_clean":"2024-04-24T23:00:22.364875+0000","last_became_active":"2024-04-24T23:00:20.510602+0000","last_became_peered":"2024-04-24T23:00:20.510602+0000","last_unstale":"2024-04-24T23:00:22.364875+0000","last_undegraded":"2024-04-24T23:00:22.364875+0000","last_fullsized":"2024-04-24T23:00:22.364875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:17.847434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486773+0000","last_change":"2024-04-24T23:00:16.483393+0000","last_active":"2024-04-24T23:00:21.486773+0000","last_peered":"2024-04-24T23:00:21.486773+0000","last_clean":"2024-04-24T23:00:21.486773+0000","last_became_active":"2024-04-24T23:00:16.483092+0000","last_became_peered":"2024-04-24T23:00:16.483092+0000","last_unstale":"2024-04-24T23:00:21.486773+0000","last_undegraded":"2024-04-24T23:00:21.486773+0000","last_fullsized":"2024-04-24T23:00:21.486773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:38.429072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360305+0000","last_change":"2024-04-24T23:00:15.398005+0000","last_active":"2024-04-24T23:00:22.360305+0000","last_peered":"2024-04-24T23:00:22.360305+0000","last_clean":"2024-04-24T23:00:22.360305+0000","last_became_active":"2024-04-24T23:00:15.397638+0000","last_became_peered":"2024-04-24T23:00:15.397638+0000","last_unstale":"2024-04-24T23:00:22.360305+0000","last_undegraded":"2024-04-24T23:00:22.360305+0000","last_fullsized":"2024-04-24T23:00:22.360305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362139+0000","last_change":"2024-04-24T23:00:20.505995+0000","last_active":"2024-04-24T23:00:22.362139+0000","last_peered":"2024-04-24T23:00:22.362139+0000","last_clean":"2024-04-24T23:00:22.362139+0000","last_became_active":"2024-04-24T23:00:20.505532+0000","last_became_peered":"2024-04-24T23:00:20.505532+0000","last_unstale":"2024-04-24T23:00:22.362139+0000","last_undegraded":"2024-04-24T23:00:22.362139+0000","last_fullsized":"2024-04-24T23:00:22.362139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:42.508455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491149+0000","last_change":"2024-04-24T23:00:16.484306+0000","last_active":"2024-04-24T23:00:21.491149+0000","last_peered":"2024-04-24T23:00:21.491149+0000","last_clean":"2024-04-24T23:00:21.491149+0000","last_became_active":"2024-04-24T23:00:16.483585+0000","last_became_peered":"2024-04-24T23:00:16.483585+0000","last_unstale":"2024-04-24T23:00:21.491149+0000","last_undegraded":"2024-04-24T23:00:21.491149+0000","last_fullsized":"2024-04-24T23:00:21.491149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:53.051451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488704+0000","last_change":"2024-04-24T23:00:15.421158+0000","last_active":"2024-04-24T23:00:21.488704+0000","last_peered":"2024-04-24T23:00:21.488704+0000","last_clean":"2024-04-24T23:00:21.488704+0000","last_became_active":"2024-04-24T23:00:15.420839+0000","last_became_peered":"2024-04-24T23:00:15.420839+0000","last_unstale":"2024-04-24T23:00:21.488704+0000","last_undegraded":"2024-04-24T23:00:21.488704+0000","last_fullsized":"2024-04-24T23:00:21.488704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:03.276247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361402+0000","last_change":"2024-04-24T23:00:20.519755+0000","last_active":"2024-04-24T23:00:22.361402+0000","last_peered":"2024-04-24T23:00:22.361402+0000","last_clean":"2024-04-24T23:00:22.361402+0000","last_became_active":"2024-04-24T23:00:20.518470+0000","last_became_peered":"2024-04-24T23:00:20.518470+0000","last_unstale":"2024-04-24T23:00:22.361402+0000","last_undegraded":"2024-04-24T23:00:22.361402+0000","last_fullsized":"2024-04-24T23:00:22.361402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:14.639189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492639+0000","last_change":"2024-04-24T23:00:16.464487+0000","last_active":"2024-04-24T23:00:21.492639+0000","last_peered":"2024-04-24T23:00:21.492639+0000","last_clean":"2024-04-24T23:00:21.492639+0000","last_became_active":"2024-04-24T23:00:16.463565+0000","last_became_peered":"2024-04-24T23:00:16.463565+0000","last_unstale":"2024-04-24T23:00:21.492639+0000","last_undegraded":"2024-04-24T23:00:21.492639+0000","last_fullsized":"2024-04-24T23:00:21.492639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491680+0000","last_change":"2024-04-24T23:00:15.400228+0000","last_active":"2024-04-24T23:00:21.491680+0000","last_peered":"2024-04-24T23:00:21.491680+0000","last_clean":"2024-04-24T23:00:21.491680+0000","last_became_active":"2024-04-24T23:00:15.397465+0000","last_became_peered":"2024-04-24T23:00:15.397465+0000","last_unstale":"2024-04-24T23:00:21.491680+0000","last_undegraded":"2024-04-24T23:00:21.491680+0000","last_fullsized":"2024-04-24T23:00:21.491680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488900+0000","last_change":"2024-04-24T23:00:20.516766+0000","last_active":"2024-04-24T23:00:21.488900+0000","last_peered":"2024-04-24T23:00:21.488900+0000","last_clean":"2024-04-24T23:00:21.488900+0000","last_became_active":"2024-04-24T23:00:20.515972+0000","last_became_peered":"2024-04-24T23:00:20.515972+0000","last_unstale":"2024-04-24T23:00:21.488900+0000","last_undegraded":"2024-04-24T23:00:21.488900+0000","last_fullsized":"2024-04-24T23:00:21.488900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365547+0000","last_change":"2024-04-24T23:00:16.480627+0000","last_active":"2024-04-24T23:00:22.365547+0000","last_peered":"2024-04-24T23:00:22.365547+0000","last_clean":"2024-04-24T23:00:22.365547+0000","last_became_active":"2024-04-24T23:00:16.480021+0000","last_became_peered":"2024-04-24T23:00:16.480021+0000","last_unstale":"2024-04-24T23:00:22.365547+0000","last_undegraded":"2024-04-24T23:00:22.365547+0000","last_fullsized":"2024-04-24T23:00:22.365547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:04.285389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488322+0000","last_change":"2024-04-24T23:00:15.428375+0000","last_active":"2024-04-24T23:00:21.488322+0000","last_peered":"2024-04-24T23:00:21.488322+0000","last_clean":"2024-04-24T23:00:21.488322+0000","last_became_active":"2024-04-24T23:00:15.428016+0000","last_became_peered":"2024-04-24T23:00:15.428016+0000","last_unstale":"2024-04-24T23:00:21.488322+0000","last_undegraded":"2024-04-24T23:00:21.488322+0000","last_fullsized":"2024-04-24T23:00:21.488322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:24.759195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363541+0000","last_change":"2024-04-24T23:00:20.535274+0000","last_active":"2024-04-24T23:00:22.363541+0000","last_peered":"2024-04-24T23:00:22.363541+0000","last_clean":"2024-04-24T23:00:22.363541+0000","last_became_active":"2024-04-24T23:00:20.524747+0000","last_became_peered":"2024-04-24T23:00:20.524747+0000","last_unstale":"2024-04-24T23:00:22.363541+0000","last_undegraded":"2024-04-24T23:00:22.363541+0000","last_fullsized":"2024-04-24T23:00:22.363541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.814128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361971+0000","last_change":"2024-04-24T23:00:16.456641+0000","last_active":"2024-04-24T23:00:22.361971+0000","last_peered":"2024-04-24T23:00:22.361971+0000","last_clean":"2024-04-24T23:00:22.361971+0000","last_became_active":"2024-04-24T23:00:16.456268+0000","last_became_peered":"2024-04-24T23:00:16.456268+0000","last_unstale":"2024-04-24T23:00:22.361971+0000","last_undegraded":"2024-04-24T23:00:22.361971+0000","last_fullsized":"2024-04-24T23:00:22.361971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491288+0000","last_change":"2024-04-24T23:00:15.429119+0000","last_active":"2024-04-24T23:00:21.491288+0000","last_peered":"2024-04-24T23:00:21.491288+0000","last_clean":"2024-04-24T23:00:21.491288+0000","last_became_active":"2024-04-24T23:00:15.428374+0000","last_became_peered":"2024-04-24T23:00:15.428374+0000","last_unstale":"2024-04-24T23:00:21.491288+0000","last_undegraded":"2024-04-24T23:00:21.491288+0000","last_fullsized":"2024-04-24T23:00:21.491288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:13:30.412685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363356+0000","last_change":"2024-04-24T23:00:20.535730+0000","last_active":"2024-04-24T23:00:22.363356+0000","last_peered":"2024-04-24T23:00:22.363356+0000","last_clean":"2024-04-24T23:00:22.363356+0000","last_became_active":"2024-04-24T23:00:20.534430+0000","last_became_peered":"2024-04-24T23:00:20.534430+0000","last_unstale":"2024-04-24T23:00:22.363356+0000","last_undegraded":"2024-04-24T23:00:22.363356+0000","last_fullsized":"2024-04-24T23:00:22.363356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:35.156511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360697+0000","last_change":"2024-04-24T23:00:16.444070+0000","last_active":"2024-04-24T23:00:22.360697+0000","last_peered":"2024-04-24T23:00:22.360697+0000","last_clean":"2024-04-24T23:00:22.360697+0000","last_became_active":"2024-04-24T23:00:16.443620+0000","last_became_peered":"2024-04-24T23:00:16.443620+0000","last_unstale":"2024-04-24T23:00:22.360697+0000","last_undegraded":"2024-04-24T23:00:22.360697+0000","last_fullsized":"2024-04-24T23:00:22.360697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:31.077128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487637+0000","last_change":"2024-04-24T23:00:15.422571+0000","last_active":"2024-04-24T23:00:21.487637+0000","last_peered":"2024-04-24T23:00:21.487637+0000","last_clean":"2024-04-24T23:00:21.487637+0000","last_became_active":"2024-04-24T23:00:15.422167+0000","last_became_peered":"2024-04-24T23:00:15.422167+0000","last_unstale":"2024-04-24T23:00:21.487637+0000","last_undegraded":"2024-04-24T23:00:21.487637+0000","last_fullsized":"2024-04-24T23:00:21.487637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:29.417228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365058+0000","last_change":"2024-04-24T23:00:20.540587+0000","last_active":"2024-04-24T23:00:22.365058+0000","last_peered":"2024-04-24T23:00:22.365058+0000","last_clean":"2024-04-24T23:00:22.365058+0000","last_became_active":"2024-04-24T23:00:20.524719+0000","last_became_peered":"2024-04-24T23:00:20.524719+0000","last_unstale":"2024-04-24T23:00:22.365058+0000","last_undegraded":"2024-04-24T23:00:22.365058+0000","last_fullsized":"2024-04-24T23:00:22.365058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488063+0000","last_change":"2024-04-24T23:00:16.471678+0000","last_active":"2024-04-24T23:00:21.488063+0000","last_peered":"2024-04-24T23:00:21.488063+0000","last_clean":"2024-04-24T23:00:21.488063+0000","last_became_active":"2024-04-24T23:00:16.469390+0000","last_became_peered":"2024-04-24T23:00:16.469390+0000","last_unstale":"2024-04-24T23:00:21.488063+0000","last_undegraded":"2024-04-24T23:00:21.488063+0000","last_fullsized":"2024-04-24T23:00:21.488063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:31:59.778549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363883+0000","last_change":"2024-04-24T23:00:15.423024+0000","last_active":"2024-04-24T23:00:22.363883+0000","last_peered":"2024-04-24T23:00:22.363883+0000","last_clean":"2024-04-24T23:00:22.363883+0000","last_became_active":"2024-04-24T23:00:15.422275+0000","last_became_peered":"2024-04-24T23:00:15.422275+0000","last_unstale":"2024-04-24T23:00:22.363883+0000","last_undegraded":"2024-04-24T23:00:22.363883+0000","last_fullsized":"2024-04-24T23:00:22.363883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365241+0000","last_change":"2024-04-24T23:00:20.535131+0000","last_active":"2024-04-24T23:00:22.365241+0000","last_peered":"2024-04-24T23:00:22.365241+0000","last_clean":"2024-04-24T23:00:22.365241+0000","last_became_active":"2024-04-24T23:00:20.534325+0000","last_became_peered":"2024-04-24T23:00:20.534325+0000","last_unstale":"2024-04-24T23:00:22.365241+0000","last_undegraded":"2024-04-24T23:00:22.365241+0000","last_fullsized":"2024-04-24T23:00:22.365241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363140+0000","last_change":"2024-04-24T23:00:16.451991+0000","last_active":"2024-04-24T23:00:22.363140+0000","last_peered":"2024-04-24T23:00:22.363140+0000","last_clean":"2024-04-24T23:00:22.363140+0000","last_became_active":"2024-04-24T23:00:16.451226+0000","last_became_peered":"2024-04-24T23:00:16.451226+0000","last_unstale":"2024-04-24T23:00:22.363140+0000","last_undegraded":"2024-04-24T23:00:22.363140+0000","last_fullsized":"2024-04-24T23:00:22.363140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:30.426371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487107+0000","last_change":"2024-04-24T23:00:15.414535+0000","last_active":"2024-04-24T23:00:21.487107+0000","last_peered":"2024-04-24T23:00:21.487107+0000","last_clean":"2024-04-24T23:00:21.487107+0000","last_became_active":"2024-04-24T23:00:15.414224+0000","last_became_peered":"2024-04-24T23:00:15.414224+0000","last_unstale":"2024-04-24T23:00:21.487107+0000","last_undegraded":"2024-04-24T23:00:21.487107+0000","last_fullsized":"2024-04-24T23:00:21.487107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:30.228280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491178+0000","last_change":"2024-04-24T23:00:20.531159+0000","last_active":"2024-04-24T23:00:21.491178+0000","last_peered":"2024-04-24T23:00:21.491178+0000","last_clean":"2024-04-24T23:00:21.491178+0000","last_became_active":"2024-04-24T23:00:20.530682+0000","last_became_peered":"2024-04-24T23:00:20.530682+0000","last_unstale":"2024-04-24T23:00:21.491178+0000","last_undegraded":"2024-04-24T23:00:21.491178+0000","last_fullsized":"2024-04-24T23:00:21.491178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:45.629364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490334+0000","last_change":"2024-04-24T23:00:16.481649+0000","last_active":"2024-04-24T23:00:21.490334+0000","last_peered":"2024-04-24T23:00:21.490334+0000","last_clean":"2024-04-24T23:00:21.490334+0000","last_became_active":"2024-04-24T23:00:16.477192+0000","last_became_peered":"2024-04-24T23:00:16.477192+0000","last_unstale":"2024-04-24T23:00:21.490334+0000","last_undegraded":"2024-04-24T23:00:21.490334+0000","last_fullsized":"2024-04-24T23:00:21.490334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:13.768051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487760+0000","last_change":"2024-04-24T23:00:15.407927+0000","last_active":"2024-04-24T23:00:21.487760+0000","last_peered":"2024-04-24T23:00:21.487760+0000","last_clean":"2024-04-24T23:00:21.487760+0000","last_became_active":"2024-04-24T23:00:15.407609+0000","last_became_peered":"2024-04-24T23:00:15.407609+0000","last_unstale":"2024-04-24T23:00:21.487760+0000","last_undegraded":"2024-04-24T23:00:21.487760+0000","last_fullsized":"2024-04-24T23:00:21.487760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:13.689340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.747953+0000","last_change":"2024-04-24T23:00:03.344529+0000","last_active":"2024-04-24T23:00:21.747953+0000","last_peered":"2024-04-24T23:00:21.747953+0000","last_clean":"2024-04-24T23:00:21.747953+0000","last_became_active":"2024-04-24T23:00:03.344074+0000","last_became_peered":"2024-04-24T23:00:03.344074+0000","last_unstale":"2024-04-24T23:00:21.747953+0000","last_undegraded":"2024-04-24T23:00:21.747953+0000","last_fullsized":"2024-04-24T23:00:21.747953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:02.322380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:02.322380+0000","last_clean_scrub_stamp":"2024-04-24T23:00:02.322380+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:40.550881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488278+0000","last_change":"2024-04-24T23:00:20.492015+0000","last_active":"2024-04-24T23:00:21.488278+0000","last_peered":"2024-04-24T23:00:21.488278+0000","last_clean":"2024-04-24T23:00:21.488278+0000","last_became_active":"2024-04-24T23:00:20.491092+0000","last_became_peered":"2024-04-24T23:00:20.491092+0000","last_unstale":"2024-04-24T23:00:21.488278+0000","last_undegraded":"2024-04-24T23:00:21.488278+0000","last_fullsized":"2024-04-24T23:00:21.488278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:49:22.306663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487732+0000","last_change":"2024-04-24T23:00:16.448759+0000","last_active":"2024-04-24T23:00:21.487732+0000","last_peered":"2024-04-24T23:00:21.487732+0000","last_clean":"2024-04-24T23:00:21.487732+0000","last_became_active":"2024-04-24T23:00:16.448187+0000","last_became_peered":"2024-04-24T23:00:16.448187+0000","last_unstale":"2024-04-24T23:00:21.487732+0000","last_undegraded":"2024-04-24T23:00:21.487732+0000","last_fullsized":"2024-04-24T23:00:21.487732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:08:59.708506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365797+0000","last_change":"2024-04-24T23:00:15.436270+0000","last_active":"2024-04-24T23:00:22.365797+0000","last_peered":"2024-04-24T23:00:22.365797+0000","last_clean":"2024-04-24T23:00:22.365797+0000","last_became_active":"2024-04-24T23:00:15.425134+0000","last_became_peered":"2024-04-24T23:00:15.425134+0000","last_unstale":"2024-04-24T23:00:22.365797+0000","last_undegraded":"2024-04-24T23:00:22.365797+0000","last_fullsized":"2024-04-24T23:00:22.365797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361374+0000","last_change":"2024-04-24T23:00:20.500617+0000","last_active":"2024-04-24T23:00:22.361374+0000","last_peered":"2024-04-24T23:00:22.361374+0000","last_clean":"2024-04-24T23:00:22.361374+0000","last_became_active":"2024-04-24T23:00:20.500158+0000","last_became_peered":"2024-04-24T23:00:20.500158+0000","last_unstale":"2024-04-24T23:00:22.361374+0000","last_undegraded":"2024-04-24T23:00:22.361374+0000","last_fullsized":"2024-04-24T23:00:22.361374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.814128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360974+0000","last_change":"2024-04-24T23:00:16.471754+0000","last_active":"2024-04-24T23:00:22.360974+0000","last_peered":"2024-04-24T23:00:22.360974+0000","last_clean":"2024-04-24T23:00:22.360974+0000","last_became_active":"2024-04-24T23:00:16.471497+0000","last_became_peered":"2024-04-24T23:00:16.471497+0000","last_unstale":"2024-04-24T23:00:22.360974+0000","last_undegraded":"2024-04-24T23:00:22.360974+0000","last_fullsized":"2024-04-24T23:00:22.360974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:27.760709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491588+0000","last_change":"2024-04-24T23:00:15.406401+0000","last_active":"2024-04-24T23:00:21.491588+0000","last_peered":"2024-04-24T23:00:21.491588+0000","last_clean":"2024-04-24T23:00:21.491588+0000","last_became_active":"2024-04-24T23:00:15.405636+0000","last_became_peered":"2024-04-24T23:00:15.405636+0000","last_unstale":"2024-04-24T23:00:21.491588+0000","last_undegraded":"2024-04-24T23:00:21.491588+0000","last_fullsized":"2024-04-24T23:00:21.491588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:02.654515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491774+0000","last_change":"2024-04-24T23:00:20.502050+0000","last_active":"2024-04-24T23:00:21.491774+0000","last_peered":"2024-04-24T23:00:21.491774+0000","last_clean":"2024-04-24T23:00:21.491774+0000","last_became_active":"2024-04-24T23:00:20.500153+0000","last_became_peered":"2024-04-24T23:00:20.500153+0000","last_unstale":"2024-04-24T23:00:21.491774+0000","last_undegraded":"2024-04-24T23:00:21.491774+0000","last_fullsized":"2024-04-24T23:00:21.491774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:51.285256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361451+0000","last_change":"2024-04-24T23:00:16.446762+0000","last_active":"2024-04-24T23:00:22.361451+0000","last_peered":"2024-04-24T23:00:22.361451+0000","last_clean":"2024-04-24T23:00:22.361451+0000","last_became_active":"2024-04-24T23:00:16.446170+0000","last_became_peered":"2024-04-24T23:00:16.446170+0000","last_unstale":"2024-04-24T23:00:22.361451+0000","last_undegraded":"2024-04-24T23:00:22.361451+0000","last_fullsized":"2024-04-24T23:00:22.361451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.801913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491407+0000","last_change":"2024-04-24T23:00:15.423703+0000","last_active":"2024-04-24T23:00:21.491407+0000","last_peered":"2024-04-24T23:00:21.491407+0000","last_clean":"2024-04-24T23:00:21.491407+0000","last_became_active":"2024-04-24T23:00:15.414863+0000","last_became_peered":"2024-04-24T23:00:15.414863+0000","last_unstale":"2024-04-24T23:00:21.491407+0000","last_undegraded":"2024-04-24T23:00:21.491407+0000","last_fullsized":"2024-04-24T23:00:21.491407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:26.588514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486409+0000","last_change":"2024-04-24T23:00:20.499277+0000","last_active":"2024-04-24T23:00:21.486409+0000","last_peered":"2024-04-24T23:00:21.486409+0000","last_clean":"2024-04-24T23:00:21.486409+0000","last_became_active":"2024-04-24T23:00:20.498802+0000","last_became_peered":"2024-04-24T23:00:20.498802+0000","last_unstale":"2024-04-24T23:00:21.486409+0000","last_undegraded":"2024-04-24T23:00:21.486409+0000","last_fullsized":"2024-04-24T23:00:21.486409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:32.166063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362253+0000","last_change":"2024-04-24T23:00:16.448112+0000","last_active":"2024-04-24T23:00:22.362253+0000","last_peered":"2024-04-24T23:00:22.362253+0000","last_clean":"2024-04-24T23:00:22.362253+0000","last_became_active":"2024-04-24T23:00:16.447838+0000","last_became_peered":"2024-04-24T23:00:16.447838+0000","last_unstale":"2024-04-24T23:00:22.362253+0000","last_undegraded":"2024-04-24T23:00:22.362253+0000","last_fullsized":"2024-04-24T23:00:22.362253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:24.143678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361996+0000","last_change":"2024-04-24T23:00:15.420914+0000","last_active":"2024-04-24T23:00:22.361996+0000","last_peered":"2024-04-24T23:00:22.361996+0000","last_clean":"2024-04-24T23:00:22.361996+0000","last_became_active":"2024-04-24T23:00:15.420590+0000","last_became_peered":"2024-04-24T23:00:15.420590+0000","last_unstale":"2024-04-24T23:00:22.361996+0000","last_undegraded":"2024-04-24T23:00:22.361996+0000","last_fullsized":"2024-04-24T23:00:22.361996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:53.443962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.748466+0000","last_change":"2024-04-24T23:00:20.494192+0000","last_active":"2024-04-24T23:00:21.748466+0000","last_peered":"2024-04-24T23:00:21.748466+0000","last_clean":"2024-04-24T23:00:21.748466+0000","last_became_active":"2024-04-24T23:00:20.493784+0000","last_became_peered":"2024-04-24T23:00:20.493784+0000","last_unstale":"2024-04-24T23:00:21.748466+0000","last_undegraded":"2024-04-24T23:00:21.748466+0000","last_fullsized":"2024-04-24T23:00:21.748466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:10.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486486+0000","last_change":"2024-04-24T23:00:16.452682+0000","last_active":"2024-04-24T23:00:21.486486+0000","last_peered":"2024-04-24T23:00:21.486486+0000","last_clean":"2024-04-24T23:00:21.486486+0000","last_became_active":"2024-04-24T23:00:16.447742+0000","last_became_peered":"2024-04-24T23:00:16.447742+0000","last_unstale":"2024-04-24T23:00:21.486486+0000","last_undegraded":"2024-04-24T23:00:21.486486+0000","last_fullsized":"2024-04-24T23:00:21.486486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.801913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489312+0000","last_change":"2024-04-24T23:00:15.416986+0000","last_active":"2024-04-24T23:00:21.489312+0000","last_peered":"2024-04-24T23:00:21.489312+0000","last_clean":"2024-04-24T23:00:21.489312+0000","last_became_active":"2024-04-24T23:00:15.416198+0000","last_became_peered":"2024-04-24T23:00:15.416198+0000","last_unstale":"2024-04-24T23:00:21.489312+0000","last_undegraded":"2024-04-24T23:00:21.489312+0000","last_fullsized":"2024-04-24T23:00:21.489312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:27.810443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492094+0000","last_change":"2024-04-24T23:00:20.526621+0000","last_active":"2024-04-24T23:00:21.492094+0000","last_peered":"2024-04-24T23:00:21.492094+0000","last_clean":"2024-04-24T23:00:21.492094+0000","last_became_active":"2024-04-24T23:00:20.525782+0000","last_became_peered":"2024-04-24T23:00:20.525782+0000","last_unstale":"2024-04-24T23:00:21.492094+0000","last_undegraded":"2024-04-24T23:00:21.492094+0000","last_fullsized":"2024-04-24T23:00:21.492094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:38:28.209697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.747735+0000","last_change":"2024-04-24T23:00:16.454748+0000","last_active":"2024-04-24T23:00:21.747735+0000","last_peered":"2024-04-24T23:00:21.747735+0000","last_clean":"2024-04-24T23:00:21.747735+0000","last_became_active":"2024-04-24T23:00:16.454031+0000","last_became_peered":"2024-04-24T23:00:16.454031+0000","last_unstale":"2024-04-24T23:00:21.747735+0000","last_undegraded":"2024-04-24T23:00:21.747735+0000","last_fullsized":"2024-04-24T23:00:21.747735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:31.237423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360689+0000","last_change":"2024-04-24T23:00:15.420149+0000","last_active":"2024-04-24T23:00:22.360689+0000","last_peered":"2024-04-24T23:00:22.360689+0000","last_clean":"2024-04-24T23:00:22.360689+0000","last_became_active":"2024-04-24T23:00:15.416688+0000","last_became_peered":"2024-04-24T23:00:15.416688+0000","last_unstale":"2024-04-24T23:00:22.360689+0000","last_undegraded":"2024-04-24T23:00:22.360689+0000","last_fullsized":"2024-04-24T23:00:22.360689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:27.810443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491371+0000","last_change":"2024-04-24T23:00:20.517137+0000","last_active":"2024-04-24T23:00:21.491371+0000","last_peered":"2024-04-24T23:00:21.491371+0000","last_clean":"2024-04-24T23:00:21.491371+0000","last_became_active":"2024-04-24T23:00:20.516152+0000","last_became_peered":"2024-04-24T23:00:20.516152+0000","last_unstale":"2024-04-24T23:00:21.491371+0000","last_undegraded":"2024-04-24T23:00:21.491371+0000","last_fullsized":"2024-04-24T23:00:21.491371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:29.452352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487144+0000","last_change":"2024-04-24T23:00:16.458939+0000","last_active":"2024-04-24T23:00:21.487144+0000","last_peered":"2024-04-24T23:00:21.487144+0000","last_clean":"2024-04-24T23:00:21.487144+0000","last_became_active":"2024-04-24T23:00:16.458081+0000","last_became_peered":"2024-04-24T23:00:16.458081+0000","last_unstale":"2024-04-24T23:00:21.487144+0000","last_undegraded":"2024-04-24T23:00:21.487144+0000","last_fullsized":"2024-04-24T23:00:21.487144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:27.760709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487474+0000","last_change":"2024-04-24T23:00:15.413409+0000","last_active":"2024-04-24T23:00:21.487474+0000","last_peered":"2024-04-24T23:00:21.487474+0000","last_clean":"2024-04-24T23:00:21.487474+0000","last_became_active":"2024-04-24T23:00:15.412847+0000","last_became_peered":"2024-04-24T23:00:15.412847+0000","last_unstale":"2024-04-24T23:00:21.487474+0000","last_undegraded":"2024-04-24T23:00:21.487474+0000","last_fullsized":"2024-04-24T23:00:21.487474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:35.114960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364628+0000","last_change":"2024-04-24T23:00:20.536112+0000","last_active":"2024-04-24T23:00:22.364628+0000","last_peered":"2024-04-24T23:00:22.364628+0000","last_clean":"2024-04-24T23:00:22.364628+0000","last_became_active":"2024-04-24T23:00:20.529427+0000","last_became_peered":"2024-04-24T23:00:20.529427+0000","last_unstale":"2024-04-24T23:00:22.364628+0000","last_undegraded":"2024-04-24T23:00:22.364628+0000","last_fullsized":"2024-04-24T23:00:22.364628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:14.639189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363813+0000","last_change":"2024-04-24T23:00:16.465373+0000","last_active":"2024-04-24T23:00:22.363813+0000","last_peered":"2024-04-24T23:00:22.363813+0000","last_clean":"2024-04-24T23:00:22.363813+0000","last_became_active":"2024-04-24T23:00:16.464653+0000","last_became_peered":"2024-04-24T23:00:16.464653+0000","last_unstale":"2024-04-24T23:00:22.363813+0000","last_undegraded":"2024-04-24T23:00:22.363813+0000","last_fullsized":"2024-04-24T23:00:22.363813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:24.143678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365627+0000","last_change":"2024-04-24T23:00:15.427483+0000","last_active":"2024-04-24T23:00:22.365627+0000","last_peered":"2024-04-24T23:00:22.365627+0000","last_clean":"2024-04-24T23:00:22.365627+0000","last_became_active":"2024-04-24T23:00:15.426641+0000","last_became_peered":"2024-04-24T23:00:15.426641+0000","last_unstale":"2024-04-24T23:00:22.365627+0000","last_undegraded":"2024-04-24T23:00:22.365627+0000","last_fullsized":"2024-04-24T23:00:22.365627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487531+0000","last_change":"2024-04-24T23:00:20.518479+0000","last_active":"2024-04-24T23:00:21.487531+0000","last_peered":"2024-04-24T23:00:21.487531+0000","last_clean":"2024-04-24T23:00:21.487531+0000","last_became_active":"2024-04-24T23:00:20.517950+0000","last_became_peered":"2024-04-24T23:00:20.517950+0000","last_unstale":"2024-04-24T23:00:21.487531+0000","last_undegraded":"2024-04-24T23:00:21.487531+0000","last_fullsized":"2024-04-24T23:00:21.487531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:37:10.220625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361194+0000","last_change":"2024-04-24T23:00:16.456931+0000","last_active":"2024-04-24T23:00:22.361194+0000","last_peered":"2024-04-24T23:00:22.361194+0000","last_clean":"2024-04-24T23:00:22.361194+0000","last_became_active":"2024-04-24T23:00:16.456636+0000","last_became_peered":"2024-04-24T23:00:16.456636+0000","last_unstale":"2024-04-24T23:00:22.361194+0000","last_undegraded":"2024-04-24T23:00:22.361194+0000","last_fullsized":"2024-04-24T23:00:22.361194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:10.559806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:26.746469+0000","last_change":"2024-04-24T23:00:15.428189+0000","last_active":"2024-04-24T23:00:26.746469+0000","last_peered":"2024-04-24T23:00:26.746469+0000","last_clean":"2024-04-24T23:00:26.746469+0000","last_became_active":"2024-04-24T23:00:15.427837+0000","last_became_peered":"2024-04-24T23:00:15.427837+0000","last_unstale":"2024-04-24T23:00:26.746469+0000","last_undegraded":"2024-04-24T23:00:26.746469+0000","last_fullsized":"2024-04-24T23:00:26.746469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490499+0000","last_change":"2024-04-24T23:00:20.501448+0000","last_active":"2024-04-24T23:00:21.490499+0000","last_peered":"2024-04-24T23:00:21.490499+0000","last_clean":"2024-04-24T23:00:21.490499+0000","last_became_active":"2024-04-24T23:00:20.499677+0000","last_became_peered":"2024-04-24T23:00:20.499677+0000","last_unstale":"2024-04-24T23:00:21.490499+0000","last_undegraded":"2024-04-24T23:00:21.490499+0000","last_fullsized":"2024-04-24T23:00:21.490499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:42.508455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487010+0000","last_change":"2024-04-24T23:00:16.453438+0000","last_active":"2024-04-24T23:00:21.487010+0000","last_peered":"2024-04-24T23:00:21.487010+0000","last_clean":"2024-04-24T23:00:21.487010+0000","last_became_active":"2024-04-24T23:00:16.453033+0000","last_became_peered":"2024-04-24T23:00:16.453033+0000","last_unstale":"2024-04-24T23:00:21.487010+0000","last_undegraded":"2024-04-24T23:00:21.487010+0000","last_fullsized":"2024-04-24T23:00:21.487010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:52:36.324979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364820+0000","last_change":"2024-04-24T23:00:15.431369+0000","last_active":"2024-04-24T23:00:22.364820+0000","last_peered":"2024-04-24T23:00:22.364820+0000","last_clean":"2024-04-24T23:00:22.364820+0000","last_became_active":"2024-04-24T23:00:15.430254+0000","last_became_peered":"2024-04-24T23:00:15.430254+0000","last_unstale":"2024-04-24T23:00:22.364820+0000","last_undegraded":"2024-04-24T23:00:22.364820+0000","last_fullsized":"2024-04-24T23:00:22.364820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361853+0000","last_change":"2024-04-24T23:00:20.503369+0000","last_active":"2024-04-24T23:00:22.361853+0000","last_peered":"2024-04-24T23:00:22.361853+0000","last_clean":"2024-04-24T23:00:22.361853+0000","last_became_active":"2024-04-24T23:00:20.502285+0000","last_became_peered":"2024-04-24T23:00:20.502285+0000","last_unstale":"2024-04-24T23:00:22.361853+0000","last_undegraded":"2024-04-24T23:00:22.361853+0000","last_fullsized":"2024-04-24T23:00:22.361853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491903+0000","last_change":"2024-04-24T23:00:16.452958+0000","last_active":"2024-04-24T23:00:21.491903+0000","last_peered":"2024-04-24T23:00:21.491903+0000","last_clean":"2024-04-24T23:00:21.491903+0000","last_became_active":"2024-04-24T23:00:16.451611+0000","last_became_peered":"2024-04-24T23:00:16.451611+0000","last_unstale":"2024-04-24T23:00:21.491903+0000","last_undegraded":"2024-04-24T23:00:21.491903+0000","last_fullsized":"2024-04-24T23:00:21.491903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:06.283705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361667+0000","last_change":"2024-04-24T23:00:15.397614+0000","last_active":"2024-04-24T23:00:22.361667+0000","last_peered":"2024-04-24T23:00:22.361667+0000","last_clean":"2024-04-24T23:00:22.361667+0000","last_became_active":"2024-04-24T23:00:15.397253+0000","last_became_peered":"2024-04-24T23:00:15.397253+0000","last_unstale":"2024-04-24T23:00:22.361667+0000","last_undegraded":"2024-04-24T23:00:22.361667+0000","last_fullsized":"2024-04-24T23:00:22.361667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:38.560562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363337+0000","last_change":"2024-04-24T23:00:20.506736+0000","last_active":"2024-04-24T23:00:22.363337+0000","last_peered":"2024-04-24T23:00:22.363337+0000","last_clean":"2024-04-24T23:00:22.363337+0000","last_became_active":"2024-04-24T23:00:20.505504+0000","last_became_peered":"2024-04-24T23:00:20.505504+0000","last_unstale":"2024-04-24T23:00:22.363337+0000","last_undegraded":"2024-04-24T23:00:22.363337+0000","last_fullsized":"2024-04-24T23:00:22.363337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:10.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362210+0000","last_change":"2024-04-24T23:00:16.451217+0000","last_active":"2024-04-24T23:00:22.362210+0000","last_peered":"2024-04-24T23:00:22.362210+0000","last_clean":"2024-04-24T23:00:22.362210+0000","last_became_active":"2024-04-24T23:00:16.450149+0000","last_became_peered":"2024-04-24T23:00:16.450149+0000","last_unstale":"2024-04-24T23:00:22.362210+0000","last_undegraded":"2024-04-24T23:00:22.362210+0000","last_fullsized":"2024-04-24T23:00:22.362210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:36.124103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.749533+0000","last_change":"2024-04-24T23:00:15.428164+0000","last_active":"2024-04-24T23:00:21.749533+0000","last_peered":"2024-04-24T23:00:21.749533+0000","last_clean":"2024-04-24T23:00:21.749533+0000","last_became_active":"2024-04-24T23:00:15.427857+0000","last_became_peered":"2024-04-24T23:00:15.427857+0000","last_unstale":"2024-04-24T23:00:21.749533+0000","last_undegraded":"2024-04-24T23:00:21.749533+0000","last_fullsized":"2024-04-24T23:00:21.749533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489396+0000","last_change":"2024-04-24T23:00:20.507135+0000","last_active":"2024-04-24T23:00:21.489396+0000","last_peered":"2024-04-24T23:00:21.489396+0000","last_clean":"2024-04-24T23:00:21.489396+0000","last_became_active":"2024-04-24T23:00:20.506257+0000","last_became_peered":"2024-04-24T23:00:20.506257+0000","last_unstale":"2024-04-24T23:00:21.489396+0000","last_undegraded":"2024-04-24T23:00:21.489396+0000","last_fullsized":"2024-04-24T23:00:21.489396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491003+0000","last_change":"2024-04-24T23:00:20.497645+0000","last_active":"2024-04-24T23:00:21.491003+0000","last_peered":"2024-04-24T23:00:21.491003+0000","last_clean":"2024-04-24T23:00:21.491003+0000","last_became_active":"2024-04-24T23:00:20.496598+0000","last_became_peered":"2024-04-24T23:00:20.496598+0000","last_unstale":"2024-04-24T23:00:21.491003+0000","last_undegraded":"2024-04-24T23:00:21.491003+0000","last_fullsized":"2024-04-24T23:00:21.491003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:59.881296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489530+0000","last_change":"2024-04-24T23:00:16.478734+0000","last_active":"2024-04-24T23:00:21.489530+0000","last_peered":"2024-04-24T23:00:21.489530+0000","last_clean":"2024-04-24T23:00:21.489530+0000","last_became_active":"2024-04-24T23:00:16.477474+0000","last_became_peered":"2024-04-24T23:00:16.477474+0000","last_unstale":"2024-04-24T23:00:21.489530+0000","last_undegraded":"2024-04-24T23:00:21.489530+0000","last_fullsized":"2024-04-24T23:00:21.489530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.178504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486799+0000","last_change":"2024-04-24T23:00:15.405948+0000","last_active":"2024-04-24T23:00:21.486799+0000","last_peered":"2024-04-24T23:00:21.486799+0000","last_clean":"2024-04-24T23:00:21.486799+0000","last_became_active":"2024-04-24T23:00:15.405608+0000","last_became_peered":"2024-04-24T23:00:15.405608+0000","last_unstale":"2024-04-24T23:00:21.486799+0000","last_undegraded":"2024-04-24T23:00:21.486799+0000","last_fullsized":"2024-04-24T23:00:21.486799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488596+0000","last_change":"2024-04-24T23:00:20.493810+0000","last_active":"2024-04-24T23:00:21.488596+0000","last_peered":"2024-04-24T23:00:21.488596+0000","last_clean":"2024-04-24T23:00:21.488596+0000","last_became_active":"2024-04-24T23:00:20.492303+0000","last_became_peered":"2024-04-24T23:00:20.492303+0000","last_unstale":"2024-04-24T23:00:21.488596+0000","last_undegraded":"2024-04-24T23:00:21.488596+0000","last_fullsized":"2024-04-24T23:00:21.488596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:58:38.649805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.489593+0000","last_change":"2024-04-24T23:00:16.465460+0000","last_active":"2024-04-24T23:00:21.489593+0000","last_peered":"2024-04-24T23:00:21.489593+0000","last_clean":"2024-04-24T23:00:21.489593+0000","last_became_active":"2024-04-24T23:00:16.457311+0000","last_became_peered":"2024-04-24T23:00:16.457311+0000","last_unstale":"2024-04-24T23:00:21.489593+0000","last_undegraded":"2024-04-24T23:00:21.489593+0000","last_fullsized":"2024-04-24T23:00:21.489593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:43:08.876496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363401+0000","last_change":"2024-04-24T23:00:15.436608+0000","last_active":"2024-04-24T23:00:22.363401+0000","last_peered":"2024-04-24T23:00:22.363401+0000","last_clean":"2024-04-24T23:00:22.363401+0000","last_became_active":"2024-04-24T23:00:15.435730+0000","last_became_peered":"2024-04-24T23:00:15.435730+0000","last_unstale":"2024-04-24T23:00:22.363401+0000","last_undegraded":"2024-04-24T23:00:22.363401+0000","last_fullsized":"2024-04-24T23:00:22.363401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487390+0000","last_change":"2024-04-24T23:00:15.417533+0000","last_active":"2024-04-24T23:00:21.487390+0000","last_peered":"2024-04-24T23:00:21.487390+0000","last_clean":"2024-04-24T23:00:21.487390+0000","last_became_active":"2024-04-24T23:00:15.417226+0000","last_became_peered":"2024-04-24T23:00:15.417226+0000","last_unstale":"2024-04-24T23:00:21.487390+0000","last_undegraded":"2024-04-24T23:00:21.487390+0000","last_fullsized":"2024-04-24T23:00:21.487390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:05.898513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490640+0000","last_change":"2024-04-24T23:00:16.483374+0000","last_active":"2024-04-24T23:00:21.490640+0000","last_peered":"2024-04-24T23:00:21.490640+0000","last_clean":"2024-04-24T23:00:21.490640+0000","last_became_active":"2024-04-24T23:00:16.482676+0000","last_became_peered":"2024-04-24T23:00:16.482676+0000","last_unstale":"2024-04-24T23:00:21.490640+0000","last_undegraded":"2024-04-24T23:00:21.490640+0000","last_fullsized":"2024-04-24T23:00:21.490640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:05.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491288+0000","last_change":"2024-04-24T23:00:20.542916+0000","last_active":"2024-04-24T23:00:21.491288+0000","last_peered":"2024-04-24T23:00:21.491288+0000","last_clean":"2024-04-24T23:00:21.491288+0000","last_became_active":"2024-04-24T23:00:20.541822+0000","last_became_peered":"2024-04-24T23:00:20.541822+0000","last_unstale":"2024-04-24T23:00:21.491288+0000","last_undegraded":"2024-04-24T23:00:21.491288+0000","last_fullsized":"2024-04-24T23:00:21.491288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:31.840092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492280+0000","last_change":"2024-04-24T23:00:15.425495+0000","last_active":"2024-04-24T23:00:21.492280+0000","last_peered":"2024-04-24T23:00:21.492280+0000","last_clean":"2024-04-24T23:00:21.492280+0000","last_became_active":"2024-04-24T23:00:15.424739+0000","last_became_peered":"2024-04-24T23:00:15.424739+0000","last_unstale":"2024-04-24T23:00:21.492280+0000","last_undegraded":"2024-04-24T23:00:21.492280+0000","last_fullsized":"2024-04-24T23:00:21.492280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:49.740745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.748176+0000","last_change":"2024-04-24T23:00:16.454250+0000","last_active":"2024-04-24T23:00:21.748176+0000","last_peered":"2024-04-24T23:00:21.748176+0000","last_clean":"2024-04-24T23:00:21.748176+0000","last_became_active":"2024-04-24T23:00:16.453965+0000","last_became_peered":"2024-04-24T23:00:16.453965+0000","last_unstale":"2024-04-24T23:00:21.748176+0000","last_undegraded":"2024-04-24T23:00:21.748176+0000","last_fullsized":"2024-04-24T23:00:21.748176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364268+0000","last_change":"2024-04-24T23:00:20.510475+0000","last_active":"2024-04-24T23:00:22.364268+0000","last_peered":"2024-04-24T23:00:22.364268+0000","last_clean":"2024-04-24T23:00:22.364268+0000","last_became_active":"2024-04-24T23:00:20.509269+0000","last_became_peered":"2024-04-24T23:00:20.509269+0000","last_unstale":"2024-04-24T23:00:22.364268+0000","last_undegraded":"2024-04-24T23:00:22.364268+0000","last_fullsized":"2024-04-24T23:00:22.364268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:09.596902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361286+0000","last_change":"2024-04-24T23:00:16.456976+0000","last_active":"2024-04-24T23:00:22.361286+0000","last_peered":"2024-04-24T23:00:22.361286+0000","last_clean":"2024-04-24T23:00:22.361286+0000","last_became_active":"2024-04-24T23:00:16.456289+0000","last_became_peered":"2024-04-24T23:00:16.456289+0000","last_unstale":"2024-04-24T23:00:22.361286+0000","last_undegraded":"2024-04-24T23:00:22.361286+0000","last_fullsized":"2024-04-24T23:00:22.361286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363709+0000","last_change":"2024-04-24T23:00:16.471774+0000","last_active":"2024-04-24T23:00:22.363709+0000","last_peered":"2024-04-24T23:00:22.363709+0000","last_clean":"2024-04-24T23:00:22.363709+0000","last_became_active":"2024-04-24T23:00:16.466134+0000","last_became_peered":"2024-04-24T23:00:16.466134+0000","last_unstale":"2024-04-24T23:00:22.363709+0000","last_undegraded":"2024-04-24T23:00:22.363709+0000","last_fullsized":"2024-04-24T23:00:22.363709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:31.237423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486774+0000","last_change":"2024-04-24T23:00:16.465926+0000","last_active":"2024-04-24T23:00:21.486774+0000","last_peered":"2024-04-24T23:00:21.486774+0000","last_clean":"2024-04-24T23:00:21.486774+0000","last_became_active":"2024-04-24T23:00:16.465659+0000","last_became_peered":"2024-04-24T23:00:16.465659+0000","last_unstale":"2024-04-24T23:00:21.486774+0000","last_undegraded":"2024-04-24T23:00:21.486774+0000","last_fullsized":"2024-04-24T23:00:21.486774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:09:47.001195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.492033+0000","last_change":"2024-04-24T23:00:16.474929+0000","last_active":"2024-04-24T23:00:21.492033+0000","last_peered":"2024-04-24T23:00:21.492033+0000","last_clean":"2024-04-24T23:00:21.492033+0000","last_became_active":"2024-04-24T23:00:16.474181+0000","last_became_peered":"2024-04-24T23:00:16.474181+0000","last_unstale":"2024-04-24T23:00:21.492033+0000","last_undegraded":"2024-04-24T23:00:21.492033+0000","last_fullsized":"2024-04-24T23:00:21.492033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:56.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.365315+0000","last_change":"2024-04-24T23:00:16.458411+0000","last_active":"2024-04-24T23:00:22.365315+0000","last_peered":"2024-04-24T23:00:22.365315+0000","last_clean":"2024-04-24T23:00:22.365315+0000","last_became_active":"2024-04-24T23:00:16.457641+0000","last_became_peered":"2024-04-24T23:00:16.457641+0000","last_unstale":"2024-04-24T23:00:22.365315+0000","last_undegraded":"2024-04-24T23:00:22.365315+0000","last_fullsized":"2024-04-24T23:00:22.365315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:06.907656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364328+0000","last_change":"2024-04-24T23:00:16.470324+0000","last_active":"2024-04-24T23:00:22.364328+0000","last_peered":"2024-04-24T23:00:22.364328+0000","last_clean":"2024-04-24T23:00:22.364328+0000","last_became_active":"2024-04-24T23:00:16.469614+0000","last_became_peered":"2024-04-24T23:00:16.469614+0000","last_unstale":"2024-04-24T23:00:22.364328+0000","last_undegraded":"2024-04-24T23:00:22.364328+0000","last_fullsized":"2024-04-24T23:00:22.364328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:05.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.362165+0000","last_change":"2024-04-24T23:00:16.450764+0000","last_active":"2024-04-24T23:00:22.362165+0000","last_peered":"2024-04-24T23:00:22.362165+0000","last_clean":"2024-04-24T23:00:22.362165+0000","last_became_active":"2024-04-24T23:00:16.450561+0000","last_became_peered":"2024-04-24T23:00:16.450561+0000","last_unstale":"2024-04-24T23:00:22.362165+0000","last_undegraded":"2024-04-24T23:00:22.362165+0000","last_fullsized":"2024-04-24T23:00:22.362165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:30.426371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490926+0000","last_change":"2024-04-24T23:00:16.453953+0000","last_active":"2024-04-24T23:00:21.490926+0000","last_peered":"2024-04-24T23:00:21.490926+0000","last_clean":"2024-04-24T23:00:21.490926+0000","last_became_active":"2024-04-24T23:00:16.452345+0000","last_became_peered":"2024-04-24T23:00:16.452345+0000","last_unstale":"2024-04-24T23:00:21.490926+0000","last_undegraded":"2024-04-24T23:00:21.490926+0000","last_fullsized":"2024-04-24T23:00:21.490926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:58.273719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486575+0000","last_change":"2024-04-24T23:00:16.459030+0000","last_active":"2024-04-24T23:00:21.486575+0000","last_peered":"2024-04-24T23:00:21.486575+0000","last_clean":"2024-04-24T23:00:21.486575+0000","last_became_active":"2024-04-24T23:00:16.458402+0000","last_became_peered":"2024-04-24T23:00:16.458402+0000","last_unstale":"2024-04-24T23:00:21.486575+0000","last_undegraded":"2024-04-24T23:00:21.486575+0000","last_fullsized":"2024-04-24T23:00:21.486575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:33.558529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488396+0000","last_change":"2024-04-24T23:00:16.456818+0000","last_active":"2024-04-24T23:00:21.488396+0000","last_peered":"2024-04-24T23:00:21.488396+0000","last_clean":"2024-04-24T23:00:21.488396+0000","last_became_active":"2024-04-24T23:00:16.453065+0000","last_became_peered":"2024-04-24T23:00:16.453065+0000","last_unstale":"2024-04-24T23:00:21.488396+0000","last_undegraded":"2024-04-24T23:00:21.488396+0000","last_fullsized":"2024-04-24T23:00:21.488396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:02.728439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.747938+0000","last_change":"2024-04-24T23:00:16.447668+0000","last_active":"2024-04-24T23:00:21.747938+0000","last_peered":"2024-04-24T23:00:21.747938+0000","last_clean":"2024-04-24T23:00:21.747938+0000","last_became_active":"2024-04-24T23:00:16.447370+0000","last_became_peered":"2024-04-24T23:00:16.447370+0000","last_unstale":"2024-04-24T23:00:21.747938+0000","last_undegraded":"2024-04-24T23:00:21.747938+0000","last_fullsized":"2024-04-24T23:00:21.747938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.490570+0000","last_change":"2024-04-24T23:00:16.478716+0000","last_active":"2024-04-24T23:00:21.490570+0000","last_peered":"2024-04-24T23:00:21.490570+0000","last_clean":"2024-04-24T23:00:21.490570+0000","last_became_active":"2024-04-24T23:00:16.477982+0000","last_became_peered":"2024-04-24T23:00:16.477982+0000","last_unstale":"2024-04-24T23:00:21.490570+0000","last_undegraded":"2024-04-24T23:00:21.490570+0000","last_fullsized":"2024-04-24T23:00:21.490570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:04.285389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360946+0000","last_change":"2024-04-24T23:00:16.449265+0000","last_active":"2024-04-24T23:00:22.360946+0000","last_peered":"2024-04-24T23:00:22.360946+0000","last_clean":"2024-04-24T23:00:22.360946+0000","last_became_active":"2024-04-24T23:00:16.446583+0000","last_became_peered":"2024-04-24T23:00:16.446583+0000","last_unstale":"2024-04-24T23:00:22.360946+0000","last_undegraded":"2024-04-24T23:00:22.360946+0000","last_fullsized":"2024-04-24T23:00:22.360946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:38.429072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488019+0000","last_change":"2024-04-24T23:00:16.483354+0000","last_active":"2024-04-24T23:00:21.488019+0000","last_peered":"2024-04-24T23:00:21.488019+0000","last_clean":"2024-04-24T23:00:21.488019+0000","last_became_active":"2024-04-24T23:00:16.483079+0000","last_became_peered":"2024-04-24T23:00:16.483079+0000","last_unstale":"2024-04-24T23:00:21.488019+0000","last_undegraded":"2024-04-24T23:00:21.488019+0000","last_fullsized":"2024-04-24T23:00:21.488019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:57:02.861698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.364543+0000","last_change":"2024-04-24T23:00:16.472605+0000","last_active":"2024-04-24T23:00:22.364543+0000","last_peered":"2024-04-24T23:00:22.364543+0000","last_clean":"2024-04-24T23:00:22.364543+0000","last_became_active":"2024-04-24T23:00:16.466076+0000","last_became_peered":"2024-04-24T23:00:16.466076+0000","last_unstale":"2024-04-24T23:00:22.364543+0000","last_undegraded":"2024-04-24T23:00:22.364543+0000","last_fullsized":"2024-04-24T23:00:22.364543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488702+0000","last_change":"2024-04-24T23:00:16.457737+0000","last_active":"2024-04-24T23:00:21.488702+0000","last_peered":"2024-04-24T23:00:21.488702+0000","last_clean":"2024-04-24T23:00:21.488702+0000","last_became_active":"2024-04-24T23:00:16.453949+0000","last_became_peered":"2024-04-24T23:00:16.453949+0000","last_unstale":"2024-04-24T23:00:21.488702+0000","last_undegraded":"2024-04-24T23:00:21.488702+0000","last_fullsized":"2024-04-24T23:00:21.488702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:08.928463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.486501+0000","last_change":"2024-04-24T23:00:16.452839+0000","last_active":"2024-04-24T23:00:21.486501+0000","last_peered":"2024-04-24T23:00:21.486501+0000","last_clean":"2024-04-24T23:00:21.486501+0000","last_became_active":"2024-04-24T23:00:16.445253+0000","last_became_peered":"2024-04-24T23:00:16.445253+0000","last_unstale":"2024-04-24T23:00:21.486501+0000","last_undegraded":"2024-04-24T23:00:21.486501+0000","last_fullsized":"2024-04-24T23:00:21.486501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:23.938299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.488118+0000","last_change":"2024-04-24T23:00:16.455784+0000","last_active":"2024-04-24T23:00:21.488118+0000","last_peered":"2024-04-24T23:00:21.488118+0000","last_clean":"2024-04-24T23:00:21.488118+0000","last_became_active":"2024-04-24T23:00:16.454953+0000","last_became_peered":"2024-04-24T23:00:16.454953+0000","last_unstale":"2024-04-24T23:00:21.488118+0000","last_undegraded":"2024-04-24T23:00:21.488118+0000","last_fullsized":"2024-04-24T23:00:21.488118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:32.545524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363621+0000","last_change":"2024-04-24T23:00:16.468365+0000","last_active":"2024-04-24T23:00:22.363621+0000","last_peered":"2024-04-24T23:00:22.363621+0000","last_clean":"2024-04-24T23:00:22.363621+0000","last_became_active":"2024-04-24T23:00:16.467630+0000","last_became_peered":"2024-04-24T23:00:16.467630+0000","last_unstale":"2024-04-24T23:00:22.363621+0000","last_undegraded":"2024-04-24T23:00:22.363621+0000","last_fullsized":"2024-04-24T23:00:22.363621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.363514+0000","last_change":"2024-04-24T23:00:16.456188+0000","last_active":"2024-04-24T23:00:22.363514+0000","last_peered":"2024-04-24T23:00:22.363514+0000","last_clean":"2024-04-24T23:00:22.363514+0000","last_became_active":"2024-04-24T23:00:16.455114+0000","last_became_peered":"2024-04-24T23:00:16.455114+0000","last_unstale":"2024-04-24T23:00:22.363514+0000","last_undegraded":"2024-04-24T23:00:22.363514+0000","last_fullsized":"2024-04-24T23:00:22.363514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:36.124103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360885+0000","last_change":"2024-04-24T23:00:16.450776+0000","last_active":"2024-04-24T23:00:22.360885+0000","last_peered":"2024-04-24T23:00:22.360885+0000","last_clean":"2024-04-24T23:00:22.360885+0000","last_became_active":"2024-04-24T23:00:16.450466+0000","last_became_peered":"2024-04-24T23:00:16.450466+0000","last_unstale":"2024-04-24T23:00:22.360885+0000","last_undegraded":"2024-04-24T23:00:22.360885+0000","last_fullsized":"2024-04-24T23:00:22.360885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:32.331306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361100+0000","last_change":"2024-04-24T23:00:16.450743+0000","last_active":"2024-04-24T23:00:22.361100+0000","last_peered":"2024-04-24T23:00:22.361100+0000","last_clean":"2024-04-24T23:00:22.361100+0000","last_became_active":"2024-04-24T23:00:16.450279+0000","last_became_peered":"2024-04-24T23:00:16.450279+0000","last_unstale":"2024-04-24T23:00:22.361100+0000","last_undegraded":"2024-04-24T23:00:22.361100+0000","last_fullsized":"2024-04-24T23:00:22.361100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:00.869015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361531+0000","last_change":"2024-04-24T23:00:16.446745+0000","last_active":"2024-04-24T23:00:22.361531+0000","last_peered":"2024-04-24T23:00:22.361531+0000","last_clean":"2024-04-24T23:00:22.361531+0000","last_became_active":"2024-04-24T23:00:16.446317+0000","last_became_peered":"2024-04-24T23:00:16.446317+0000","last_unstale":"2024-04-24T23:00:22.361531+0000","last_undegraded":"2024-04-24T23:00:22.361531+0000","last_fullsized":"2024-04-24T23:00:22.361531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:47.110869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.749496+0000","last_change":"2024-04-24T23:00:16.446352+0000","last_active":"2024-04-24T23:00:21.749496+0000","last_peered":"2024-04-24T23:00:21.749496+0000","last_clean":"2024-04-24T23:00:21.749496+0000","last_became_active":"2024-04-24T23:00:16.445839+0000","last_became_peered":"2024-04-24T23:00:16.445839+0000","last_unstale":"2024-04-24T23:00:21.749496+0000","last_undegraded":"2024-04-24T23:00:21.749496+0000","last_fullsized":"2024-04-24T23:00:21.749496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.487985+0000","last_change":"2024-04-24T23:00:16.451439+0000","last_active":"2024-04-24T23:00:21.487985+0000","last_peered":"2024-04-24T23:00:21.487985+0000","last_clean":"2024-04-24T23:00:21.487985+0000","last_became_active":"2024-04-24T23:00:16.450293+0000","last_became_peered":"2024-04-24T23:00:16.450293+0000","last_unstale":"2024-04-24T23:00:21.487985+0000","last_undegraded":"2024-04-24T23:00:21.487985+0000","last_fullsized":"2024-04-24T23:00:21.487985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:19.586817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360593+0000","last_change":"2024-04-24T23:00:16.482222+0000","last_active":"2024-04-24T23:00:22.360593+0000","last_peered":"2024-04-24T23:00:22.360593+0000","last_clean":"2024-04-24T23:00:22.360593+0000","last_became_active":"2024-04-24T23:00:16.481897+0000","last_became_peered":"2024-04-24T23:00:16.481897+0000","last_unstale":"2024-04-24T23:00:22.360593+0000","last_undegraded":"2024-04-24T23:00:22.360593+0000","last_fullsized":"2024-04-24T23:00:22.360593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361442+0000","last_change":"2024-04-24T23:00:16.482100+0000","last_active":"2024-04-24T23:00:22.361442+0000","last_peered":"2024-04-24T23:00:22.361442+0000","last_clean":"2024-04-24T23:00:22.361442+0000","last_became_active":"2024-04-24T23:00:16.481832+0000","last_became_peered":"2024-04-24T23:00:16.481832+0000","last_unstale":"2024-04-24T23:00:22.361442+0000","last_undegraded":"2024-04-24T23:00:22.361442+0000","last_fullsized":"2024-04-24T23:00:22.361442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.360651+0000","last_change":"2024-04-24T23:00:16.466121+0000","last_active":"2024-04-24T23:00:22.360651+0000","last_peered":"2024-04-24T23:00:22.360651+0000","last_clean":"2024-04-24T23:00:22.360651+0000","last_became_active":"2024-04-24T23:00:16.465749+0000","last_became_peered":"2024-04-24T23:00:16.465749+0000","last_unstale":"2024-04-24T23:00:22.360651+0000","last_undegraded":"2024-04-24T23:00:22.360651+0000","last_fullsized":"2024-04-24T23:00:22.360651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:05.734745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361597+0000","last_change":"2024-04-24T23:00:16.481682+0000","last_active":"2024-04-24T23:00:22.361597+0000","last_peered":"2024-04-24T23:00:22.361597+0000","last_clean":"2024-04-24T23:00:22.361597+0000","last_became_active":"2024-04-24T23:00:16.481381+0000","last_became_peered":"2024-04-24T23:00:16.481381+0000","last_unstale":"2024-04-24T23:00:22.361597+0000","last_undegraded":"2024-04-24T23:00:22.361597+0000","last_fullsized":"2024-04-24T23:00:22.361597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:14.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491105+0000","last_change":"2024-04-24T23:00:16.461984+0000","last_active":"2024-04-24T23:00:21.491105+0000","last_peered":"2024-04-24T23:00:21.491105+0000","last_clean":"2024-04-24T23:00:21.491105+0000","last_became_active":"2024-04-24T23:00:16.461267+0000","last_became_peered":"2024-04-24T23:00:16.461267+0000","last_unstale":"2024-04-24T23:00:21.491105+0000","last_undegraded":"2024-04-24T23:00:21.491105+0000","last_fullsized":"2024-04-24T23:00:21.491105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:53:00.776972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:21.491640+0000","last_change":"2024-04-24T23:00:16.460191+0000","last_active":"2024-04-24T23:00:21.491640+0000","last_peered":"2024-04-24T23:00:21.491640+0000","last_clean":"2024-04-24T23:00:21.491640+0000","last_became_active":"2024-04-24T23:00:16.459445+0000","last_became_peered":"2024-04-24T23:00:16.459445+0000","last_unstale":"2024-04-24T23:00:21.491640+0000","last_undegraded":"2024-04-24T23:00:21.491640+0000","last_fullsized":"2024-04-24T23:00:21.491640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:12.313822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-24T23:00:22.361195+0000","last_change":"2024-04-24T23:00:16.450409+0000","last_active":"2024-04-24T23:00:22.361195+0000","last_peered":"2024-04-24T23:00:22.361195+0000","last_clean":"2024-04-24T23:00:22.361195+0000","last_became_active":"2024-04-24T23:00:16.450061+0000","last_became_peered":"2024-04-24T23:00:16.450061+0000","last_unstale":"2024-04-24T23:00:22.361195+0000","last_undegraded":"2024-04-24T23:00:22.361195+0000","last_fullsized":"2024-04-24T23:00:22.361195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:23.938299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":101627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":102085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":327680,"data_stored":691941,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":101559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":101503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":691963,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:00:37.616 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T23:00:37.616 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-24T23:00:37.616 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-24T23:00:37.617 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-24T23:00:37.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.767+0000 7fd5d7b42640 1 Processor -- start 2024-04-24T23:00:37.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.767+0000 7fd5d7b42640 1 -- start start 2024-04-24T23:00:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d7b42640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5d006fd40 0x7fd5d013f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d7b42640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd5d0146080 0x7fd5d014fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d7b42640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d00b5b20 con 0x7fd5d00afc30 2024-04-24T23:00:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d7b42640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd5d01454e0 con 0x7fd5d0146080 2024-04-24T23:00:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d7b42640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d00b5e00 con 0x7fd5d006fd40 2024-04-24T23:00:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d60df640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd5d0146080 0x7fd5d014fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d58de640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5d006fd40 0x7fd5d013f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d60df640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd5d0146080 0x7fd5d014fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.43:45940/0 (socket says 172.21.15.43:45940) 2024-04-24T23:00:37.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d60df640 1 -- 172.21.15.43:0/2863189892 learned_addr learned my addr 172.21.15.43:0/2863189892 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:37.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d50dd640 1 --1- 172.21.15.43:0/2863189892 >> v1:172.21.15.162:6789/0 conn(0x7fd5d00afc30 0x7fd5d0145970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.43:53624/0 (socket says 172.21.15.43:53624) 2024-04-24T23:00:37.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d58de640 1 -- 172.21.15.43:0/2863189892 >> v2:172.21.15.162:3300/0 conn(0x7fd5d0146080 msgr2=0x7fd5d014fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:37.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d58de640 1 --2- 172.21.15.43:0/2863189892 >> v2:172.21.15.162:3300/0 conn(0x7fd5d0146080 0x7fd5d014fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d58de640 1 -- 172.21.15.43:0/2863189892 >> v1:172.21.15.162:6789/0 conn(0x7fd5d00afc30 legacy=0x7fd5d0145970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d58de640 1 -- 172.21.15.43:0/2863189892 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d00b60e0 con 0x7fd5d006fd40 2024-04-24T23:00:37.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d58de640 1 --2- 172.21.15.43:0/2863189892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5d006fd40 0x7fd5d013f310 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0097c0 tx=0x7fd5cc01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53a39b1465a7add1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d48dc640 1 -- 172.21.15.43:0/2863189892 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0b1070 con 0x7fd5d006fd40 2024-04-24T23:00:37.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d48dc640 1 -- 172.21.15.43:0/2863189892 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5cc0ac600 con 0x7fd5d006fd40 2024-04-24T23:00:37.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.771+0000 7fd5d48dc640 1 -- 172.21.15.43:0/2863189892 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0ac9d0 con 0x7fd5d006fd40 2024-04-24T23:00:37.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 -- 172.21.15.43:0/2863189892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5d006fd40 msgr2=0x7fd5d013f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 --2- 172.21.15.43:0/2863189892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5d006fd40 0x7fd5d013f310 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0097c0 tx=0x7fd5cc01c380 comp rx=0 tx=0).stop 2024-04-24T23:00:37.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 -- 172.21.15.43:0/2863189892 shutdown_connections 2024-04-24T23:00:37.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 --2- 172.21.15.43:0/2863189892 >> v2:172.21.15.162:3300/0 conn(0x7fd5d0146080 0x7fd5d014fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 --2- 172.21.15.43:0/2863189892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5d006fd40 0x7fd5d013f310 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 -- 172.21.15.43:0/2863189892 >> 172.21.15.43:0/2863189892 conn(0x7fd5d006b5f0 msgr2=0x7fd5d006ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:37.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 -- 172.21.15.43:0/2863189892 shutdown_connections 2024-04-24T23:00:37.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 -- 172.21.15.43:0/2863189892 wait complete. 2024-04-24T23:00:37.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 Processor -- start 2024-04-24T23:00:37.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 -- start start 2024-04-24T23:00:37.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5d006fd40 0x7fd5d0149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5d0146080 0x7fd5d0147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5d0071a80 0x7fd5d0071f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d0152ba0 con 0x7fd5d006fd40 2024-04-24T23:00:37.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d0152a20 con 0x7fd5d0071a80 2024-04-24T23:00:37.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d0152d20 con 0x7fd5d0146080 2024-04-24T23:00:37.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d58de640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5d006fd40 0x7fd5d0149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d58de640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5d006fd40 0x7fd5d0149000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43166/0 (socket says 172.21.15.43:43166) 2024-04-24T23:00:37.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d58de640 1 -- 172.21.15.43:0/1777689339 learned_addr learned my addr 172.21.15.43:0/1777689339 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:37.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d60df640 1 --2- 172.21.15.43:0/1777689339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5d0071a80 0x7fd5d0071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d50dd640 1 --2- 172.21.15.43:0/1777689339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5d0146080 0x7fd5d0147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d58de640 1 -- 172.21.15.43:0/1777689339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5d0146080 msgr2=0x7fd5d0147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d58de640 1 --2- 172.21.15.43:0/1777689339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5d0146080 0x7fd5d0147dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d58de640 1 -- 172.21.15.43:0/1777689339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5d0071a80 msgr2=0x7fd5d0071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d58de640 1 --2- 172.21.15.43:0/1777689339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5d0071a80 0x7fd5d0071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d58de640 1 -- 172.21.15.43:0/1777689339 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d0072450 con 0x7fd5d006fd40 2024-04-24T23:00:37.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d60df640 1 --2- 172.21.15.43:0/1777689339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5d0071a80 0x7fd5d0071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:37.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d58de640 1 --2- 172.21.15.43:0/1777689339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5d006fd40 0x7fd5d0149000 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc019fb0 tx=0x7fd5cc01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5c67fc640 1 -- 172.21.15.43:0/1777689339 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0b1040 con 0x7fd5d006fd40 2024-04-24T23:00:37.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5c67fc640 1 -- 172.21.15.43:0/1777689339 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5cc0ac400 con 0x7fd5d006fd40 2024-04-24T23:00:37.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5c67fc640 1 -- 172.21.15.43:0/1777689339 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc006e20 con 0x7fd5d006fd40 2024-04-24T23:00:37.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 -- 172.21.15.43:0/1777689339 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d0135c00 con 0x7fd5d006fd40 2024-04-24T23:00:37.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 -- 172.21.15.43:0/1777689339 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d0148830 con 0x7fd5d006fd40 2024-04-24T23:00:37.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.775+0000 7fd5d7b42640 1 -- 172.21.15.43:0/1777689339 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d00682c0 con 0x7fd5d006fd40 2024-04-24T23:00:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.779+0000 7fd5c67fc640 1 -- 172.21.15.43:0/1777689339 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd5cc0be030 con 0x7fd5d006fd40 2024-04-24T23:00:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.779+0000 7fd5c67fc640 1 --2- 172.21.15.43:0/1777689339 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd5b40678c0 0x7fd5b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.779+0000 7fd5c67fc640 1 -- 172.21.15.43:0/1777689339 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd5cc11f960 con 0x7fd5d006fd40 2024-04-24T23:00:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.779+0000 7fd5d50dd640 1 --2- 172.21.15.43:0/1777689339 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd5b40678c0 0x7fd5b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.779+0000 7fd5d50dd640 1 --2- 172.21.15.43:0/1777689339 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd5b40678c0 0x7fd5b4069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd5d01e2160 tx=0x7fd5c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.783+0000 7fd5c67fc640 1 -- 172.21.15.43:0/1777689339 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd5cc0c5060 con 0x7fd5d006fd40 2024-04-24T23:00:37.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.967+0000 7fd5d7b42640 1 -- 172.21.15.43:0/1777689339 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd5d0148310 con 0x7fd5d006fd40 2024-04-24T23:00:37.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.971+0000 7fd5c67fc640 1 -- 172.21.15.43:0/1777689339 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd5cc016090 con 0x7fd5d006fd40 2024-04-24T23:00:37.975 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:37.975 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-24T23:00:37.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.971+0000 7fd5d7b42640 1 -- 172.21.15.43:0/1777689339 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd5b40678c0 msgr2=0x7fd5b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.971+0000 7fd5d7b42640 1 --2- 172.21.15.43:0/1777689339 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd5b40678c0 0x7fd5b4069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd5d01e2160 tx=0x7fd5c0009040 comp rx=0 tx=0).stop 2024-04-24T23:00:37.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.971+0000 7fd5d7b42640 1 -- 172.21.15.43:0/1777689339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5d006fd40 msgr2=0x7fd5d0149000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:37.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.971+0000 7fd5d7b42640 1 --2- 172.21.15.43:0/1777689339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5d006fd40 0x7fd5d0149000 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc019fb0 tx=0x7fd5cc01abc0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.971+0000 7fd5d7b42640 1 -- 172.21.15.43:0/1777689339 shutdown_connections 2024-04-24T23:00:37.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.971+0000 7fd5d7b42640 1 --2- 172.21.15.43:0/1777689339 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fd5b40678c0 0x7fd5b4069d80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.971+0000 7fd5d7b42640 1 --2- 172.21.15.43:0/1777689339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5d0071a80 0x7fd5d0071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.971+0000 7fd5d7b42640 1 --2- 172.21.15.43:0/1777689339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5d0146080 0x7fd5d0147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.971+0000 7fd5d7b42640 1 --2- 172.21.15.43:0/1777689339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5d006fd40 0x7fd5d0149000 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:37.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.971+0000 7fd5d7b42640 1 -- 172.21.15.43:0/1777689339 >> 172.21.15.43:0/1777689339 conn(0x7fd5d006b5f0 msgr2=0x7fd5d00b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:37.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.971+0000 7fd5d7b42640 1 -- 172.21.15.43:0/1777689339 shutdown_connections 2024-04-24T23:00:37.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:37.971+0000 7fd5d7b42640 1 -- 172.21.15.43:0/1777689339 wait complete. 2024-04-24T23:00:37.993 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-24T23:00:37.993 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:38.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.103+0000 7fb70af1a640 1 Processor -- start 2024-04-24T23:00:38.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.103+0000 7fb70af1a640 1 -- start start 2024-04-24T23:00:38.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.103+0000 7fb70af1a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb7040b2500 0x7fb704145450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.103+0000 7fb70af1a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb704145990 0x7fb70413f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.103+0000 7fb70af1a640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb704070060 con 0x7fb70413f730 2024-04-24T23:00:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.103+0000 7fb70af1a640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fb7040b28e0 con 0x7fb7040b2500 2024-04-24T23:00:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.103+0000 7fb70af1a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb7040af8f0 con 0x7fb704145990 2024-04-24T23:00:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb708cb6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb7040b2500 0x7fb704145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb7094b7640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb70413f730 0x7fb7041489c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54598/0 (socket says 172.21.15.43:54598) 2024-04-24T23:00:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb708cb6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb7040b2500 0x7fb704145450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43182/0 (socket says 172.21.15.43:43182) 2024-04-24T23:00:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb7094b7640 1 -- 172.21.15.43:0/642959265 learned_addr learned my addr 172.21.15.43:0/642959265 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb703fff640 1 --2- 172.21.15.43:0/642959265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb704145990 0x7fb70413f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb708cb6640 1 -- 172.21.15.43:0/642959265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb704145990 msgr2=0x7fb70413f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb708cb6640 1 --2- 172.21.15.43:0/642959265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb704145990 0x7fb70413f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb708cb6640 1 -- 172.21.15.43:0/642959265 >> v1:172.21.15.43:6789/0 conn(0x7fb70413f730 legacy=0x7fb7041489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb7037fe640 1 -- 172.21.15.43:0/642959265 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2421827798 0 0) 0x7fb704070060 con 0x7fb70413f730 2024-04-24T23:00:38.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb708cb6640 1 -- 172.21.15.43:0/642959265 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70406fb40 con 0x7fb7040b2500 2024-04-24T23:00:38.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb703fff640 1 --2- 172.21.15.43:0/642959265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb704145990 0x7fb70413f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:38.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb708cb6640 1 --2- 172.21.15.43:0/642959265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7040b2500 0x7fb704145450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80097c0 tx=0x7fb6f801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604a1f8d4393f0c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:38.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb7037fe640 1 -- 172.21.15.43:0/642959265 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80b0070 con 0x7fb7040b2500 2024-04-24T23:00:38.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb7037fe640 1 -- 172.21.15.43:0/642959265 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f80ab600 con 0x7fb7040b2500 2024-04-24T23:00:38.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb7037fe640 1 -- 172.21.15.43:0/642959265 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7040b63c0 con 0x7fb7040b2500 2024-04-24T23:00:38.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb70af1a640 1 -- 172.21.15.43:0/642959265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7040b2500 msgr2=0x7fb704145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb70af1a640 1 --2- 172.21.15.43:0/642959265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7040b2500 0x7fb704145450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80097c0 tx=0x7fb6f801c4a0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb70af1a640 1 -- 172.21.15.43:0/642959265 shutdown_connections 2024-04-24T23:00:38.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb70af1a640 1 --2- 172.21.15.43:0/642959265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb704145990 0x7fb70413f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb70af1a640 1 --2- 172.21.15.43:0/642959265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7040b2500 0x7fb704145450 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb70af1a640 1 -- 172.21.15.43:0/642959265 >> 172.21.15.43:0/642959265 conn(0x7fb7040b5690 msgr2=0x7fb7040b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:38.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb70af1a640 1 -- 172.21.15.43:0/642959265 shutdown_connections 2024-04-24T23:00:38.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.107+0000 7fb70af1a640 1 -- 172.21.15.43:0/642959265 wait complete. 2024-04-24T23:00:38.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb70af1a640 1 Processor -- start 2024-04-24T23:00:38.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb70af1a640 1 -- start start 2024-04-24T23:00:38.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb70af1a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb7040b2500 0x7fb70413c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb70af1a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb70413f730 0x7fb704138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb70af1a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb704145990 0x7fb7041e1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb70af1a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb7040b4af0 con 0x7fb704145990 2024-04-24T23:00:38.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb70af1a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb7040b54a0 con 0x7fb70413f730 2024-04-24T23:00:38.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb70af1a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb7040b4c70 con 0x7fb7040b2500 2024-04-24T23:00:38.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb7094b7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb704145990 0x7fb7041e1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb7094b7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb704145990 0x7fb7041e1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43198/0 (socket says 172.21.15.43:43198) 2024-04-24T23:00:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb7094b7640 1 -- 172.21.15.43:0/2169242480 learned_addr learned my addr 172.21.15.43:0/2169242480 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb708cb6640 1 --2- 172.21.15.43:0/2169242480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb7040b2500 0x7fb70413c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb703fff640 1 --2- 172.21.15.43:0/2169242480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb70413f730 0x7fb704138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb7094b7640 1 -- 172.21.15.43:0/2169242480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb7040b2500 msgr2=0x7fb70413c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb7094b7640 1 --2- 172.21.15.43:0/2169242480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb7040b2500 0x7fb70413c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb7094b7640 1 -- 172.21.15.43:0/2169242480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb70413f730 msgr2=0x7fb704138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb7094b7640 1 --2- 172.21.15.43:0/2169242480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb70413f730 0x7fb704138770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb7094b7640 1 -- 172.21.15.43:0/2169242480 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7041486a0 con 0x7fb704145990 2024-04-24T23:00:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb7094b7640 1 --2- 172.21.15.43:0/2169242480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb704145990 0x7fb7041e1060 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c730 tx=0x7fb6fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb7017fa640 1 -- 172.21.15.43:0/2169242480 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc018070 con 0x7fb704145990 2024-04-24T23:00:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb7017fa640 1 -- 172.21.15.43:0/2169242480 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6fc00ce40 con 0x7fb704145990 2024-04-24T23:00:38.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb70af1a640 1 -- 172.21.15.43:0/2169242480 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70413d050 con 0x7fb704145990 2024-04-24T23:00:38.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb7017fa640 1 -- 172.21.15.43:0/2169242480 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00a860 con 0x7fb704145990 2024-04-24T23:00:38.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb70af1a640 1 -- 172.21.15.43:0/2169242480 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb704147a50 con 0x7fb704145990 2024-04-24T23:00:38.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb70af1a640 1 -- 172.21.15.43:0/2169242480 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70404f580 con 0x7fb704145990 2024-04-24T23:00:38.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb7017fa640 1 -- 172.21.15.43:0/2169242480 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb6fc01b070 con 0x7fb704145990 2024-04-24T23:00:38.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb7017fa640 1 --2- 172.21.15.43:0/2169242480 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb6f00678c0 0x7fb6f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb7017fa640 1 -- 172.21.15.43:0/2169242480 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb6fc0854c0 con 0x7fb704145990 2024-04-24T23:00:38.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.111+0000 7fb708cb6640 1 --2- 172.21.15.43:0/2169242480 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb6f00678c0 0x7fb6f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.115+0000 7fb708cb6640 1 --2- 172.21.15.43:0/2169242480 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb6f00678c0 0x7fb6f0069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80ad000 tx=0x7fb6f80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:38.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.115+0000 7fb7017fa640 1 -- 172.21.15.43:0/2169242480 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fb6fc055d50 con 0x7fb704145990 2024-04-24T23:00:38.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.271+0000 7fb70af1a640 1 -- 172.21.15.43:0/2169242480 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb704143540 con 0x7fb704145990 2024-04-24T23:00:38.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.275+0000 7fb7017fa640 1 -- 172.21.15.43:0/2169242480 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18518 (secure 0 0 0) 0x7fb6fc055650 con 0x7fb704145990 2024-04-24T23:00:38.280 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:38.280 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:20.863941+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.275+0000 7fb70af1a640 1 -- 172.21.15.43:0/2169242480 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb6f00678c0 msgr2=0x7fb6f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.275+0000 7fb70af1a640 1 --2- 172.21.15.43:0/2169242480 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb6f00678c0 0x7fb6f0069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80ad000 tx=0x7fb6f80a6000 comp rx=0 tx=0).stop 2024-04-24T23:00:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.275+0000 7fb70af1a640 1 -- 172.21.15.43:0/2169242480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb704145990 msgr2=0x7fb7041e1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.275+0000 7fb70af1a640 1 --2- 172.21.15.43:0/2169242480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb704145990 0x7fb7041e1060 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c730 tx=0x7fb6fc00cbf0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.275+0000 7fb70af1a640 1 -- 172.21.15.43:0/2169242480 shutdown_connections 2024-04-24T23:00:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.275+0000 7fb70af1a640 1 --2- 172.21.15.43:0/2169242480 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb6f00678c0 0x7fb6f0069d80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.275+0000 7fb70af1a640 1 --2- 172.21.15.43:0/2169242480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb704145990 0x7fb7041e1060 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.275+0000 7fb70af1a640 1 --2- 172.21.15.43:0/2169242480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb70413f730 0x7fb704138770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.275+0000 7fb70af1a640 1 --2- 172.21.15.43:0/2169242480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb7040b2500 0x7fb70413c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.275+0000 7fb70af1a640 1 -- 172.21.15.43:0/2169242480 >> 172.21.15.43:0/2169242480 conn(0x7fb7040b5690 msgr2=0x7fb7040b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:38.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.275+0000 7fb70af1a640 1 -- 172.21.15.43:0/2169242480 shutdown_connections 2024-04-24T23:00:38.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.275+0000 7fb70af1a640 1 -- 172.21.15.43:0/2169242480 wait complete. 2024-04-24T23:00:38.298 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:00:02.322280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:00:14.136303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:00:14.764010+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T23:00:18.504756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:00:38.299 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:00:38.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.411+0000 7f98e13c0640 1 Processor -- start 2024-04-24T23:00:38.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.411+0000 7f98e13c0640 1 -- start start 2024-04-24T23:00:38.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98e13c0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f98dc0b37f0 0x7f98dc072820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98e13c0640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f98dc0733a0 0x7f98dc144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98e13c0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98dc0b3bd0 con 0x7f98dc072d60 2024-04-24T23:00:38.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98e13c0640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f98dc0b24f0 con 0x7f98dc0733a0 2024-04-24T23:00:38.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98e13c0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f98dc0b2980 con 0x7f98dc0b37f0 2024-04-24T23:00:38.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98da7fc640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f98dc0733a0 0x7f98dc144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98da7fc640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f98dc0733a0 0x7f98dc144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43212/0 (socket says 172.21.15.43:43212) 2024-04-24T23:00:38.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98da7fc640 1 -- 172.21.15.43:0/78268599 learned_addr learned my addr 172.21.15.43:0/78268599 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:38.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98da7fc640 1 -- 172.21.15.43:0/78268599 >> v2:172.21.15.162:3300/0 conn(0x7f98dc0b37f0 msgr2=0x7f98dc072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:38.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98daffd640 1 --2- 172.21.15.43:0/78268599 >> v2:172.21.15.162:3300/0 conn(0x7f98dc0b37f0 0x7f98dc072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98da7fc640 1 --2- 172.21.15.43:0/78268599 >> v2:172.21.15.162:3300/0 conn(0x7f98dc0b37f0 0x7f98dc072820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98da7fc640 1 -- 172.21.15.43:0/78268599 >> v1:172.21.15.162:6789/0 conn(0x7f98dc072d60 legacy=0x7f98dc1477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:38.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98da7fc640 1 -- 172.21.15.43:0/78268599 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98dc06fdd0 con 0x7f98dc0733a0 2024-04-24T23:00:38.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98daffd640 1 --2- 172.21.15.43:0/78268599 >> v2:172.21.15.162:3300/0 conn(0x7f98dc0b37f0 0x7f98dc072820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:38.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98da7fc640 1 --2- 172.21.15.43:0/78268599 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98dc0733a0 0x7f98dc144260 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f98dc06e420 tx=0x7f98d001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684f6036452f24d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:38.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98d9ffb640 1 -- 172.21.15.43:0/78268599 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d00b0070 con 0x7f98dc0733a0 2024-04-24T23:00:38.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98d9ffb640 1 -- 172.21.15.43:0/78268599 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d00ab600 con 0x7f98dc0733a0 2024-04-24T23:00:38.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98d9ffb640 1 -- 172.21.15.43:0/78268599 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d00ab9d0 con 0x7f98dc0733a0 2024-04-24T23:00:38.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98e13c0640 1 -- 172.21.15.43:0/78268599 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98dc0733a0 msgr2=0x7f98dc144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98e13c0640 1 --2- 172.21.15.43:0/78268599 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98dc0733a0 0x7f98dc144260 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f98dc06e420 tx=0x7f98d001c450 comp rx=0 tx=0).stop 2024-04-24T23:00:38.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98e13c0640 1 -- 172.21.15.43:0/78268599 shutdown_connections 2024-04-24T23:00:38.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98e13c0640 1 --2- 172.21.15.43:0/78268599 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98dc0733a0 0x7f98dc144260 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98e13c0640 1 --2- 172.21.15.43:0/78268599 >> v2:172.21.15.162:3300/0 conn(0x7f98dc0b37f0 0x7f98dc072820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98e13c0640 1 -- 172.21.15.43:0/78268599 >> 172.21.15.43:0/78268599 conn(0x7f98dc0b5690 msgr2=0x7f98dc0b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:38.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98e13c0640 1 -- 172.21.15.43:0/78268599 shutdown_connections 2024-04-24T23:00:38.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.415+0000 7f98e13c0640 1 -- 172.21.15.43:0/78268599 wait complete. 2024-04-24T23:00:38.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98e13c0640 1 Processor -- start 2024-04-24T23:00:38.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98e13c0640 1 -- start start 2024-04-24T23:00:38.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98e13c0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98dc072d60 0x7f98dc139c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98e13c0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98dc0733a0 0x7f98dc138ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98e13c0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98dc0b37f0 0x7f98dc13b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98e13c0640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f98dc151eb0 con 0x7f98dc0733a0 2024-04-24T23:00:38.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98e13c0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f98dc151d30 con 0x7f98dc072d60 2024-04-24T23:00:38.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98e13c0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f98dc152030 con 0x7f98dc0b37f0 2024-04-24T23:00:38.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98da7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98dc0733a0 0x7f98dc138ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98da7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98dc0733a0 0x7f98dc138ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43226/0 (socket says 172.21.15.43:43226) 2024-04-24T23:00:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98da7fc640 1 -- 172.21.15.43:0/2501176266 learned_addr learned my addr 172.21.15.43:0/2501176266 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98daffd640 1 --2- 172.21.15.43:0/2501176266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98dc072d60 0x7f98dc139c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98da7fc640 1 -- 172.21.15.43:0/2501176266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98dc0b37f0 msgr2=0x7f98dc13b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98db7fe640 1 --2- 172.21.15.43:0/2501176266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98dc0b37f0 0x7f98dc13b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98da7fc640 1 --2- 172.21.15.43:0/2501176266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98dc0b37f0 0x7f98dc13b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98da7fc640 1 -- 172.21.15.43:0/2501176266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98dc072d60 msgr2=0x7f98dc139c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98da7fc640 1 --2- 172.21.15.43:0/2501176266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98dc072d60 0x7f98dc139c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98da7fc640 1 -- 172.21.15.43:0/2501176266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98dc13bda0 con 0x7f98dc0733a0 2024-04-24T23:00:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98daffd640 1 --2- 172.21.15.43:0/2501176266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98dc072d60 0x7f98dc139c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98da7fc640 1 --2- 172.21.15.43:0/2501176266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98dc0733a0 0x7f98dc138ba0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f98d001ab00 tx=0x7f98d00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98c37fe640 1 -- 172.21.15.43:0/2501176266 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d00b9070 con 0x7f98dc0733a0 2024-04-24T23:00:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98c37fe640 1 -- 172.21.15.43:0/2501176266 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d00b4640 con 0x7f98dc0733a0 2024-04-24T23:00:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98c37fe640 1 -- 172.21.15.43:0/2501176266 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d00b0040 con 0x7f98dc0733a0 2024-04-24T23:00:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98e13c0640 1 -- 172.21.15.43:0/2501176266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98dc13aae0 con 0x7f98dc0733a0 2024-04-24T23:00:38.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98e13c0640 1 -- 172.21.15.43:0/2501176266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98dc0aec80 con 0x7f98dc0733a0 2024-04-24T23:00:38.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.419+0000 7f98e13c0640 1 -- 172.21.15.43:0/2501176266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98dc04f580 con 0x7f98dc0733a0 2024-04-24T23:00:38.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.423+0000 7f98c37fe640 1 -- 172.21.15.43:0/2501176266 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f98d00aa3a0 con 0x7f98dc0733a0 2024-04-24T23:00:38.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.423+0000 7f98c37fe640 1 --2- 172.21.15.43:0/2501176266 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98c80678f0 0x7f98c8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.423+0000 7f98c37fe640 1 -- 172.21.15.43:0/2501176266 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f98d011f1a0 con 0x7f98dc0733a0 2024-04-24T23:00:38.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.423+0000 7f98daffd640 1 --2- 172.21.15.43:0/2501176266 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98c80678f0 0x7f98c8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.423+0000 7f98daffd640 1 --2- 172.21.15.43:0/2501176266 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98c80678f0 0x7f98c8069db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f98cc007f40 tx=0x7f98cc007490 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:38.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.427+0000 7f98c37fe640 1 -- 172.21.15.43:0/2501176266 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f98d00160d0 con 0x7f98dc0733a0 2024-04-24T23:00:38.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.587+0000 7f98e13c0640 1 -- 172.21.15.43:0/2501176266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f98dc143670 con 0x7f98dc0733a0 2024-04-24T23:00:38.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.587+0000 7f98c37fe640 1 -- 172.21.15.43:0/2501176266 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f98d00efa30 con 0x7f98dc0733a0 2024-04-24T23:00:38.594 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-24T23:00:38.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.591+0000 7f98e13c0640 1 -- 172.21.15.43:0/2501176266 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98c80678f0 msgr2=0x7f98c8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.591+0000 7f98e13c0640 1 --2- 172.21.15.43:0/2501176266 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98c80678f0 0x7f98c8069db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f98cc007f40 tx=0x7f98cc007490 comp rx=0 tx=0).stop 2024-04-24T23:00:38.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.591+0000 7f98e13c0640 1 -- 172.21.15.43:0/2501176266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98dc0733a0 msgr2=0x7f98dc138ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.591+0000 7f98e13c0640 1 --2- 172.21.15.43:0/2501176266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98dc0733a0 0x7f98dc138ba0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f98d001ab00 tx=0x7f98d00191f0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.591+0000 7f98e13c0640 1 -- 172.21.15.43:0/2501176266 shutdown_connections 2024-04-24T23:00:38.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.591+0000 7f98e13c0640 1 --2- 172.21.15.43:0/2501176266 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f98c80678f0 0x7f98c8069db0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.591+0000 7f98e13c0640 1 --2- 172.21.15.43:0/2501176266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98dc0b37f0 0x7f98dc13b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.591+0000 7f98e13c0640 1 --2- 172.21.15.43:0/2501176266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98dc0733a0 0x7f98dc138ba0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.591+0000 7f98e13c0640 1 --2- 172.21.15.43:0/2501176266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98dc072d60 0x7f98dc139c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.591+0000 7f98e13c0640 1 -- 172.21.15.43:0/2501176266 >> 172.21.15.43:0/2501176266 conn(0x7f98dc0b5690 msgr2=0x7f98dc0b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:38.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.591+0000 7f98e13c0640 1 -- 172.21.15.43:0/2501176266 shutdown_connections 2024-04-24T23:00:38.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.591+0000 7f98e13c0640 1 -- 172.21.15.43:0/2501176266 wait complete. 2024-04-24T23:00:38.612 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:00:38.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b18b7b640 1 Processor -- start 2024-04-24T23:00:38.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b18b7b640 1 -- start start 2024-04-24T23:00:38.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b18b7b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8b140b2500 0x7f8b14145450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b18b7b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b14145990 0x7f8b1413f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b18b7b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b14070060 con 0x7f8b1413f730 2024-04-24T23:00:38.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b18b7b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8b140b28e0 con 0x7f8b140b2500 2024-04-24T23:00:38.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b18b7b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8b140af8f0 con 0x7f8b14145990 2024-04-24T23:00:38.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b1259c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8b140b2500 0x7f8b14145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b11d9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b14145990 0x7f8b1413f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b12d9d640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8b1413f730 0x7f8b141489c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.43:53644/0 (socket says 172.21.15.43:53644) 2024-04-24T23:00:38.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b1259c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8b140b2500 0x7f8b14145450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.43:45984/0 (socket says 172.21.15.43:45984) 2024-04-24T23:00:38.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b12d9d640 1 -- 172.21.15.43:0/2123677713 learned_addr learned my addr 172.21.15.43:0/2123677713 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:38.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b1259c640 1 -- 172.21.15.43:0/2123677713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b14145990 msgr2=0x7f8b1413f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:38.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b1259c640 1 --2- 172.21.15.43:0/2123677713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b14145990 0x7f8b1413f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b1259c640 1 -- 172.21.15.43:0/2123677713 >> v1:172.21.15.162:6789/0 conn(0x7f8b1413f730 legacy=0x7f8b141489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.731+0000 7f8b1259c640 1 -- 172.21.15.43:0/2123677713 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1406fb40 con 0x7f8b140b2500 2024-04-24T23:00:38.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.735+0000 7f8b1259c640 1 --2- 172.21.15.43:0/2123677713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b140b2500 0x7f8b14145450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b080097c0 tx=0x7f8b0801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cec9e60d9718cd01 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:38.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.735+0000 7f8b1159a640 1 -- 172.21.15.43:0/2123677713 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b080b0070 con 0x7f8b140b2500 2024-04-24T23:00:38.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.735+0000 7f8b1159a640 1 -- 172.21.15.43:0/2123677713 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b080ab600 con 0x7f8b140b2500 2024-04-24T23:00:38.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.735+0000 7f8b1159a640 1 -- 172.21.15.43:0/2123677713 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b140b63c0 con 0x7f8b140b2500 2024-04-24T23:00:38.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.735+0000 7f8b18b7b640 1 -- 172.21.15.43:0/2123677713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b140b2500 msgr2=0x7f8b14145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.735+0000 7f8b18b7b640 1 --2- 172.21.15.43:0/2123677713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b140b2500 0x7f8b14145450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b080097c0 tx=0x7f8b0801c4a0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.735+0000 7f8b18b7b640 1 -- 172.21.15.43:0/2123677713 shutdown_connections 2024-04-24T23:00:38.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.735+0000 7f8b18b7b640 1 --2- 172.21.15.43:0/2123677713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b14145990 0x7f8b1413f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.735+0000 7f8b18b7b640 1 --2- 172.21.15.43:0/2123677713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b140b2500 0x7f8b14145450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.735+0000 7f8b18b7b640 1 -- 172.21.15.43:0/2123677713 >> 172.21.15.43:0/2123677713 conn(0x7f8b140b5690 msgr2=0x7f8b140b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:38.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.735+0000 7f8b18b7b640 1 -- 172.21.15.43:0/2123677713 shutdown_connections 2024-04-24T23:00:38.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.735+0000 7f8b18b7b640 1 -- 172.21.15.43:0/2123677713 wait complete. 2024-04-24T23:00:38.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.735+0000 7f8b18b7b640 1 Processor -- start 2024-04-24T23:00:38.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b18b7b640 1 -- start start 2024-04-24T23:00:38.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b18b7b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b140b2500 0x7f8b14147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b18b7b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b1413f730 0x7f8b140b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b18b7b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b14145990 0x7f8b141e0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b18b7b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8b140b4af0 con 0x7f8b14145990 2024-04-24T23:00:38.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b18b7b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b140b54a0 con 0x7f8b1413f730 2024-04-24T23:00:38.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b18b7b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8b140b4c70 con 0x7f8b140b2500 2024-04-24T23:00:38.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b12d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b14145990 0x7f8b141e0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b12d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b14145990 0x7f8b141e0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43234/0 (socket says 172.21.15.43:43234) 2024-04-24T23:00:38.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b12d9d640 1 -- 172.21.15.43:0/4276288048 learned_addr learned my addr 172.21.15.43:0/4276288048 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:38.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b11d9b640 1 --2- 172.21.15.43:0/4276288048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b1413f730 0x7f8b140b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b1259c640 1 --2- 172.21.15.43:0/4276288048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b140b2500 0x7f8b14147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b12d9d640 1 -- 172.21.15.43:0/4276288048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b140b2500 msgr2=0x7f8b14147a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b12d9d640 1 --2- 172.21.15.43:0/4276288048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b140b2500 0x7f8b14147a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b12d9d640 1 -- 172.21.15.43:0/4276288048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b1413f730 msgr2=0x7f8b140b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b12d9d640 1 --2- 172.21.15.43:0/4276288048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b1413f730 0x7f8b140b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b12d9d640 1 -- 172.21.15.43:0/4276288048 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b140aec10 con 0x7f8b14145990 2024-04-24T23:00:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b12d9d640 1 --2- 172.21.15.43:0/4276288048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b14145990 0x7f8b141e0250 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00ca80 tx=0x7f8b0c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b02ffd640 1 -- 172.21.15.43:0/4276288048 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c017070 con 0x7f8b14145990 2024-04-24T23:00:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b02ffd640 1 -- 172.21.15.43:0/4276288048 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b0c00ac30 con 0x7f8b14145990 2024-04-24T23:00:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b02ffd640 1 -- 172.21.15.43:0/4276288048 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c012600 con 0x7f8b14145990 2024-04-24T23:00:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b18b7b640 1 -- 172.21.15.43:0/4276288048 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b140aeef0 con 0x7f8b14145990 2024-04-24T23:00:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b18b7b640 1 -- 172.21.15.43:0/4276288048 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b1413fdc0 con 0x7f8b14145990 2024-04-24T23:00:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b18b7b640 1 -- 172.21.15.43:0/4276288048 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b1404f580 con 0x7f8b14145990 2024-04-24T23:00:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b02ffd640 1 -- 172.21.15.43:0/4276288048 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8b0c01a070 con 0x7f8b14145990 2024-04-24T23:00:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b02ffd640 1 --2- 172.21.15.43:0/4276288048 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8af40678c0 0x7f8af4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b02ffd640 1 -- 172.21.15.43:0/4276288048 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8b0c085b20 con 0x7f8b14145990 2024-04-24T23:00:38.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b1259c640 1 --2- 172.21.15.43:0/4276288048 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8af40678c0 0x7f8af4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:38.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.739+0000 7f8b1259c640 1 --2- 172.21.15.43:0/4276288048 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8af40678c0 0x7f8af4069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b080ad000 tx=0x7f8b08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:38.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.743+0000 7f8b02ffd640 1 -- 172.21.15.43:0/4276288048 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8b0c00ae20 con 0x7f8b14145990 2024-04-24T23:00:38.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.903+0000 7f8b18b7b640 1 -- 172.21.15.43:0/4276288048 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8b14143460 con 0x7f8b14145990 2024-04-24T23:00:38.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.903+0000 7f8b02ffd640 1 -- 172.21.15.43:0/4276288048 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f8b0c055d60 con 0x7f8b14145990 2024-04-24T23:00:38.910 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-24T23:00:38.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.907+0000 7f8b18b7b640 1 -- 172.21.15.43:0/4276288048 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8af40678c0 msgr2=0x7f8af4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.907+0000 7f8b18b7b640 1 --2- 172.21.15.43:0/4276288048 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8af40678c0 0x7f8af4069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b080ad000 tx=0x7f8b08008040 comp rx=0 tx=0).stop 2024-04-24T23:00:38.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.907+0000 7f8b18b7b640 1 -- 172.21.15.43:0/4276288048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b14145990 msgr2=0x7f8b141e0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:38.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.907+0000 7f8b18b7b640 1 --2- 172.21.15.43:0/4276288048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b14145990 0x7f8b141e0250 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00ca80 tx=0x7f8b0c00cf40 comp rx=0 tx=0).stop 2024-04-24T23:00:38.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.907+0000 7f8b18b7b640 1 -- 172.21.15.43:0/4276288048 shutdown_connections 2024-04-24T23:00:38.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.907+0000 7f8b18b7b640 1 --2- 172.21.15.43:0/4276288048 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8af40678c0 0x7f8af4069d80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.907+0000 7f8b18b7b640 1 --2- 172.21.15.43:0/4276288048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b14145990 0x7f8b141e0250 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.907+0000 7f8b18b7b640 1 --2- 172.21.15.43:0/4276288048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b1413f730 0x7f8b140b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.907+0000 7f8b18b7b640 1 --2- 172.21.15.43:0/4276288048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b140b2500 0x7f8b14147a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:38.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.907+0000 7f8b18b7b640 1 -- 172.21.15.43:0/4276288048 >> 172.21.15.43:0/4276288048 conn(0x7f8b140b5690 msgr2=0x7f8b14143c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:38.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.907+0000 7f8b18b7b640 1 -- 172.21.15.43:0/4276288048 shutdown_connections 2024-04-24T23:00:38.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:38.907+0000 7f8b18b7b640 1 -- 172.21.15.43:0/4276288048 wait complete. 2024-04-24T23:00:38.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:00:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc268a92640 1 Processor -- start 2024-04-24T23:00:39.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc268a92640 1 -- start start 2024-04-24T23:00:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc268a92640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2640b2500 0x7fc264145450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc268a92640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc26413f900 0x7fc26414fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc268a92640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc264070060 con 0x7fc264145990 2024-04-24T23:00:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc268a92640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc2640b28e0 con 0x7fc26413f900 2024-04-24T23:00:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc268a92640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc2640af8f0 con 0x7fc2640b2500 2024-04-24T23:00:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc262d9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc26413f900 0x7fc26414fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc262d9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc26413f900 0x7fc26414fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43242/0 (socket says 172.21.15.43:43242) 2024-04-24T23:00:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc262d9d640 1 -- 172.21.15.43:0/2054517578 learned_addr learned my addr 172.21.15.43:0/2054517578 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc261d9b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc264145990 0x7fc26413f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54602/0 (socket says 172.21.15.43:54602) 2024-04-24T23:00:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc26259c640 1 --2- 172.21.15.43:0/2054517578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2640b2500 0x7fc264145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc262d9d640 1 -- 172.21.15.43:0/2054517578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2640b2500 msgr2=0x7fc264145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc262d9d640 1 --2- 172.21.15.43:0/2054517578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2640b2500 0x7fc264145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc262d9d640 1 -- 172.21.15.43:0/2054517578 >> v1:172.21.15.43:6789/0 conn(0x7fc264145990 legacy=0x7fc26413f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc26159a640 1 -- 172.21.15.43:0/2054517578 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2569460683 0 0) 0x7fc264070060 con 0x7fc264145990 2024-04-24T23:00:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.051+0000 7fc262d9d640 1 -- 172.21.15.43:0/2054517578 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26406fb40 con 0x7fc26413f900 2024-04-24T23:00:39.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc262d9d640 1 --2- 172.21.15.43:0/2054517578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc26413f900 0x7fc26414fcf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009870 tx=0x7fc25c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffce22a66d551028 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:39.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc26159a640 1 -- 172.21.15.43:0/2054517578 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c0b2070 con 0x7fc26413f900 2024-04-24T23:00:39.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc26159a640 1 -- 172.21.15.43:0/2054517578 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc25c0a9070 con 0x7fc26413f900 2024-04-24T23:00:39.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc26159a640 1 -- 172.21.15.43:0/2054517578 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c0ad880 con 0x7fc26413f900 2024-04-24T23:00:39.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 -- 172.21.15.43:0/2054517578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc26413f900 msgr2=0x7fc26414fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 --2- 172.21.15.43:0/2054517578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc26413f900 0x7fc26414fcf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009870 tx=0x7fc25c01c560 comp rx=0 tx=0).stop 2024-04-24T23:00:39.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 -- 172.21.15.43:0/2054517578 shutdown_connections 2024-04-24T23:00:39.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 --2- 172.21.15.43:0/2054517578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc26413f900 0x7fc26414fcf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 --2- 172.21.15.43:0/2054517578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2640b2500 0x7fc264145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 -- 172.21.15.43:0/2054517578 >> 172.21.15.43:0/2054517578 conn(0x7fc2640b5690 msgr2=0x7fc2640b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:39.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 -- 172.21.15.43:0/2054517578 shutdown_connections 2024-04-24T23:00:39.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 -- 172.21.15.43:0/2054517578 wait complete. 2024-04-24T23:00:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 Processor -- start 2024-04-24T23:00:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 -- start start 2024-04-24T23:00:39.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2640b2500 0x7fc26413a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc26413f900 0x7fc2641e1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264145990 0x7fc2641e2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc2640b54a0 con 0x7fc2640b2500 2024-04-24T23:00:39.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc2640b4d00 con 0x7fc26413f900 2024-04-24T23:00:39.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc268a92640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc264152a50 con 0x7fc264145990 2024-04-24T23:00:39.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc26259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2640b2500 0x7fc26413a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc26259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2640b2500 0x7fc26413a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43258/0 (socket says 172.21.15.43:43258) 2024-04-24T23:00:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc26259c640 1 -- 172.21.15.43:0/2460950718 learned_addr learned my addr 172.21.15.43:0/2460950718 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc261d9b640 1 --2- 172.21.15.43:0/2460950718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc26413f900 0x7fc2641e1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc262d9d640 1 --2- 172.21.15.43:0/2460950718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264145990 0x7fc2641e2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc26259c640 1 -- 172.21.15.43:0/2460950718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264145990 msgr2=0x7fc2641e2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc26259c640 1 --2- 172.21.15.43:0/2460950718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264145990 0x7fc2641e2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc26259c640 1 -- 172.21.15.43:0/2460950718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc26413f900 msgr2=0x7fc2641e1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc26259c640 1 --2- 172.21.15.43:0/2460950718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc26413f900 0x7fc2641e1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc26259c640 1 -- 172.21.15.43:0/2460950718 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2641392e0 con 0x7fc2640b2500 2024-04-24T23:00:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc261d9b640 1 --2- 172.21.15.43:0/2460950718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc26413f900 0x7fc2641e1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.055+0000 7fc26259c640 1 --2- 172.21.15.43:0/2460950718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2640b2500 0x7fc26413a420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc25400d5f0 tx=0x7fc25400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.059+0000 7fc25affd640 1 -- 172.21.15.43:0/2460950718 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2540125f0 con 0x7fc2640b2500 2024-04-24T23:00:39.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.059+0000 7fc25affd640 1 -- 172.21.15.43:0/2460950718 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc254019070 con 0x7fc2640b2500 2024-04-24T23:00:39.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.059+0000 7fc268a92640 1 -- 172.21.15.43:0/2460950718 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26413bb10 con 0x7fc2640b2500 2024-04-24T23:00:39.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.059+0000 7fc25affd640 1 -- 172.21.15.43:0/2460950718 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2540129b0 con 0x7fc2640b2500 2024-04-24T23:00:39.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.059+0000 7fc268a92640 1 -- 172.21.15.43:0/2460950718 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2641420c0 con 0x7fc2640b2500 2024-04-24T23:00:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.059+0000 7fc268a92640 1 -- 172.21.15.43:0/2460950718 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc26404f580 con 0x7fc2640b2500 2024-04-24T23:00:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.059+0000 7fc25affd640 1 -- 172.21.15.43:0/2460950718 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc254012b50 con 0x7fc2640b2500 2024-04-24T23:00:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.059+0000 7fc25affd640 1 --2- 172.21.15.43:0/2460950718 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc2440678f0 0x7fc244069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.059+0000 7fc25affd640 1 -- 172.21.15.43:0/2460950718 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc2540863e0 con 0x7fc2640b2500 2024-04-24T23:00:39.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.059+0000 7fc261d9b640 1 --2- 172.21.15.43:0/2460950718 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc2440678f0 0x7fc244069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.059+0000 7fc261d9b640 1 --2- 172.21.15.43:0/2460950718 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc2440678f0 0x7fc244069db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc24c007fd0 tx=0x7fc24c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:39.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.063+0000 7fc25affd640 1 -- 172.21.15.43:0/2460950718 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc254056bd0 con 0x7fc2640b2500 2024-04-24T23:00:39.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.223+0000 7fc268a92640 1 -- 172.21.15.43:0/2460950718 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc2640b5df0 con 0x7fc2640b2500 2024-04-24T23:00:39.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.227+0000 7fc25affd640 1 -- 172.21.15.43:0/2460950718 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fc2540564d0 con 0x7fc2640b2500 2024-04-24T23:00:39.231 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-24T23:00:39.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.227+0000 7fc268a92640 1 -- 172.21.15.43:0/2460950718 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc2440678f0 msgr2=0x7fc244069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.227+0000 7fc268a92640 1 --2- 172.21.15.43:0/2460950718 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc2440678f0 0x7fc244069db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc24c007fd0 tx=0x7fc24c009040 comp rx=0 tx=0).stop 2024-04-24T23:00:39.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.227+0000 7fc268a92640 1 -- 172.21.15.43:0/2460950718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2640b2500 msgr2=0x7fc26413a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.227+0000 7fc268a92640 1 --2- 172.21.15.43:0/2460950718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2640b2500 0x7fc26413a420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc25400d5f0 tx=0x7fc25400dab0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.227+0000 7fc268a92640 1 -- 172.21.15.43:0/2460950718 shutdown_connections 2024-04-24T23:00:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.227+0000 7fc268a92640 1 --2- 172.21.15.43:0/2460950718 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc2440678f0 0x7fc244069db0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.227+0000 7fc268a92640 1 --2- 172.21.15.43:0/2460950718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264145990 0x7fc2641e2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.227+0000 7fc268a92640 1 --2- 172.21.15.43:0/2460950718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc26413f900 0x7fc2641e1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.227+0000 7fc268a92640 1 --2- 172.21.15.43:0/2460950718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2640b2500 0x7fc26413a420 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.227+0000 7fc268a92640 1 -- 172.21.15.43:0/2460950718 >> 172.21.15.43:0/2460950718 conn(0x7fc2640b5690 msgr2=0x7fc2640b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.227+0000 7fc268a92640 1 -- 172.21.15.43:0/2460950718 shutdown_connections 2024-04-24T23:00:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.227+0000 7fc268a92640 1 -- 172.21.15.43:0/2460950718 wait complete. 2024-04-24T23:00:39.251 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:00:39.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.367+0000 7f7f0d8ab640 1 Processor -- start 2024-04-24T23:00:39.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.367+0000 7f7f0d8ab640 1 -- start start 2024-04-24T23:00:39.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f0d8ab640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7f080b2500 0x7f7f08145450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f0d8ab640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7f08145990 0x7f7f0813f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f0d8ab640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f08070060 con 0x7f7f0813f730 2024-04-24T23:00:39.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f0d8ab640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f7f080b28e0 con 0x7f7f080b2500 2024-04-24T23:00:39.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f0d8ab640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7f080af8f0 con 0x7f7f08145990 2024-04-24T23:00:39.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f06ffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7f080b2500 0x7f7f08145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f06ffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7f080b2500 0x7f7f08145450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43264/0 (socket says 172.21.15.43:43264) 2024-04-24T23:00:39.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f06ffd640 1 -- 172.21.15.43:0/4058935518 learned_addr learned my addr 172.21.15.43:0/4058935518 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:39.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f067fc640 1 --2- 172.21.15.43:0/4058935518 >> v2:172.21.15.162:3300/0 conn(0x7f7f08145990 0x7f7f0813f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f06ffd640 1 -- 172.21.15.43:0/4058935518 >> v2:172.21.15.162:3300/0 conn(0x7f7f08145990 msgr2=0x7f7f0813f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:39.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f06ffd640 1 --2- 172.21.15.43:0/4058935518 >> v2:172.21.15.162:3300/0 conn(0x7f7f08145990 0x7f7f0813f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f06ffd640 1 -- 172.21.15.43:0/4058935518 >> v1:172.21.15.162:6789/0 conn(0x7f7f0813f730 legacy=0x7f7f081489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:39.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f06ffd640 1 -- 172.21.15.43:0/4058935518 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0806fb40 con 0x7f7f080b2500 2024-04-24T23:00:39.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f067fc640 1 --2- 172.21.15.43:0/4058935518 >> v2:172.21.15.162:3300/0 conn(0x7f7f08145990 0x7f7f0813f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:39.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f06ffd640 1 --2- 172.21.15.43:0/4058935518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f080b2500 0x7f7f08145450 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7f0806e120 tx=0x7f7ef801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43f9bed073115c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:39.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f05ffb640 1 -- 172.21.15.43:0/4058935518 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f080b63c0 con 0x7f7f080b2500 2024-04-24T23:00:39.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f05ffb640 1 -- 172.21.15.43:0/4058935518 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef80a56a0 con 0x7f7f080b2500 2024-04-24T23:00:39.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.371+0000 7f7f05ffb640 1 -- 172.21.15.43:0/4058935518 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef80a5a70 con 0x7f7f080b2500 2024-04-24T23:00:39.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 -- 172.21.15.43:0/4058935518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f080b2500 msgr2=0x7f7f08145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 --2- 172.21.15.43:0/4058935518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f080b2500 0x7f7f08145450 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7f0806e120 tx=0x7f7ef801c9b0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 -- 172.21.15.43:0/4058935518 shutdown_connections 2024-04-24T23:00:39.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 --2- 172.21.15.43:0/4058935518 >> v2:172.21.15.162:3300/0 conn(0x7f7f08145990 0x7f7f0813f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 --2- 172.21.15.43:0/4058935518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f080b2500 0x7f7f08145450 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 -- 172.21.15.43:0/4058935518 >> 172.21.15.43:0/4058935518 conn(0x7f7f080b5690 msgr2=0x7f7f080b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:39.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 -- 172.21.15.43:0/4058935518 shutdown_connections 2024-04-24T23:00:39.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 -- 172.21.15.43:0/4058935518 wait complete. 2024-04-24T23:00:39.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 Processor -- start 2024-04-24T23:00:39.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 -- start start 2024-04-24T23:00:39.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f080b2500 0x7f7f08137850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0813f730 0x7f7f08147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f08145990 0x7f7f08134e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7f080b4c70 con 0x7f7f0813f730 2024-04-24T23:00:39.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f080b4af0 con 0x7f7f080b2500 2024-04-24T23:00:39.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7f08152d10 con 0x7f7f08145990 2024-04-24T23:00:39.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f067fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0813f730 0x7f7f08147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f067fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0813f730 0x7f7f08147f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43274/0 (socket says 172.21.15.43:43274) 2024-04-24T23:00:39.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f067fc640 1 -- 172.21.15.43:0/2807404330 learned_addr learned my addr 172.21.15.43:0/2807404330 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:39.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f06ffd640 1 --2- 172.21.15.43:0/2807404330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f080b2500 0x7f7f08137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f077fe640 1 --2- 172.21.15.43:0/2807404330 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f08145990 0x7f7f08134e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f067fc640 1 -- 172.21.15.43:0/2807404330 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f08145990 msgr2=0x7f7f08134e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f067fc640 1 --2- 172.21.15.43:0/2807404330 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f08145990 0x7f7f08134e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f067fc640 1 -- 172.21.15.43:0/2807404330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f080b2500 msgr2=0x7f7f08137850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f067fc640 1 --2- 172.21.15.43:0/2807404330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f080b2500 0x7f7f08137850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f067fc640 1 -- 172.21.15.43:0/2807404330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0813d460 con 0x7f7f0813f730 2024-04-24T23:00:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f067fc640 1 --2- 172.21.15.43:0/2807404330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0813f730 0x7f7f08147f00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c820 tx=0x7f7efc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7eeffff640 1 -- 172.21.15.43:0/2807404330 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc015070 con 0x7f7f0813f730 2024-04-24T23:00:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7eeffff640 1 -- 172.21.15.43:0/2807404330 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7efc004220 con 0x7f7f0813f730 2024-04-24T23:00:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7eeffff640 1 -- 172.21.15.43:0/2807404330 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00ce10 con 0x7f7f0813f730 2024-04-24T23:00:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 -- 172.21.15.43:0/2807404330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0813d180 con 0x7f7f0813f730 2024-04-24T23:00:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.375+0000 7f7f0d8ab640 1 -- 172.21.15.43:0/2807404330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f08146b80 con 0x7f7f0813f730 2024-04-24T23:00:39.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.379+0000 7f7f0d8ab640 1 -- 172.21.15.43:0/2807404330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ee80052a0 con 0x7f7f0813f730 2024-04-24T23:00:39.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.379+0000 7f7eeffff640 1 -- 172.21.15.43:0/2807404330 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7efc007830 con 0x7f7f0813f730 2024-04-24T23:00:39.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.379+0000 7f7eeffff640 1 --2- 172.21.15.43:0/2807404330 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f7ef40678f0 0x7f7ef4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.379+0000 7f7f06ffd640 1 --2- 172.21.15.43:0/2807404330 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f7ef40678f0 0x7f7ef4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.379+0000 7f7eeffff640 1 -- 172.21.15.43:0/2807404330 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7efc085ce0 con 0x7f7f0813f730 2024-04-24T23:00:39.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.379+0000 7f7f06ffd640 1 --2- 172.21.15.43:0/2807404330 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f7ef40678f0 0x7f7ef4069db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80ae000 tx=0x7f7ef80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:39.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.383+0000 7f7eeffff640 1 -- 172.21.15.43:0/2807404330 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f7f0813d460 con 0x7f7f0813f730 2024-04-24T23:00:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.543+0000 7f7f0d8ab640 1 -- 172.21.15.43:0/2807404330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7ee8005860 con 0x7f7f0813f730 2024-04-24T23:00:39.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.543+0000 7f7eeffff640 1 -- 172.21.15.43:0/2807404330 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f7efc056570 con 0x7f7f0813f730 2024-04-24T23:00:39.548 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-24T23:00:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.543+0000 7f7f0d8ab640 1 -- 172.21.15.43:0/2807404330 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f7ef40678f0 msgr2=0x7f7ef4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.543+0000 7f7f0d8ab640 1 --2- 172.21.15.43:0/2807404330 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f7ef40678f0 0x7f7ef4069db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80ae000 tx=0x7f7ef80a7070 comp rx=0 tx=0).stop 2024-04-24T23:00:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.543+0000 7f7f0d8ab640 1 -- 172.21.15.43:0/2807404330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0813f730 msgr2=0x7f7f08147f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.543+0000 7f7f0d8ab640 1 --2- 172.21.15.43:0/2807404330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0813f730 0x7f7f08147f00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c820 tx=0x7f7efc00cce0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.543+0000 7f7f0d8ab640 1 -- 172.21.15.43:0/2807404330 shutdown_connections 2024-04-24T23:00:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.543+0000 7f7f0d8ab640 1 --2- 172.21.15.43:0/2807404330 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f7ef40678f0 0x7f7ef4069db0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.543+0000 7f7f0d8ab640 1 --2- 172.21.15.43:0/2807404330 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f08145990 0x7f7f08134e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.543+0000 7f7f0d8ab640 1 --2- 172.21.15.43:0/2807404330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0813f730 0x7f7f08147f00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.543+0000 7f7f0d8ab640 1 --2- 172.21.15.43:0/2807404330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f080b2500 0x7f7f08137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.543+0000 7f7f0d8ab640 1 -- 172.21.15.43:0/2807404330 >> 172.21.15.43:0/2807404330 conn(0x7f7f080b5690 msgr2=0x7f7f08072e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.543+0000 7f7f0d8ab640 1 -- 172.21.15.43:0/2807404330 shutdown_connections 2024-04-24T23:00:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.543+0000 7f7f0d8ab640 1 -- 172.21.15.43:0/2807404330 wait complete. 2024-04-24T23:00:39.565 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:00:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.675+0000 7f9247bf2640 1 Processor -- start 2024-04-24T23:00:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f9247bf2640 1 -- start start 2024-04-24T23:00:39.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f9247bf2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f924013f1f0 0x7f924013f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f9247bf2640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9240070060 con 0x7f92400b2500 2024-04-24T23:00:39.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f9247bf2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f924013fbc0 con 0x7f924014dce0 2024-04-24T23:00:39.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f9247bf2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f92400b28e0 con 0x7f924013f1f0 2024-04-24T23:00:39.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924598e640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f92400b2500 0x7f9240145450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54614/0 (socket says 172.21.15.43:54614) 2024-04-24T23:00:39.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924598e640 1 -- 172.21.15.43:0/2619405439 learned_addr learned my addr 172.21.15.43:0/2619405439 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:39.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924518d640 1 --2- 172.21.15.43:0/2619405439 >> v2:172.21.15.162:3300/0 conn(0x7f924013f1f0 0x7f924013f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924498c640 1 -- 172.21.15.43:0/2619405439 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1148800138 0 0) 0x7f9240070060 con 0x7f92400b2500 2024-04-24T23:00:39.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924498c640 1 -- 172.21.15.43:0/2619405439 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f922c003530 con 0x7f92400b2500 2024-04-24T23:00:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924498c640 1 -- 172.21.15.43:0/2619405439 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1809449438 0 0) 0x7f922c003530 con 0x7f92400b2500 2024-04-24T23:00:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924498c640 1 -- 172.21.15.43:0/2619405439 >> v2:172.21.15.162:3300/0 conn(0x7f924013f1f0 msgr2=0x7f924013f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924498c640 1 --2- 172.21.15.43:0/2619405439 >> v2:172.21.15.162:3300/0 conn(0x7f924013f1f0 0x7f924013f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924498c640 1 -- 172.21.15.43:0/2619405439 >> v1:172.21.15.162:6789/0 conn(0x7f924014dce0 legacy=0x7f92401500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924498c640 1 -- 172.21.15.43:0/2619405439 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92400af8f0 con 0x7f92400b2500 2024-04-24T23:00:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924498c640 1 -- 172.21.15.43:0/2619405439 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f9230001680 con 0x7f92400b2500 2024-04-24T23:00:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924498c640 1 -- 172.21.15.43:0/2619405439 >> v1:172.21.15.43:6789/0 conn(0x7f92400b2500 legacy=0x7f9240145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924498c640 1 --2- 172.21.15.43:0/2619405439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f922c0039c0 0x7f922c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924498c640 1 --2- 172.21.15.43:0/2619405439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c004810 0x7f922c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924498c640 1 --2- 172.21.15.43:0/2619405439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f922c0051d0 0x7f922c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924498c640 1 -- 172.21.15.43:0/2619405439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f92400b28e0 con 0x7f922c0039c0 2024-04-24T23:00:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924498c640 1 -- 172.21.15.43:0/2619405439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f922c00c070 con 0x7f922c0051d0 2024-04-24T23:00:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924498c640 1 -- 172.21.15.43:0/2619405439 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f922c00c270 con 0x7f922c004810 2024-04-24T23:00:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924598e640 1 --2- 172.21.15.43:0/2619405439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f922c0039c0 0x7f922c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924518d640 1 --2- 172.21.15.43:0/2619405439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c004810 0x7f922c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924618f640 1 --2- 172.21.15.43:0/2619405439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f922c0051d0 0x7f922c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924598e640 1 -- 172.21.15.43:0/2619405439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c004810 msgr2=0x7f922c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924598e640 1 --2- 172.21.15.43:0/2619405439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c004810 0x7f922c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924598e640 1 -- 172.21.15.43:0/2619405439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f922c0051d0 msgr2=0x7f922c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924598e640 1 --2- 172.21.15.43:0/2619405439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f922c0051d0 0x7f922c00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924618f640 1 -- 172.21.15.43:0/2619405439 reap_dead start 2024-04-24T23:00:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.679+0000 7f924598e640 1 -- 172.21.15.43:0/2619405439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c003530 con 0x7f922c0039c0 2024-04-24T23:00:39.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924598e640 1 --2- 172.21.15.43:0/2619405439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f922c0039c0 0x7f922c003de0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f923000c290 tx=0x7f923001cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56aee62f0e59f619 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:39.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924498c640 1 -- 172.21.15.43:0/2619405439 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9230007d40 con 0x7f922c0039c0 2024-04-24T23:00:39.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924498c640 1 -- 172.21.15.43:0/2619405439 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92300a9020 con 0x7f922c0039c0 2024-04-24T23:00:39.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924498c640 1 -- 172.21.15.43:0/2619405439 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9230005ae0 con 0x7f922c0039c0 2024-04-24T23:00:39.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f9247bf2640 1 -- 172.21.15.43:0/2619405439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f922c0039c0 msgr2=0x7f922c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f9247bf2640 1 --2- 172.21.15.43:0/2619405439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f922c0039c0 0x7f922c003de0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f923000c290 tx=0x7f923001cd00 comp rx=0 tx=0).stop 2024-04-24T23:00:39.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f9247bf2640 1 -- 172.21.15.43:0/2619405439 shutdown_connections 2024-04-24T23:00:39.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f9247bf2640 1 --2- 172.21.15.43:0/2619405439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f922c0039c0 0x7f922c003de0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f9247bf2640 1 -- 172.21.15.43:0/2619405439 >> 172.21.15.43:0/2619405439 conn(0x7f92400b5690 msgr2=0x7f92400b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:39.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f9247bf2640 1 -- 172.21.15.43:0/2619405439 shutdown_connections 2024-04-24T23:00:39.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f9247bf2640 1 -- 172.21.15.43:0/2619405439 wait complete. 2024-04-24T23:00:39.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f9247bf2640 1 Processor -- start 2024-04-24T23:00:39.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f9247bf2640 1 -- start start 2024-04-24T23:00:39.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f9247bf2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c0039c0 0x7f9240144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f9247bf2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92401465b0 0x7f9240146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f9247bf2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9240147400 0x7f92401e14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f9247bf2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f92400b4af0 con 0x7f92401465b0 2024-04-24T23:00:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f9247bf2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f92400b63c0 con 0x7f9240147400 2024-04-24T23:00:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f9247bf2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f92400b4c70 con 0x7f922c0039c0 2024-04-24T23:00:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924518d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92401465b0 0x7f9240146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924518d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92401465b0 0x7f9240146ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43288/0 (socket says 172.21.15.43:43288) 2024-04-24T23:00:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924518d640 1 -- 172.21.15.43:0/346572780 learned_addr learned my addr 172.21.15.43:0/346572780 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924598e640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c0039c0 0x7f9240144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924618f640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9240147400 0x7f92401e14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924518d640 1 -- 172.21.15.43:0/346572780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c0039c0 msgr2=0x7f9240144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924518d640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c0039c0 0x7f9240144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924518d640 1 -- 172.21.15.43:0/346572780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9240147400 msgr2=0x7f92401e14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924518d640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9240147400 0x7f92401e14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924518d640 1 -- 172.21.15.43:0/346572780 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924013c590 con 0x7f92401465b0 2024-04-24T23:00:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924598e640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c0039c0 0x7f9240144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924618f640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9240147400 0x7f92401e14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.683+0000 7f924518d640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92401465b0 0x7f9240146ec0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f923c011690 tx=0x7f923c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.687+0000 7f92367fc640 1 -- 172.21.15.43:0/346572780 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c00f9c0 con 0x7f92401465b0 2024-04-24T23:00:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.687+0000 7f92367fc640 1 -- 172.21.15.43:0/346572780 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923c00fb60 con 0x7f92401465b0 2024-04-24T23:00:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.687+0000 7f9247bf2640 1 -- 172.21.15.43:0/346572780 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9240147890 con 0x7f92401465b0 2024-04-24T23:00:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.687+0000 7f92367fc640 1 -- 172.21.15.43:0/346572780 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c015460 con 0x7f92401465b0 2024-04-24T23:00:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.687+0000 7f9247bf2640 1 -- 172.21.15.43:0/346572780 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92400b8630 con 0x7f92401465b0 2024-04-24T23:00:39.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.687+0000 7f9247bf2640 1 -- 172.21.15.43:0/346572780 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f924004f580 con 0x7f92401465b0 2024-04-24T23:00:39.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.687+0000 7f92367fc640 1 -- 172.21.15.43:0/346572780 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f923c015600 con 0x7f92401465b0 2024-04-24T23:00:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.687+0000 7f92367fc640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f92240678c0 0x7f9224069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.687+0000 7f92367fc640 1 -- 172.21.15.43:0/346572780 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f923c0868c0 con 0x7f92401465b0 2024-04-24T23:00:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.687+0000 7f924598e640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f92240678c0 0x7f9224069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.687+0000 7f924598e640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f92240678c0 0x7f9224069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f92300aa000 tx=0x7f9230001a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.691+0000 7f92367fc640 1 -- 172.21.15.43:0/346572780 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f923c019030 con 0x7f92401465b0 2024-04-24T23:00:39.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.887+0000 7f9247bf2640 1 -- 172.21.15.43:0/346572780 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92400af530 con 0x7f92401465b0 2024-04-24T23:00:39.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.887+0000 7f92367fc640 1 -- 172.21.15.43:0/346572780 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3529 (secure 0 0 0) 0x7f923c057150 con 0x7f92401465b0 2024-04-24T23:00:39.893 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:39.893 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/2236776475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2236776475},{"type":"v1","addr":"172.21.15.162:6833","nonce":2236776475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:00:15.762941+0000","modified":"2024-04-24T23:00:32.909117+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6835/152091432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":152091432},{"type":"v1","addr":"172.21.15.43:6835","nonce":152091432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-04-24T23:00:39.893 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-04-24T23:00:39.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.891+0000 7f9247bf2640 1 -- 172.21.15.43:0/346572780 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f92240678c0 msgr2=0x7f9224069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.891+0000 7f9247bf2640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f92240678c0 0x7f9224069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f92300aa000 tx=0x7f9230001a50 comp rx=0 tx=0).stop 2024-04-24T23:00:39.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.891+0000 7f9247bf2640 1 -- 172.21.15.43:0/346572780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92401465b0 msgr2=0x7f9240146ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:39.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.891+0000 7f9247bf2640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92401465b0 0x7f9240146ec0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f923c011690 tx=0x7f923c011b50 comp rx=0 tx=0).stop 2024-04-24T23:00:39.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.891+0000 7f9247bf2640 1 -- 172.21.15.43:0/346572780 shutdown_connections 2024-04-24T23:00:39.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.891+0000 7f9247bf2640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f92240678c0 0x7f9224069d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.891+0000 7f9247bf2640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9240147400 0x7f92401e14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.891+0000 7f9247bf2640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92401465b0 0x7f9240146ec0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.891+0000 7f9247bf2640 1 --2- 172.21.15.43:0/346572780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f922c0039c0 0x7f9240144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:39.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.891+0000 7f9247bf2640 1 -- 172.21.15.43:0/346572780 >> 172.21.15.43:0/346572780 conn(0x7f92400b5690 msgr2=0x7f924006d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:39.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.891+0000 7f9247bf2640 1 -- 172.21.15.43:0/346572780 shutdown_connections 2024-04-24T23:00:39.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:39.891+0000 7f9247bf2640 1 -- 172.21.15.43:0/346572780 wait complete. 2024-04-24T23:00:39.912 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7f5320640 1 Processor -- start 2024-04-24T23:00:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7f5320640 1 -- start start 2024-04-24T23:00:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7f5320640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff7f006b450 0x7ff7f0147e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7f5320640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff7f00afb30 0x7ff7f0148380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7f5320640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7f009f600 con 0x7ff7f00b54f0 2024-04-24T23:00:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7f5320640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff7f00aef90 con 0x7ff7f006b450 2024-04-24T23:00:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7f5320640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff7f009f8a0 con 0x7ff7f00afb30 2024-04-24T23:00:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7ee7fc640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff7f00b54f0 0x7ff7f00af420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54616/0 (socket says 172.21.15.43:54616) 2024-04-24T23:00:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7ee7fc640 1 -- 172.21.15.43:0/151045404 learned_addr learned my addr 172.21.15.43:0/151045404 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7eeffd640 1 --2- 172.21.15.43:0/151045404 >> v2:172.21.15.43:3300/0 conn(0x7ff7f006b450 0x7ff7f0147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7ef7fe640 1 --2- 172.21.15.43:0/151045404 >> v2:172.21.15.162:3300/0 conn(0x7ff7f00afb30 0x7ff7f0148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7eeffd640 1 -- 172.21.15.43:0/151045404 >> v2:172.21.15.162:3300/0 conn(0x7ff7f00afb30 msgr2=0x7ff7f0148380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7eeffd640 1 --2- 172.21.15.43:0/151045404 >> v2:172.21.15.162:3300/0 conn(0x7ff7f00afb30 0x7ff7f0148380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7eeffd640 1 -- 172.21.15.43:0/151045404 >> v1:172.21.15.43:6789/0 conn(0x7ff7f00b54f0 legacy=0x7ff7f00af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7eeffd640 1 -- 172.21.15.43:0/151045404 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f009fb80 con 0x7ff7f006b450 2024-04-24T23:00:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7ef7fe640 1 --2- 172.21.15.43:0/151045404 >> v2:172.21.15.162:3300/0 conn(0x7ff7f00afb30 0x7ff7f0148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.031+0000 7ff7edffb640 1 -- 172.21.15.43:0/151045404 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3654037086 0 0) 0x7ff7f009f600 con 0x7ff7f00b54f0 2024-04-24T23:00:40.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.035+0000 7ff7eeffd640 1 --2- 172.21.15.43:0/151045404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f006b450 0x7ff7f0147e40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00b5b20 tx=0x7ff7e001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8ad573d75e8a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.035+0000 7ff7edffb640 1 -- 172.21.15.43:0/151045404 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00b0070 con 0x7ff7f006b450 2024-04-24T23:00:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.035+0000 7ff7edffb640 1 -- 172.21.15.43:0/151045404 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e00ab600 con 0x7ff7f006b450 2024-04-24T23:00:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.035+0000 7ff7edffb640 1 -- 172.21.15.43:0/151045404 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00ab9d0 con 0x7ff7f006b450 2024-04-24T23:00:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.035+0000 7ff7f5320640 1 -- 172.21.15.43:0/151045404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f006b450 msgr2=0x7ff7f0147e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.035+0000 7ff7f5320640 1 --2- 172.21.15.43:0/151045404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f006b450 0x7ff7f0147e40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00b5b20 tx=0x7ff7e001c3f0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.035+0000 7ff7f5320640 1 -- 172.21.15.43:0/151045404 shutdown_connections 2024-04-24T23:00:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.035+0000 7ff7f5320640 1 --2- 172.21.15.43:0/151045404 >> v2:172.21.15.162:3300/0 conn(0x7ff7f00afb30 0x7ff7f0148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.035+0000 7ff7f5320640 1 --2- 172.21.15.43:0/151045404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f006b450 0x7ff7f0147e40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.035+0000 7ff7f5320640 1 -- 172.21.15.43:0/151045404 >> 172.21.15.43:0/151045404 conn(0x7ff7f00b9b50 msgr2=0x7ff7f00b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.035+0000 7ff7f5320640 1 -- 172.21.15.43:0/151045404 shutdown_connections 2024-04-24T23:00:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.035+0000 7ff7f5320640 1 -- 172.21.15.43:0/151045404 wait complete. 2024-04-24T23:00:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.035+0000 7ff7f5320640 1 Processor -- start 2024-04-24T23:00:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.035+0000 7ff7f5320640 1 -- start start 2024-04-24T23:00:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7f5320640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7f006b450 0x7ff7f0141820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7f5320640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7f00afb30 0x7ff7f013ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7f5320640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f0143b20 0x7ff7f0142880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7f5320640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f0154970 con 0x7ff7f0143b20 2024-04-24T23:00:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7f5320640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f01547f0 con 0x7ff7f006b450 2024-04-24T23:00:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7f5320640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f0154af0 con 0x7ff7f00afb30 2024-04-24T23:00:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7ef7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f0143b20 0x7ff7f0142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7ef7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f0143b20 0x7ff7f0142880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43302/0 (socket says 172.21.15.43:43302) 2024-04-24T23:00:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7ef7fe640 1 -- 172.21.15.43:0/2958099352 learned_addr learned my addr 172.21.15.43:0/2958099352 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7eeffd640 1 --2- 172.21.15.43:0/2958099352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7f006b450 0x7ff7f0141820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7ee7fc640 1 --2- 172.21.15.43:0/2958099352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7f00afb30 0x7ff7f013ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7ef7fe640 1 -- 172.21.15.43:0/2958099352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7f00afb30 msgr2=0x7ff7f013ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7ef7fe640 1 --2- 172.21.15.43:0/2958099352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7f00afb30 0x7ff7f013ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7ef7fe640 1 -- 172.21.15.43:0/2958099352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7f006b450 msgr2=0x7ff7f0141820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7ef7fe640 1 --2- 172.21.15.43:0/2958099352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7f006b450 0x7ff7f0141820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7ef7fe640 1 -- 172.21.15.43:0/2958099352 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f0141d60 con 0x7ff7f0143b20 2024-04-24T23:00:40.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7eeffd640 1 --2- 172.21.15.43:0/2958099352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7f006b450 0x7ff7f0141820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:40.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7ef7fe640 1 --2- 172.21.15.43:0/2958099352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f0143b20 0x7ff7f0142880 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff7e800cef0 tx=0x7ff7e800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:40.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7e77fe640 1 -- 172.21.15.43:0/2958099352 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e801a070 con 0x7ff7f0143b20 2024-04-24T23:00:40.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7e77fe640 1 -- 172.21.15.43:0/2958099352 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e800d860 con 0x7ff7f0143b20 2024-04-24T23:00:40.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7f5320640 1 -- 172.21.15.43:0/2958099352 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f0145100 con 0x7ff7f0143b20 2024-04-24T23:00:40.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7e77fe640 1 -- 172.21.15.43:0/2958099352 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e800dc50 con 0x7ff7f0143b20 2024-04-24T23:00:40.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7f5320640 1 -- 172.21.15.43:0/2958099352 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f0144e20 con 0x7ff7f0143b20 2024-04-24T23:00:40.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7f5320640 1 -- 172.21.15.43:0/2958099352 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f004f580 con 0x7ff7f0143b20 2024-04-24T23:00:40.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7e77fe640 1 -- 172.21.15.43:0/2958099352 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff7e801d070 con 0x7ff7f0143b20 2024-04-24T23:00:40.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7e77fe640 1 --2- 172.21.15.43:0/2958099352 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff7d00678f0 0x7ff7d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7e77fe640 1 -- 172.21.15.43:0/2958099352 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff7e8086c30 con 0x7ff7f0143b20 2024-04-24T23:00:40.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7eeffd640 1 --2- 172.21.15.43:0/2958099352 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff7d00678f0 0x7ff7d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.039+0000 7ff7eeffd640 1 --2- 172.21.15.43:0/2958099352 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff7d00678f0 0x7ff7d0069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff7e00ad000 tx=0x7ff7e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:40.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.043+0000 7ff7e77fe640 1 -- 172.21.15.43:0/2958099352 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ff7e8024020 con 0x7ff7f0143b20 2024-04-24T23:00:40.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.207+0000 7ff7f5320640 1 -- 172.21.15.43:0/2958099352 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7f00b3f80 con 0x7ff7f0143b20 2024-04-24T23:00:40.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.207+0000 7ff7e77fe640 1 -- 172.21.15.43:0/2958099352 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18518 (secure 0 0 0) 0x7ff7e80575d0 con 0x7ff7f0143b20 2024-04-24T23:00:40.215 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:40.215 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:20.863941+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.211+0000 7ff7f5320640 1 -- 172.21.15.43:0/2958099352 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff7d00678f0 msgr2=0x7ff7d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.211+0000 7ff7f5320640 1 --2- 172.21.15.43:0/2958099352 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff7d00678f0 0x7ff7d0069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff7e00ad000 tx=0x7ff7e0008040 comp rx=0 tx=0).stop 2024-04-24T23:00:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.211+0000 7ff7f5320640 1 -- 172.21.15.43:0/2958099352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f0143b20 msgr2=0x7ff7f0142880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.211+0000 7ff7f5320640 1 --2- 172.21.15.43:0/2958099352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f0143b20 0x7ff7f0142880 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff7e800cef0 tx=0x7ff7e800a710 comp rx=0 tx=0).stop 2024-04-24T23:00:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.211+0000 7ff7f5320640 1 -- 172.21.15.43:0/2958099352 shutdown_connections 2024-04-24T23:00:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.211+0000 7ff7f5320640 1 --2- 172.21.15.43:0/2958099352 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff7d00678f0 0x7ff7d0069db0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.211+0000 7ff7f5320640 1 --2- 172.21.15.43:0/2958099352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f0143b20 0x7ff7f0142880 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.211+0000 7ff7f5320640 1 --2- 172.21.15.43:0/2958099352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7f00afb30 0x7ff7f013ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.211+0000 7ff7f5320640 1 --2- 172.21.15.43:0/2958099352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7f006b450 0x7ff7f0141820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.211+0000 7ff7f5320640 1 -- 172.21.15.43:0/2958099352 >> 172.21.15.43:0/2958099352 conn(0x7ff7f00b9b50 msgr2=0x7ff7f00b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:40.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.211+0000 7ff7f5320640 1 -- 172.21.15.43:0/2958099352 shutdown_connections 2024-04-24T23:00:40.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.211+0000 7ff7f5320640 1 -- 172.21.15.43:0/2958099352 wait complete. 2024-04-24T23:00:40.234 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:00:02.322280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:00:14.136303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:00:14.764010+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T23:00:18.504756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:00:40.235 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:00:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f9745af7640 1 Processor -- start 2024-04-24T23:00:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f9745af7640 1 -- start start 2024-04-24T23:00:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f9745af7640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f97400b2500 0x7f9740145450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f9745af7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9740145990 0x7f974013f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f9745af7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f974013f730 0x7f97401489c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f9745af7640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f9740070060 con 0x7f97400b2500 2024-04-24T23:00:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f9745af7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f97400b28e0 con 0x7f974013f730 2024-04-24T23:00:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f9745af7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f97400af8f0 con 0x7f9740145990 2024-04-24T23:00:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f973f7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f97400b2500 0x7f9740145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f973f7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f97400b2500 0x7f9740145450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34594/0 (socket says 172.21.15.43:34594) 2024-04-24T23:00:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f973f7fe640 1 -- 172.21.15.43:0/1047130324 learned_addr learned my addr 172.21.15.43:0/1047130324 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f973effd640 1 --2- 172.21.15.43:0/1047130324 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9740145990 0x7f974013f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f973ffff640 1 --2- 172.21.15.43:0/1047130324 >> v2:172.21.15.162:3300/0 conn(0x7f974013f730 0x7f97401489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f973f7fe640 1 -- 172.21.15.43:0/1047130324 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9740145990 msgr2=0x7f974013f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:40.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f973f7fe640 1 --2- 172.21.15.43:0/1047130324 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9740145990 0x7f974013f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f973f7fe640 1 -- 172.21.15.43:0/1047130324 >> v2:172.21.15.162:3300/0 conn(0x7f974013f730 msgr2=0x7f97401489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:40.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f973f7fe640 1 --2- 172.21.15.43:0/1047130324 >> v2:172.21.15.162:3300/0 conn(0x7f974013f730 0x7f97401489c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f973f7fe640 1 -- 172.21.15.43:0/1047130324 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974006fb40 con 0x7f97400b2500 2024-04-24T23:00:40.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.351+0000 7f973ffff640 1 --2- 172.21.15.43:0/1047130324 >> v2:172.21.15.162:3300/0 conn(0x7f974013f730 0x7f97401489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:40.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973f7fe640 1 --2- 172.21.15.43:0/1047130324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97400b2500 0x7f9740145450 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9740149a60 tx=0x7f973001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658bf3ad7827e90f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:40.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973e7fc640 1 -- 172.21.15.43:0/1047130324 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97300b0070 con 0x7f97400b2500 2024-04-24T23:00:40.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973e7fc640 1 -- 172.21.15.43:0/1047130324 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97300ab600 con 0x7f97400b2500 2024-04-24T23:00:40.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973e7fc640 1 -- 172.21.15.43:0/1047130324 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97400b63c0 con 0x7f97400b2500 2024-04-24T23:00:40.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 -- 172.21.15.43:0/1047130324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97400b2500 msgr2=0x7f9740145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 --2- 172.21.15.43:0/1047130324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97400b2500 0x7f9740145450 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9740149a60 tx=0x7f973001c260 comp rx=0 tx=0).stop 2024-04-24T23:00:40.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 -- 172.21.15.43:0/1047130324 shutdown_connections 2024-04-24T23:00:40.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 --2- 172.21.15.43:0/1047130324 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9740145990 0x7f974013f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 --2- 172.21.15.43:0/1047130324 >> v2:172.21.15.162:3300/0 conn(0x7f974013f730 0x7f97401489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 --2- 172.21.15.43:0/1047130324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97400b2500 0x7f9740145450 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 -- 172.21.15.43:0/1047130324 >> 172.21.15.43:0/1047130324 conn(0x7f97400b5690 msgr2=0x7f97400b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:40.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 -- 172.21.15.43:0/1047130324 shutdown_connections 2024-04-24T23:00:40.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 -- 172.21.15.43:0/1047130324 wait complete. 2024-04-24T23:00:40.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 Processor -- start 2024-04-24T23:00:40.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 -- start start 2024-04-24T23:00:40.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97400b2500 0x7f97400b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f974013f730 0x7f974013dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9740145990 0x7f974013e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f97400b4af0 con 0x7f97400b2500 2024-04-24T23:00:40.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f97400b54a0 con 0x7f974013f730 2024-04-24T23:00:40.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f97400b4c70 con 0x7f9740145990 2024-04-24T23:00:40.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97400b2500 0x7f97400b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97400b2500 0x7f97400b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34606/0 (socket says 172.21.15.43:34606) 2024-04-24T23:00:40.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973f7fe640 1 -- 172.21.15.43:0/2293905367 learned_addr learned my addr 172.21.15.43:0/2293905367 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:40.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973effd640 1 --2- 172.21.15.43:0/2293905367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f974013f730 0x7f974013dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973ffff640 1 --2- 172.21.15.43:0/2293905367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9740145990 0x7f974013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973f7fe640 1 -- 172.21.15.43:0/2293905367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9740145990 msgr2=0x7f974013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973f7fe640 1 --2- 172.21.15.43:0/2293905367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9740145990 0x7f974013e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973f7fe640 1 -- 172.21.15.43:0/2293905367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f974013f730 msgr2=0x7f974013dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973f7fe640 1 --2- 172.21.15.43:0/2293905367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f974013f730 0x7f974013dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973f7fe640 1 -- 172.21.15.43:0/2293905367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9740145120 con 0x7f97400b2500 2024-04-24T23:00:40.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973effd640 1 --2- 172.21.15.43:0/2293905367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f974013f730 0x7f974013dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:40.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f973f7fe640 1 --2- 172.21.15.43:0/2293905367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97400b2500 0x7f97400b0d90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f97300ae040 tx=0x7f9730019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:40.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9727fff640 1 -- 172.21.15.43:0/2293905367 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97300b0040 con 0x7f97400b2500 2024-04-24T23:00:40.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9727fff640 1 -- 172.21.15.43:0/2293905367 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97300b9070 con 0x7f97400b2500 2024-04-24T23:00:40.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9745af7640 1 -- 172.21.15.43:0/2293905367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9740143e00 con 0x7f97400b2500 2024-04-24T23:00:40.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.355+0000 7f9727fff640 1 -- 172.21.15.43:0/2293905367 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97300b46a0 con 0x7f97400b2500 2024-04-24T23:00:40.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.359+0000 7f9745af7640 1 -- 172.21.15.43:0/2293905367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97400b1a00 con 0x7f97400b2500 2024-04-24T23:00:40.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.359+0000 7f9745af7640 1 -- 172.21.15.43:0/2293905367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f974004f580 con 0x7f97400b2500 2024-04-24T23:00:40.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.359+0000 7f9727fff640 1 -- 172.21.15.43:0/2293905367 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f97300b4840 con 0x7f97400b2500 2024-04-24T23:00:40.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.359+0000 7f9727fff640 1 --2- 172.21.15.43:0/2293905367 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f972c0678f0 0x7f972c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.359+0000 7f9727fff640 1 -- 172.21.15.43:0/2293905367 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f973011fb80 con 0x7f97400b2500 2024-04-24T23:00:40.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.359+0000 7f973effd640 1 --2- 172.21.15.43:0/2293905367 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f972c0678f0 0x7f972c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.359+0000 7f973effd640 1 --2- 172.21.15.43:0/2293905367 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f972c0678f0 0x7f972c069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f97400b16f0 tx=0x7f9734008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:40.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.363+0000 7f9727fff640 1 -- 172.21.15.43:0/2293905367 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9730016110 con 0x7f97400b2500 2024-04-24T23:00:40.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.531+0000 7f9745af7640 1 -- 172.21.15.43:0/2293905367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9740148cb0 con 0x7f97400b2500 2024-04-24T23:00:40.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.531+0000 7f9727fff640 1 -- 172.21.15.43:0/2293905367 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f97300f0410 con 0x7f97400b2500 2024-04-24T23:00:40.536 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-24T23:00:40.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.531+0000 7f9745af7640 1 -- 172.21.15.43:0/2293905367 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f972c0678f0 msgr2=0x7f972c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.531+0000 7f9745af7640 1 --2- 172.21.15.43:0/2293905367 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f972c0678f0 0x7f972c069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f97400b16f0 tx=0x7f9734008040 comp rx=0 tx=0).stop 2024-04-24T23:00:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.531+0000 7f9745af7640 1 -- 172.21.15.43:0/2293905367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97400b2500 msgr2=0x7f97400b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.531+0000 7f9745af7640 1 --2- 172.21.15.43:0/2293905367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97400b2500 0x7f97400b0d90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f97300ae040 tx=0x7f9730019000 comp rx=0 tx=0).stop 2024-04-24T23:00:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.531+0000 7f9745af7640 1 -- 172.21.15.43:0/2293905367 shutdown_connections 2024-04-24T23:00:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.531+0000 7f9745af7640 1 --2- 172.21.15.43:0/2293905367 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f972c0678f0 0x7f972c069db0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.531+0000 7f9745af7640 1 --2- 172.21.15.43:0/2293905367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9740145990 0x7f974013e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.531+0000 7f9745af7640 1 --2- 172.21.15.43:0/2293905367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f974013f730 0x7f974013dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.531+0000 7f9745af7640 1 --2- 172.21.15.43:0/2293905367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97400b2500 0x7f97400b0d90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.531+0000 7f9745af7640 1 -- 172.21.15.43:0/2293905367 >> 172.21.15.43:0/2293905367 conn(0x7f97400b5690 msgr2=0x7f974014f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.531+0000 7f9745af7640 1 -- 172.21.15.43:0/2293905367 shutdown_connections 2024-04-24T23:00:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.531+0000 7f9745af7640 1 -- 172.21.15.43:0/2293905367 wait complete. 2024-04-24T23:00:40.555 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:00:40.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4faa28e640 1 Processor -- start 2024-04-24T23:00:40.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4faa28e640 1 -- start start 2024-04-24T23:00:40.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4faa28e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4fa40b57a0 0x7f4fa406f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4faa28e640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fa406f440 con 0x7f4fa406fda0 2024-04-24T23:00:40.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4faa28e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fa4141de0 con 0x7f4fa4141a00 2024-04-24T23:00:40.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4faa28e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4fa40b71d0 con 0x7f4fa40b57a0 2024-04-24T23:00:40.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa882b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4fa406fda0 0x7f4fa4152150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:51096/0 (socket says 172.21.15.43:51096) 2024-04-24T23:00:40.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa882b640 1 -- 172.21.15.43:0/744789026 learned_addr learned my addr 172.21.15.43:0/744789026 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:40.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa37fe640 1 --2- 172.21.15.43:0/744789026 >> v2:172.21.15.162:3300/0 conn(0x7f4fa40b57a0 0x7f4fa406f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa2ffd640 1 -- 172.21.15.43:0/744789026 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571276760 0 0) 0x7f4fa406f440 con 0x7f4fa406fda0 2024-04-24T23:00:40.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa2ffd640 1 -- 172.21.15.43:0/744789026 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f8c003530 con 0x7f4fa406fda0 2024-04-24T23:00:40.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa2ffd640 1 -- 172.21.15.43:0/744789026 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 154160821 0 0) 0x7f4f8c003530 con 0x7f4fa406fda0 2024-04-24T23:00:40.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa2ffd640 1 -- 172.21.15.43:0/744789026 >> v2:172.21.15.162:3300/0 conn(0x7f4fa40b57a0 msgr2=0x7f4fa406f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:40.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa2ffd640 1 --2- 172.21.15.43:0/744789026 >> v2:172.21.15.162:3300/0 conn(0x7f4fa40b57a0 0x7f4fa406f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa2ffd640 1 -- 172.21.15.43:0/744789026 >> v1:172.21.15.162:6789/0 conn(0x7f4fa4141a00 legacy=0x7f4fa4072b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa2ffd640 1 -- 172.21.15.43:0/744789026 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa40b6ef0 con 0x7f4fa406fda0 2024-04-24T23:00:40.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa2ffd640 1 -- 172.21.15.43:0/744789026 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f4f9c001a00 con 0x7f4fa406fda0 2024-04-24T23:00:40.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa2ffd640 1 -- 172.21.15.43:0/744789026 >> v1:172.21.15.43:6789/0 conn(0x7f4fa406fda0 legacy=0x7f4fa4152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa2ffd640 1 --2- 172.21.15.43:0/744789026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f8c0039c0 0x7f4f8c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa2ffd640 1 --2- 172.21.15.43:0/744789026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f8c004810 0x7f4f8c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa2ffd640 1 --2- 172.21.15.43:0/744789026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f8c0051d0 0x7f4f8c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa2ffd640 1 -- 172.21.15.43:0/744789026 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa40b71d0 con 0x7f4f8c004810 2024-04-24T23:00:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa2ffd640 1 -- 172.21.15.43:0/744789026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8c00c170 con 0x7f4f8c0039c0 2024-04-24T23:00:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa2ffd640 1 -- 172.21.15.43:0/744789026 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4f8c00c370 con 0x7f4f8c0051d0 2024-04-24T23:00:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa37fe640 1 --2- 172.21.15.43:0/744789026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f8c004810 0x7f4f8c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa3fff640 1 --2- 172.21.15.43:0/744789026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f8c0039c0 0x7f4f8c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa37fe640 1 -- 172.21.15.43:0/744789026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f8c0051d0 msgr2=0x7f4f8c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa37fe640 1 --2- 172.21.15.43:0/744789026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f8c0051d0 0x7f4f8c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa37fe640 1 -- 172.21.15.43:0/744789026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f8c0039c0 msgr2=0x7f4f8c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa37fe640 1 --2- 172.21.15.43:0/744789026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f8c0039c0 0x7f4f8c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa37fe640 1 -- 172.21.15.43:0/744789026 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f8c003530 con 0x7f4f8c004810 2024-04-24T23:00:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa3fff640 1 --2- 172.21.15.43:0/744789026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f8c0039c0 0x7f4f8c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.675+0000 7f4fa882b640 1 -- 172.21.15.43:0/744789026 reap_dead start 2024-04-24T23:00:40.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.679+0000 7f4fa37fe640 1 --2- 172.21.15.43:0/744789026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f8c004810 0x7f4f8c004c90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009ae0 tx=0x7f4f9801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b139dc0dd65ba37 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:40.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.679+0000 7f4fa2ffd640 1 -- 172.21.15.43:0/744789026 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f980096b0 con 0x7f4f8c004810 2024-04-24T23:00:40.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.679+0000 7f4fa2ffd640 1 -- 172.21.15.43:0/744789026 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f980a6450 con 0x7f4f8c004810 2024-04-24T23:00:40.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.679+0000 7f4fa2ffd640 1 -- 172.21.15.43:0/744789026 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f980a6840 con 0x7f4f8c004810 2024-04-24T23:00:40.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.679+0000 7f4faa28e640 1 -- 172.21.15.43:0/744789026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f8c004810 msgr2=0x7f4f8c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.679+0000 7f4faa28e640 1 --2- 172.21.15.43:0/744789026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f8c004810 0x7f4f8c004c90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009ae0 tx=0x7f4f9801ca70 comp rx=0 tx=0).stop 2024-04-24T23:00:40.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.679+0000 7f4faa28e640 1 -- 172.21.15.43:0/744789026 shutdown_connections 2024-04-24T23:00:40.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.679+0000 7f4faa28e640 1 --2- 172.21.15.43:0/744789026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f8c004810 0x7f4f8c004c90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.679+0000 7f4faa28e640 1 -- 172.21.15.43:0/744789026 >> 172.21.15.43:0/744789026 conn(0x7f4fa40b78a0 msgr2=0x7f4fa40b7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:40.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.679+0000 7f4faa28e640 1 -- 172.21.15.43:0/744789026 shutdown_connections 2024-04-24T23:00:40.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.679+0000 7f4faa28e640 1 -- 172.21.15.43:0/744789026 wait complete. 2024-04-24T23:00:40.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.679+0000 7f4faa28e640 1 Processor -- start 2024-04-24T23:00:40.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.679+0000 7f4faa28e640 1 -- start start 2024-04-24T23:00:40.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4faa28e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f8c004810 0x7f4fa40b9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4faa28e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fa413cb30 0x7f4fa41e3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4faa28e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fa413cf70 0x7f4fa41e41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4faa28e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa409ee70 con 0x7f4f8c004810 2024-04-24T23:00:40.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4faa28e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa40b6400 con 0x7f4fa413cf70 2024-04-24T23:00:40.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4faa28e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4fa409eff0 con 0x7f4fa413cb30 2024-04-24T23:00:40.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f8c004810 0x7f4fa40b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f8c004810 0x7f4fa40b9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34630/0 (socket says 172.21.15.43:34630) 2024-04-24T23:00:40.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa3fff640 1 -- 172.21.15.43:0/2485942287 learned_addr learned my addr 172.21.15.43:0/2485942287 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:40.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa37fe640 1 --2- 172.21.15.43:0/2485942287 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fa413cb30 0x7f4fa41e3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa882b640 1 --2- 172.21.15.43:0/2485942287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fa413cf70 0x7f4fa41e41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa3fff640 1 -- 172.21.15.43:0/2485942287 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fa413cb30 msgr2=0x7f4fa41e3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa3fff640 1 --2- 172.21.15.43:0/2485942287 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fa413cb30 0x7f4fa41e3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa3fff640 1 -- 172.21.15.43:0/2485942287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fa413cf70 msgr2=0x7f4fa41e41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa3fff640 1 --2- 172.21.15.43:0/2485942287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fa413cf70 0x7f4fa41e41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa3fff640 1 -- 172.21.15.43:0/2485942287 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa4142280 con 0x7f4f8c004810 2024-04-24T23:00:40.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa3fff640 1 --2- 172.21.15.43:0/2485942287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f8c004810 0x7f4fa40b9050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400d400 tx=0x7f4f9400d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:40.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa0ff9640 1 -- 172.21.15.43:0/2485942287 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f94018070 con 0x7f4f8c004810 2024-04-24T23:00:40.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa0ff9640 1 -- 172.21.15.43:0/2485942287 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f94003620 con 0x7f4f8c004810 2024-04-24T23:00:40.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4faa28e640 1 -- 172.21.15.43:0/2485942287 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa413f5b0 con 0x7f4f8c004810 2024-04-24T23:00:40.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa0ff9640 1 -- 172.21.15.43:0/2485942287 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f94003a10 con 0x7f4f8c004810 2024-04-24T23:00:40.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4faa28e640 1 -- 172.21.15.43:0/2485942287 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa413fb70 con 0x7f4f8c004810 2024-04-24T23:00:40.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4faa28e640 1 -- 172.21.15.43:0/2485942287 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fa404f580 con 0x7f4f8c004810 2024-04-24T23:00:40.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa0ff9640 1 -- 172.21.15.43:0/2485942287 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f9401b070 con 0x7f4f8c004810 2024-04-24T23:00:40.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa0ff9640 1 --2- 172.21.15.43:0/2485942287 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4f900678c0 0x7f4f90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:40.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa0ff9640 1 -- 172.21.15.43:0/2485942287 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4f94085e50 con 0x7f4f8c004810 2024-04-24T23:00:40.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa37fe640 1 --2- 172.21.15.43:0/2485942287 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4f900678c0 0x7f4f90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:40.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.683+0000 7f4fa37fe640 1 --2- 172.21.15.43:0/2485942287 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4f900678c0 0x7f4f90069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f980ad000 tx=0x7f4f980b2040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:40.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.687+0000 7f4fa0ff9640 1 -- 172.21.15.43:0/2485942287 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f4f940560e0 con 0x7f4f8c004810 2024-04-24T23:00:40.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.847+0000 7f4faa28e640 1 -- 172.21.15.43:0/2485942287 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4fa40a03a0 con 0x7f4f8c004810 2024-04-24T23:00:40.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.851+0000 7f4fa0ff9640 1 -- 172.21.15.43:0/2485942287 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f4f9405a3e0 con 0x7f4f8c004810 2024-04-24T23:00:40.855 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-24T23:00:40.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.851+0000 7f4faa28e640 1 -- 172.21.15.43:0/2485942287 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4f900678c0 msgr2=0x7f4f90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.851+0000 7f4faa28e640 1 --2- 172.21.15.43:0/2485942287 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4f900678c0 0x7f4f90069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f980ad000 tx=0x7f4f980b2040 comp rx=0 tx=0).stop 2024-04-24T23:00:40.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.851+0000 7f4faa28e640 1 -- 172.21.15.43:0/2485942287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f8c004810 msgr2=0x7f4fa40b9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:40.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.851+0000 7f4faa28e640 1 --2- 172.21.15.43:0/2485942287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f8c004810 0x7f4fa40b9050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400d400 tx=0x7f4f9400d8c0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.851+0000 7f4faa28e640 1 -- 172.21.15.43:0/2485942287 shutdown_connections 2024-04-24T23:00:40.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.851+0000 7f4faa28e640 1 --2- 172.21.15.43:0/2485942287 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4f900678c0 0x7f4f90069d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.851+0000 7f4faa28e640 1 --2- 172.21.15.43:0/2485942287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fa413cf70 0x7f4fa41e41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.851+0000 7f4faa28e640 1 --2- 172.21.15.43:0/2485942287 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fa413cb30 0x7f4fa41e3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.851+0000 7f4faa28e640 1 --2- 172.21.15.43:0/2485942287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f8c004810 0x7f4fa40b9050 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:40.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.851+0000 7f4faa28e640 1 -- 172.21.15.43:0/2485942287 >> 172.21.15.43:0/2485942287 conn(0x7f4fa40b78a0 msgr2=0x7f4fa40b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:40.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.851+0000 7f4faa28e640 1 -- 172.21.15.43:0/2485942287 shutdown_connections 2024-04-24T23:00:40.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.851+0000 7f4faa28e640 1 -- 172.21.15.43:0/2485942287 wait complete. 2024-04-24T23:00:40.874 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:00:41.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb2a0f13640 1 Processor -- start 2024-04-24T23:00:41.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb2a0f13640 1 -- start start 2024-04-24T23:00:41.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb2a0f13640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb29c0bd870 0x7fb29c0b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb2a0f13640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb29c0b9590 0x7fb29c14ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb2a0f13640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb29c14b190 0x7fb29c1411c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb2a0f13640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fb29c14b600 con 0x7fb29c0b9590 2024-04-24T23:00:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb2a0f13640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb29c0bdc50 con 0x7fb29c0bd870 2024-04-24T23:00:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb2a0f13640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb29c0b5740 con 0x7fb29c14b190 2024-04-24T23:00:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb299d9b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb29c0b9590 0x7fb29c14ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb299d9b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb29c0b9590 0x7fb29c14ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34636/0 (socket says 172.21.15.43:34636) 2024-04-24T23:00:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb299d9b640 1 -- 172.21.15.43:0/1247920290 learned_addr learned my addr 172.21.15.43:0/1247920290 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb29ad9d640 1 --2- 172.21.15.43:0/1247920290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb29c14b190 0x7fb29c1411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb29a59c640 1 --2- 172.21.15.43:0/1247920290 >> v2:172.21.15.162:3300/0 conn(0x7fb29c0bd870 0x7fb29c0b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb299d9b640 1 -- 172.21.15.43:0/1247920290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb29c14b190 msgr2=0x7fb29c1411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb299d9b640 1 --2- 172.21.15.43:0/1247920290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb29c14b190 0x7fb29c1411c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb299d9b640 1 -- 172.21.15.43:0/1247920290 >> v2:172.21.15.162:3300/0 conn(0x7fb29c0bd870 msgr2=0x7fb29c0b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb299d9b640 1 --2- 172.21.15.43:0/1247920290 >> v2:172.21.15.162:3300/0 conn(0x7fb29c0bd870 0x7fb29c0b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:40.999+0000 7fb299d9b640 1 -- 172.21.15.43:0/1247920290 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29c0b5a20 con 0x7fb29c0b9590 2024-04-24T23:00:41.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb299d9b640 1 --2- 172.21.15.43:0/1247920290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29c0b9590 0x7fb29c14ac50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0b90a0 tx=0x7fb29001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbc9387e4049ec9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:41.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb29959a640 1 -- 172.21.15.43:0/1247920290 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2900ab600 con 0x7fb29c0b9590 2024-04-24T23:00:41.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb29959a640 1 -- 172.21.15.43:0/1247920290 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2900b0070 con 0x7fb29c0b9590 2024-04-24T23:00:41.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb29959a640 1 -- 172.21.15.43:0/1247920290 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2900ab9c0 con 0x7fb29c0b9590 2024-04-24T23:00:41.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 -- 172.21.15.43:0/1247920290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29c0b9590 msgr2=0x7fb29c14ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 --2- 172.21.15.43:0/1247920290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29c0b9590 0x7fb29c14ac50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0b90a0 tx=0x7fb29001c460 comp rx=0 tx=0).stop 2024-04-24T23:00:41.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 -- 172.21.15.43:0/1247920290 shutdown_connections 2024-04-24T23:00:41.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 --2- 172.21.15.43:0/1247920290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb29c14b190 0x7fb29c1411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 --2- 172.21.15.43:0/1247920290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29c0b9590 0x7fb29c14ac50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 --2- 172.21.15.43:0/1247920290 >> v2:172.21.15.162:3300/0 conn(0x7fb29c0bd870 0x7fb29c0b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 -- 172.21.15.43:0/1247920290 >> 172.21.15.43:0/1247920290 conn(0x7fb29c072f20 msgr2=0x7fb29c0bcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:41.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 -- 172.21.15.43:0/1247920290 shutdown_connections 2024-04-24T23:00:41.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 -- 172.21.15.43:0/1247920290 wait complete. 2024-04-24T23:00:41.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 Processor -- start 2024-04-24T23:00:41.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 -- start start 2024-04-24T23:00:41.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29c0bd870 0x7fb29c147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb29c14b190 0x7fb29c13e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb29c147130 0x7fb29c1475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c0b8210 con 0x7fb29c0bd870 2024-04-24T23:00:41.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c0b8090 con 0x7fb29c14b190 2024-04-24T23:00:41.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb2a0f13640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb29c0b8390 con 0x7fb29c147130 2024-04-24T23:00:41.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb29a59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29c0bd870 0x7fb29c147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb29a59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29c0bd870 0x7fb29c147ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34652/0 (socket says 172.21.15.43:34652) 2024-04-24T23:00:41.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.003+0000 7fb29a59c640 1 -- 172.21.15.43:0/570237169 learned_addr learned my addr 172.21.15.43:0/570237169 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:41.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb299d9b640 1 --2- 172.21.15.43:0/570237169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb29c14b190 0x7fb29c13e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb29ad9d640 1 --2- 172.21.15.43:0/570237169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb29c147130 0x7fb29c1475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb29a59c640 1 -- 172.21.15.43:0/570237169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb29c147130 msgr2=0x7fb29c1475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb29a59c640 1 --2- 172.21.15.43:0/570237169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb29c147130 0x7fb29c1475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb29a59c640 1 -- 172.21.15.43:0/570237169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb29c14b190 msgr2=0x7fb29c13e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb29a59c640 1 --2- 172.21.15.43:0/570237169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb29c14b190 0x7fb29c13e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb29a59c640 1 -- 172.21.15.43:0/570237169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29c142d80 con 0x7fb29c0bd870 2024-04-24T23:00:41.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb29a59c640 1 --2- 172.21.15.43:0/570237169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29c0bd870 0x7fb29c147ee0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb28c00d830 tx=0x7fb28c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:41.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb28affd640 1 -- 172.21.15.43:0/570237169 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28c00b6c0 con 0x7fb29c0bd870 2024-04-24T23:00:41.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb28affd640 1 -- 172.21.15.43:0/570237169 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb28c019070 con 0x7fb29c0bd870 2024-04-24T23:00:41.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb2a0f13640 1 -- 172.21.15.43:0/570237169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb29c147b00 con 0x7fb29c0bd870 2024-04-24T23:00:41.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb28affd640 1 -- 172.21.15.43:0/570237169 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28c00ba60 con 0x7fb29c0bd870 2024-04-24T23:00:41.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb2a0f13640 1 -- 172.21.15.43:0/570237169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb29c1420a0 con 0x7fb29c0bd870 2024-04-24T23:00:41.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb2a0f13640 1 -- 172.21.15.43:0/570237169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb29c04f580 con 0x7fb29c0bd870 2024-04-24T23:00:41.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb28affd640 1 -- 172.21.15.43:0/570237169 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb28c01e460 con 0x7fb29c0bd870 2024-04-24T23:00:41.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb28affd640 1 --2- 172.21.15.43:0/570237169 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb27c0678c0 0x7fb27c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb299d9b640 1 --2- 172.21.15.43:0/570237169 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb27c0678c0 0x7fb27c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb28affd640 1 -- 172.21.15.43:0/570237169 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb28c0866c0 con 0x7fb29c0bd870 2024-04-24T23:00:41.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.007+0000 7fb299d9b640 1 --2- 172.21.15.43:0/570237169 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb27c0678c0 0x7fb27c069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb2900af000 tx=0x7fb2900a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:41.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.011+0000 7fb28affd640 1 -- 172.21.15.43:0/570237169 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fb28c056ec0 con 0x7fb29c0bd870 2024-04-24T23:00:41.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.171+0000 7fb2a0f13640 1 -- 172.21.15.43:0/570237169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb29c146cf0 con 0x7fb29c0bd870 2024-04-24T23:00:41.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.171+0000 7fb28affd640 1 -- 172.21.15.43:0/570237169 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fb28c0567c0 con 0x7fb29c0bd870 2024-04-24T23:00:41.178 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-24T23:00:41.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.175+0000 7fb2a0f13640 1 -- 172.21.15.43:0/570237169 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb27c0678c0 msgr2=0x7fb27c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.175+0000 7fb2a0f13640 1 --2- 172.21.15.43:0/570237169 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb27c0678c0 0x7fb27c069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb2900af000 tx=0x7fb2900a7000 comp rx=0 tx=0).stop 2024-04-24T23:00:41.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.175+0000 7fb2a0f13640 1 -- 172.21.15.43:0/570237169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29c0bd870 msgr2=0x7fb29c147ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.175+0000 7fb2a0f13640 1 --2- 172.21.15.43:0/570237169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29c0bd870 0x7fb29c147ee0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb28c00d830 tx=0x7fb28c00dcf0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.175+0000 7fb2a0f13640 1 -- 172.21.15.43:0/570237169 shutdown_connections 2024-04-24T23:00:41.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.175+0000 7fb2a0f13640 1 --2- 172.21.15.43:0/570237169 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb27c0678c0 0x7fb27c069d80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.175+0000 7fb2a0f13640 1 --2- 172.21.15.43:0/570237169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb29c147130 0x7fb29c1475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.175+0000 7fb2a0f13640 1 --2- 172.21.15.43:0/570237169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb29c14b190 0x7fb29c13e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.175+0000 7fb2a0f13640 1 --2- 172.21.15.43:0/570237169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29c0bd870 0x7fb29c147ee0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.175+0000 7fb2a0f13640 1 -- 172.21.15.43:0/570237169 >> 172.21.15.43:0/570237169 conn(0x7fb29c072f20 msgr2=0x7fb29c13b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:41.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.175+0000 7fb2a0f13640 1 -- 172.21.15.43:0/570237169 shutdown_connections 2024-04-24T23:00:41.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.175+0000 7fb2a0f13640 1 -- 172.21.15.43:0/570237169 wait complete. 2024-04-24T23:00:41.198 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:00:41.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.315+0000 7f8eb4ca6640 1 Processor -- start 2024-04-24T23:00:41.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.315+0000 7f8eb4ca6640 1 -- start start 2024-04-24T23:00:41.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.315+0000 7f8eb4ca6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8eb00b9590 0x7f8eb00b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.315+0000 7f8eb4ca6640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb00bdc50 con 0x7f8eb014b360 2024-04-24T23:00:41.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.315+0000 7f8eb4ca6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb00b5740 con 0x7f8eb00bd870 2024-04-24T23:00:41.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.315+0000 7f8eb4ca6640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb00b5a20 con 0x7f8eb00b9590 2024-04-24T23:00:41.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.315+0000 7f8eadd9b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8eb00b9590 0x7f8eb00b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.315+0000 7f8eadd9b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8eb00b9590 0x7f8eb00b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34662/0 (socket says 172.21.15.43:34662) 2024-04-24T23:00:41.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.315+0000 7f8eadd9b640 1 -- 172.21.15.43:0/177545359 learned_addr learned my addr 172.21.15.43:0/177545359 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:41.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.315+0000 7f8eaed9d640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8eb014b360 0x7f8eb01411c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:51106/0 (socket says 172.21.15.43:51106) 2024-04-24T23:00:41.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.315+0000 7f8eadd9b640 1 -- 172.21.15.43:0/177545359 >> v1:172.21.15.162:6789/0 conn(0x7f8eb00bd870 legacy=0x7f8eb014ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:41.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.315+0000 7f8eadd9b640 1 -- 172.21.15.43:0/177545359 >> v1:172.21.15.43:6789/0 conn(0x7f8eb014b360 legacy=0x7f8eb01411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.315+0000 7f8ead59a640 1 -- 172.21.15.43:0/177545359 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 825888088 0 0) 0x7f8eb00bdc50 con 0x7f8eb014b360 2024-04-24T23:00:41.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.315+0000 7f8eadd9b640 1 -- 172.21.15.43:0/177545359 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb00b5d00 con 0x7f8eb00b9590 2024-04-24T23:00:41.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eadd9b640 1 --2- 172.21.15.43:0/177545359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb00b9590 0x7f8eb00b49d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009870 tx=0x7f8ea001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb61e6854345c07d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:41.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8ead59a640 1 -- 172.21.15.43:0/177545359 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00b1070 con 0x7f8eb00b9590 2024-04-24T23:00:41.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8ead59a640 1 -- 172.21.15.43:0/177545359 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea00a8050 con 0x7f8eb00b9590 2024-04-24T23:00:41.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8ead59a640 1 -- 172.21.15.43:0/177545359 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00ac860 con 0x7f8eb00b9590 2024-04-24T23:00:41.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eb4ca6640 1 -- 172.21.15.43:0/177545359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb00b9590 msgr2=0x7f8eb00b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eb4ca6640 1 --2- 172.21.15.43:0/177545359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb00b9590 0x7f8eb00b49d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009870 tx=0x7f8ea001c490 comp rx=0 tx=0).stop 2024-04-24T23:00:41.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eb4ca6640 1 -- 172.21.15.43:0/177545359 shutdown_connections 2024-04-24T23:00:41.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eb4ca6640 1 --2- 172.21.15.43:0/177545359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb00b9590 0x7f8eb00b49d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eb4ca6640 1 -- 172.21.15.43:0/177545359 >> 172.21.15.43:0/177545359 conn(0x7f8eb0072f20 msgr2=0x7f8eb00bcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:41.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eb4ca6640 1 -- 172.21.15.43:0/177545359 shutdown_connections 2024-04-24T23:00:41.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eb4ca6640 1 -- 172.21.15.43:0/177545359 wait complete. 2024-04-24T23:00:41.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eb4ca6640 1 Processor -- start 2024-04-24T23:00:41.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eb4ca6640 1 -- start start 2024-04-24T23:00:41.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eb4ca6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb00bd870 0x7f8eb01e3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eb4ca6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb014b360 0x7f8eb0144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eb4ca6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb0142780 0x7f8eb0137270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eb4ca6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb0155d10 con 0x7f8eb00bd870 2024-04-24T23:00:41.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eb4ca6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb0155b90 con 0x7f8eb014b360 2024-04-24T23:00:41.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eb4ca6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb0155e90 con 0x7f8eb0142780 2024-04-24T23:00:41.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eae59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb00bd870 0x7f8eb01e3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eae59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb00bd870 0x7f8eb01e3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34670/0 (socket says 172.21.15.43:34670) 2024-04-24T23:00:41.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eae59c640 1 -- 172.21.15.43:0/1364456617 learned_addr learned my addr 172.21.15.43:0/1364456617 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:41.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eadd9b640 1 --2- 172.21.15.43:0/1364456617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb014b360 0x7f8eb0144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eaed9d640 1 --2- 172.21.15.43:0/1364456617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb0142780 0x7f8eb0137270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eae59c640 1 -- 172.21.15.43:0/1364456617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb0142780 msgr2=0x7f8eb0137270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eae59c640 1 --2- 172.21.15.43:0/1364456617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb0142780 0x7f8eb0137270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eae59c640 1 -- 172.21.15.43:0/1364456617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb014b360 msgr2=0x7f8eb0144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eae59c640 1 --2- 172.21.15.43:0/1364456617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb014b360 0x7f8eb0144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eae59c640 1 -- 172.21.15.43:0/1364456617 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb0152c60 con 0x7f8eb00bd870 2024-04-24T23:00:41.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eadd9b640 1 --2- 172.21.15.43:0/1364456617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb014b360 0x7f8eb0144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:41.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8eae59c640 1 --2- 172.21.15.43:0/1364456617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb00bd870 0x7f8eb01e3070 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400c500 tx=0x7f8ea400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:41.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8e9effd640 1 -- 172.21.15.43:0/1364456617 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4016020 con 0x7f8eb00bd870 2024-04-24T23:00:41.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8e9effd640 1 -- 172.21.15.43:0/1364456617 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea4005220 con 0x7f8eb00bd870 2024-04-24T23:00:41.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.319+0000 7f8e9effd640 1 -- 172.21.15.43:0/1364456617 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4007030 con 0x7f8eb00bd870 2024-04-24T23:00:41.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.323+0000 7f8eb4ca6640 1 -- 172.21.15.43:0/1364456617 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb01e3cb0 con 0x7f8eb00bd870 2024-04-24T23:00:41.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.323+0000 7f8eb4ca6640 1 -- 172.21.15.43:0/1364456617 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb013c740 con 0x7f8eb00bd870 2024-04-24T23:00:41.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.323+0000 7f8eb4ca6640 1 -- 172.21.15.43:0/1364456617 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb004f580 con 0x7f8eb00bd870 2024-04-24T23:00:41.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.323+0000 7f8e9effd640 1 -- 172.21.15.43:0/1364456617 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ea40071d0 con 0x7f8eb00bd870 2024-04-24T23:00:41.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.323+0000 7f8e9effd640 1 --2- 172.21.15.43:0/1364456617 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8e900678c0 0x7f8e90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.323+0000 7f8eadd9b640 1 --2- 172.21.15.43:0/1364456617 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8e900678c0 0x7f8e90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.323+0000 7f8e9effd640 1 -- 172.21.15.43:0/1364456617 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8ea40853e0 con 0x7f8eb00bd870 2024-04-24T23:00:41.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.323+0000 7f8eadd9b640 1 --2- 172.21.15.43:0/1364456617 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8e900678c0 0x7f8e90069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00ae000 tx=0x7f8ea0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:41.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.327+0000 7f8e9effd640 1 -- 172.21.15.43:0/1364456617 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8eb0152c60 con 0x7f8eb00bd870 2024-04-24T23:00:41.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.487+0000 7f8eb4ca6640 1 -- 172.21.15.43:0/1364456617 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8eb0144e60 con 0x7f8eb00bd870 2024-04-24T23:00:41.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.487+0000 7f8e9effd640 1 -- 172.21.15.43:0/1364456617 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f8ea4055bf0 con 0x7f8eb00bd870 2024-04-24T23:00:41.493 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-24T23:00:41.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.491+0000 7f8eb4ca6640 1 -- 172.21.15.43:0/1364456617 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8e900678c0 msgr2=0x7f8e90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.491+0000 7f8eb4ca6640 1 --2- 172.21.15.43:0/1364456617 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8e900678c0 0x7f8e90069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00ae000 tx=0x7f8ea0008040 comp rx=0 tx=0).stop 2024-04-24T23:00:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.491+0000 7f8eb4ca6640 1 -- 172.21.15.43:0/1364456617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb00bd870 msgr2=0x7f8eb01e3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.491+0000 7f8eb4ca6640 1 --2- 172.21.15.43:0/1364456617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb00bd870 0x7f8eb01e3070 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400c500 tx=0x7f8ea400c9c0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.491+0000 7f8eb4ca6640 1 -- 172.21.15.43:0/1364456617 shutdown_connections 2024-04-24T23:00:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.491+0000 7f8eb4ca6640 1 --2- 172.21.15.43:0/1364456617 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8e900678c0 0x7f8e90069d80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.491+0000 7f8eb4ca6640 1 --2- 172.21.15.43:0/1364456617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb0142780 0x7f8eb0137270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.491+0000 7f8eb4ca6640 1 --2- 172.21.15.43:0/1364456617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb014b360 0x7f8eb0144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.491+0000 7f8eb4ca6640 1 --2- 172.21.15.43:0/1364456617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eb00bd870 0x7f8eb01e3070 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.491+0000 7f8eb4ca6640 1 -- 172.21.15.43:0/1364456617 >> 172.21.15.43:0/1364456617 conn(0x7f8eb0072f20 msgr2=0x7f8eb0147d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.491+0000 7f8eb4ca6640 1 -- 172.21.15.43:0/1364456617 shutdown_connections 2024-04-24T23:00:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.491+0000 7f8eb4ca6640 1 -- 172.21.15.43:0/1364456617 wait complete. 2024-04-24T23:00:41.512 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:00:41.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.627+0000 7f7c14793640 1 Processor -- start 2024-04-24T23:00:41.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.627+0000 7f7c14793640 1 -- start start 2024-04-24T23:00:41.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.631+0000 7f7c14793640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c0c0b2500 0x7f7c0c145450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.631+0000 7f7c14793640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7c0c13f900 0x7f7c0c14fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.631+0000 7f7c14793640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c0c070060 con 0x7f7c0c145990 2024-04-24T23:00:41.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.631+0000 7f7c14793640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f7c0c0b28e0 con 0x7f7c0c13f900 2024-04-24T23:00:41.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.631+0000 7f7c14793640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7c0c0af8f0 con 0x7f7c0c0b2500 2024-04-24T23:00:41.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.631+0000 7f7c12d30640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7c0c13f900 0x7f7c0c14fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.631+0000 7f7c11d2e640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7c0c145990 0x7f7c0c13f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:51120/0 (socket says 172.21.15.43:51120) 2024-04-24T23:00:41.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.631+0000 7f7c11d2e640 1 -- 172.21.15.43:0/344029957 learned_addr learned my addr 172.21.15.43:0/344029957 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:41.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.631+0000 7f7c12d30640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7c0c13f900 0x7f7c0c14fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34682/0 (socket says 172.21.15.43:34682) 2024-04-24T23:00:41.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.631+0000 7f7c1252f640 1 --2- 172.21.15.43:0/344029957 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c0c0b2500 0x7f7c0c145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.631+0000 7f7c12d30640 1 -- 172.21.15.43:0/344029957 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c0c0b2500 msgr2=0x7f7c0c145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:41.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.631+0000 7f7c12d30640 1 --2- 172.21.15.43:0/344029957 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c0c0b2500 0x7f7c0c145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.631+0000 7f7c12d30640 1 -- 172.21.15.43:0/344029957 >> v1:172.21.15.43:6789/0 conn(0x7f7c0c145990 legacy=0x7f7c0c13f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.631+0000 7f7c1152d640 1 -- 172.21.15.43:0/344029957 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 971796267 0 0) 0x7f7c0c070060 con 0x7f7c0c145990 2024-04-24T23:00:41.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.631+0000 7f7c12d30640 1 -- 172.21.15.43:0/344029957 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c06fb40 con 0x7f7c0c13f900 2024-04-24T23:00:41.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c12d30640 1 --2- 172.21.15.43:0/344029957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c0c13f900 0x7f7c0c14fcf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009d90 tx=0x7f7c0401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1855f45a04e30aa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:41.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c1152d640 1 -- 172.21.15.43:0/344029957 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c040b2070 con 0x7f7c0c13f900 2024-04-24T23:00:41.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c1152d640 1 -- 172.21.15.43:0/344029957 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c040a5830 con 0x7f7c0c13f900 2024-04-24T23:00:41.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c1152d640 1 -- 172.21.15.43:0/344029957 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c040a5c00 con 0x7f7c0c13f900 2024-04-24T23:00:41.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 -- 172.21.15.43:0/344029957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c0c13f900 msgr2=0x7f7c0c14fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 --2- 172.21.15.43:0/344029957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c0c13f900 0x7f7c0c14fcf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009d90 tx=0x7f7c0401c970 comp rx=0 tx=0).stop 2024-04-24T23:00:41.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 -- 172.21.15.43:0/344029957 shutdown_connections 2024-04-24T23:00:41.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 --2- 172.21.15.43:0/344029957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c0c13f900 0x7f7c0c14fcf0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 --2- 172.21.15.43:0/344029957 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c0c0b2500 0x7f7c0c145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 -- 172.21.15.43:0/344029957 >> 172.21.15.43:0/344029957 conn(0x7f7c0c0b5690 msgr2=0x7f7c0c0b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:41.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 -- 172.21.15.43:0/344029957 shutdown_connections 2024-04-24T23:00:41.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 -- 172.21.15.43:0/344029957 wait complete. 2024-04-24T23:00:41.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 Processor -- start 2024-04-24T23:00:41.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 -- start start 2024-04-24T23:00:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c0c0b2500 0x7f7c0c13e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c0c13f900 0x7f7c0c1e35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c0c145990 0x7f7c0c1e3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c0b54a0 con 0x7f7c0c145990 2024-04-24T23:00:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c0b4d40 con 0x7f7c0c13f900 2024-04-24T23:00:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7c0c152a50 con 0x7f7c0c0b2500 2024-04-24T23:00:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c12d30640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c0c145990 0x7f7c0c1e3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c12d30640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c0c145990 0x7f7c0c1e3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34692/0 (socket says 172.21.15.43:34692) 2024-04-24T23:00:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c12d30640 1 -- 172.21.15.43:0/2832908990 learned_addr learned my addr 172.21.15.43:0/2832908990 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c12d30640 1 -- 172.21.15.43:0/2832908990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c0c0b2500 msgr2=0x7f7c0c13e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c11d2e640 1 --2- 172.21.15.43:0/2832908990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c0c13f900 0x7f7c0c1e35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c1252f640 1 --2- 172.21.15.43:0/2832908990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c0c0b2500 0x7f7c0c13e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c12d30640 1 --2- 172.21.15.43:0/2832908990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c0c0b2500 0x7f7c0c13e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c12d30640 1 -- 172.21.15.43:0/2832908990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c0c13f900 msgr2=0x7f7c0c1e35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c12d30640 1 --2- 172.21.15.43:0/2832908990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c0c13f900 0x7f7c0c1e35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c12d30640 1 -- 172.21.15.43:0/2832908990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c0b1330 con 0x7f7c0c145990 2024-04-24T23:00:41.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c11d2e640 1 --2- 172.21.15.43:0/2832908990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c0c13f900 0x7f7c0c1e35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:41.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c12d30640 1 --2- 172.21.15.43:0/2832908990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c0c145990 0x7f7c0c1e3b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009d90 tx=0x7f7c04019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:41.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c02ffd640 1 -- 172.21.15.43:0/2832908990 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c040b2050 con 0x7f7c0c145990 2024-04-24T23:00:41.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c02ffd640 1 -- 172.21.15.43:0/2832908990 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c040be070 con 0x7f7c0c145990 2024-04-24T23:00:41.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 -- 172.21.15.43:0/2832908990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0c0b1610 con 0x7f7c0c145990 2024-04-24T23:00:41.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c02ffd640 1 -- 172.21.15.43:0/2832908990 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c040ada90 con 0x7f7c0c145990 2024-04-24T23:00:41.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.635+0000 7f7c14793640 1 -- 172.21.15.43:0/2832908990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c0c0b0fc0 con 0x7f7c0c145990 2024-04-24T23:00:41.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.639+0000 7f7c14793640 1 -- 172.21.15.43:0/2832908990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c0c04f580 con 0x7f7c0c145990 2024-04-24T23:00:41.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.639+0000 7f7c02ffd640 1 -- 172.21.15.43:0/2832908990 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7c040a56b0 con 0x7f7c0c145990 2024-04-24T23:00:41.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.639+0000 7f7c02ffd640 1 --2- 172.21.15.43:0/2832908990 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f7bf00678c0 0x7f7bf0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.639+0000 7f7c02ffd640 1 -- 172.21.15.43:0/2832908990 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7c04121180 con 0x7f7c0c145990 2024-04-24T23:00:41.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.639+0000 7f7c1252f640 1 --2- 172.21.15.43:0/2832908990 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f7bf00678c0 0x7f7bf0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.639+0000 7f7c1252f640 1 --2- 172.21.15.43:0/2832908990 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f7bf00678c0 0x7f7bf0069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7c080096d0 tx=0x7f7c08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:41.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.643+0000 7f7c02ffd640 1 -- 172.21.15.43:0/2832908990 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f7c04016560 con 0x7f7c0c145990 2024-04-24T23:00:41.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.839+0000 7f7c14793640 1 -- 172.21.15.43:0/2832908990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c0c0af540 con 0x7f7c0c145990 2024-04-24T23:00:41.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.843+0000 7f7c02ffd640 1 -- 172.21.15.43:0/2832908990 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3529 (secure 0 0 0) 0x7f7c040f1a10 con 0x7f7c0c145990 2024-04-24T23:00:41.848 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:41.848 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/2236776475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2236776475},{"type":"v1","addr":"172.21.15.162:6833","nonce":2236776475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:00:15.762941+0000","modified":"2024-04-24T23:00:32.909117+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6835/152091432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":152091432},{"type":"v1","addr":"172.21.15.43:6835","nonce":152091432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-04-24T23:00:41.848 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-04-24T23:00:41.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.843+0000 7f7c14793640 1 -- 172.21.15.43:0/2832908990 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f7bf00678c0 msgr2=0x7f7bf0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.843+0000 7f7c14793640 1 --2- 172.21.15.43:0/2832908990 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f7bf00678c0 0x7f7bf0069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7c080096d0 tx=0x7f7c08008040 comp rx=0 tx=0).stop 2024-04-24T23:00:41.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.843+0000 7f7c14793640 1 -- 172.21.15.43:0/2832908990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c0c145990 msgr2=0x7f7c0c1e3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.843+0000 7f7c14793640 1 --2- 172.21.15.43:0/2832908990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c0c145990 0x7f7c0c1e3b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009d90 tx=0x7f7c04019710 comp rx=0 tx=0).stop 2024-04-24T23:00:41.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.843+0000 7f7c14793640 1 -- 172.21.15.43:0/2832908990 shutdown_connections 2024-04-24T23:00:41.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.843+0000 7f7c14793640 1 --2- 172.21.15.43:0/2832908990 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f7bf00678c0 0x7f7bf0069d80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.843+0000 7f7c14793640 1 --2- 172.21.15.43:0/2832908990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c0c145990 0x7f7c0c1e3b00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.843+0000 7f7c14793640 1 --2- 172.21.15.43:0/2832908990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c0c13f900 0x7f7c0c1e35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.843+0000 7f7c14793640 1 --2- 172.21.15.43:0/2832908990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c0c0b2500 0x7f7c0c13e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.843+0000 7f7c14793640 1 -- 172.21.15.43:0/2832908990 >> 172.21.15.43:0/2832908990 conn(0x7f7c0c0b5690 msgr2=0x7f7c0c0b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:41.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.843+0000 7f7c14793640 1 -- 172.21.15.43:0/2832908990 shutdown_connections 2024-04-24T23:00:41.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.843+0000 7f7c14793640 1 -- 172.21.15.43:0/2832908990 wait complete. 2024-04-24T23:00:41.867 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:00:41.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.987+0000 7f76def12640 1 Processor -- start 2024-04-24T23:00:41.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.987+0000 7f76def12640 1 -- start start 2024-04-24T23:00:41.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76def12640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f76d80bd860 0x7f76d8141370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76def12640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f76d814b520 0x7f76d8151f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:41.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76def12640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d80bdc40 con 0x7f76d81418b0 2024-04-24T23:00:41.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76def12640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f76d8141d40 con 0x7f76d814b520 2024-04-24T23:00:41.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76def12640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f76d80b6c80 con 0x7f76d80bd860 2024-04-24T23:00:41.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76d7fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f76d81418b0 0x7f76d814ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:51126/0 (socket says 172.21.15.43:51126) 2024-04-24T23:00:41.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76dd4af640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f76d814b520 0x7f76d8151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76d7fff640 1 -- 172.21.15.43:0/2849103951 learned_addr learned my addr 172.21.15.43:0/2849103951 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:41.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76dccae640 1 --2- 172.21.15.43:0/2849103951 >> v2:172.21.15.162:3300/0 conn(0x7f76d80bd860 0x7f76d8141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:41.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76dd4af640 1 -- 172.21.15.43:0/2849103951 >> v2:172.21.15.162:3300/0 conn(0x7f76d80bd860 msgr2=0x7f76d8141370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:41.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76dd4af640 1 --2- 172.21.15.43:0/2849103951 >> v2:172.21.15.162:3300/0 conn(0x7f76d80bd860 0x7f76d8141370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:41.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76dd4af640 1 -- 172.21.15.43:0/2849103951 >> v1:172.21.15.43:6789/0 conn(0x7f76d81418b0 legacy=0x7f76d814ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:41.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76dd4af640 1 -- 172.21.15.43:0/2849103951 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d80b5770 con 0x7f76d814b520 2024-04-24T23:00:41.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76d77fe640 1 -- 172.21.15.43:0/2849103951 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446022564 0 0) 0x7f76d80bdc40 con 0x7f76d81418b0 2024-04-24T23:00:41.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76dd4af640 1 --2- 172.21.15.43:0/2849103951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d814b520 0x7f76d8151f60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f76d80ba980 tx=0x7f76d001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59dece9afe4af11 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:41.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76d77fe640 1 -- 172.21.15.43:0/2849103951 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d00b1070 con 0x7f76d814b520 2024-04-24T23:00:41.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76d77fe640 1 -- 172.21.15.43:0/2849103951 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d00ac620 con 0x7f76d814b520 2024-04-24T23:00:41.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.991+0000 7f76d77fe640 1 -- 172.21.15.43:0/2849103951 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d00ac9f0 con 0x7f76d814b520 2024-04-24T23:00:41.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 -- 172.21.15.43:0/2849103951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d814b520 msgr2=0x7f76d8151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 --2- 172.21.15.43:0/2849103951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d814b520 0x7f76d8151f60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f76d80ba980 tx=0x7f76d001c3c0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 -- 172.21.15.43:0/2849103951 shutdown_connections 2024-04-24T23:00:42.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 --2- 172.21.15.43:0/2849103951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d814b520 0x7f76d8151f60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 --2- 172.21.15.43:0/2849103951 >> v2:172.21.15.162:3300/0 conn(0x7f76d80bd860 0x7f76d8141370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 -- 172.21.15.43:0/2849103951 >> 172.21.15.43:0/2849103951 conn(0x7f76d8072f20 msgr2=0x7f76d80bcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:42.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 -- 172.21.15.43:0/2849103951 shutdown_connections 2024-04-24T23:00:42.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 -- 172.21.15.43:0/2849103951 wait complete. 2024-04-24T23:00:42.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 Processor -- start 2024-04-24T23:00:42.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 -- start start 2024-04-24T23:00:42.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d80bd860 0x7f76d813efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76d81418b0 0x7f76d8142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76d814b520 0x7f76d81e2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f76d80b4500 con 0x7f76d80bd860 2024-04-24T23:00:42.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76d80b9590 con 0x7f76d81418b0 2024-04-24T23:00:42.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f76d80b4680 con 0x7f76d814b520 2024-04-24T23:00:42.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76dccae640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d80bd860 0x7f76d813efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76dccae640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d80bd860 0x7f76d813efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34712/0 (socket says 172.21.15.43:34712) 2024-04-24T23:00:42.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76dccae640 1 -- 172.21.15.43:0/1755899851 learned_addr learned my addr 172.21.15.43:0/1755899851 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:42.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76dccae640 1 -- 172.21.15.43:0/1755899851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76d814b520 msgr2=0x7f76d81e2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76dccae640 1 --2- 172.21.15.43:0/1755899851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76d814b520 0x7f76d81e2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76dccae640 1 -- 172.21.15.43:0/1755899851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76d81418b0 msgr2=0x7f76d8142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76dccae640 1 --2- 172.21.15.43:0/1755899851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76d81418b0 0x7f76d8142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76dccae640 1 -- 172.21.15.43:0/1755899851 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d81428d0 con 0x7f76d80bd860 2024-04-24T23:00:42.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76dccae640 1 --2- 172.21.15.43:0/1755899851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d80bd860 0x7f76d813efa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009dd0 tx=0x7f76c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:42.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76d57fa640 1 -- 172.21.15.43:0/1755899851 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8018020 con 0x7f76d80bd860 2024-04-24T23:00:42.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76d57fa640 1 -- 172.21.15.43:0/1755899851 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c8014480 con 0x7f76d80bd860 2024-04-24T23:00:42.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76d57fa640 1 -- 172.21.15.43:0/1755899851 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8014870 con 0x7f76d80bd860 2024-04-24T23:00:42.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 -- 172.21.15.43:0/1755899851 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d8142b80 con 0x7f76d80bd860 2024-04-24T23:00:42.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 -- 172.21.15.43:0/1755899851 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d813fc90 con 0x7f76d80bd860 2024-04-24T23:00:42.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.995+0000 7f76def12640 1 -- 172.21.15.43:0/1755899851 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d804f580 con 0x7f76d80bd860 2024-04-24T23:00:42.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.999+0000 7f76d57fa640 1 -- 172.21.15.43:0/1755899851 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f76c801b020 con 0x7f76d80bd860 2024-04-24T23:00:42.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.999+0000 7f76d57fa640 1 --2- 172.21.15.43:0/1755899851 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f76b80678c0 0x7f76b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.999+0000 7f76d57fa640 1 -- 172.21.15.43:0/1755899851 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f76c8086aa0 con 0x7f76d80bd860 2024-04-24T23:00:42.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.999+0000 7f76d7fff640 1 --2- 172.21.15.43:0/1755899851 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f76b80678c0 0x7f76b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:41.999+0000 7f76d7fff640 1 --2- 172.21.15.43:0/1755899851 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f76b80678c0 0x7f76b8069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f76c0000c10 tx=0x7f76c0007910 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:42.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.003+0000 7f76d57fa640 1 -- 172.21.15.43:0/1755899851 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f76c8022070 con 0x7f76d80bd860 2024-04-24T23:00:42.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.167+0000 7f76def12640 1 -- 172.21.15.43:0/1755899851 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76d8062490 con 0x7f76d80bd860 2024-04-24T23:00:42.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.167+0000 7f76d57fa640 1 -- 172.21.15.43:0/1755899851 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18518 (secure 0 0 0) 0x7f76c8010040 con 0x7f76d80bd860 2024-04-24T23:00:42.174 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:42.174 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:20.863941+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:00:42.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.171+0000 7f76def12640 1 -- 172.21.15.43:0/1755899851 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f76b80678c0 msgr2=0x7f76b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.171+0000 7f76def12640 1 --2- 172.21.15.43:0/1755899851 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f76b80678c0 0x7f76b8069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f76c0000c10 tx=0x7f76c0007910 comp rx=0 tx=0).stop 2024-04-24T23:00:42.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.171+0000 7f76def12640 1 -- 172.21.15.43:0/1755899851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d80bd860 msgr2=0x7f76d813efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.171+0000 7f76def12640 1 --2- 172.21.15.43:0/1755899851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d80bd860 0x7f76d813efa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009dd0 tx=0x7f76c800c490 comp rx=0 tx=0).stop 2024-04-24T23:00:42.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.171+0000 7f76def12640 1 -- 172.21.15.43:0/1755899851 shutdown_connections 2024-04-24T23:00:42.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.171+0000 7f76def12640 1 --2- 172.21.15.43:0/1755899851 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f76b80678c0 0x7f76b8069d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.171+0000 7f76def12640 1 --2- 172.21.15.43:0/1755899851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76d814b520 0x7f76d81e2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.171+0000 7f76def12640 1 --2- 172.21.15.43:0/1755899851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76d81418b0 0x7f76d8142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.171+0000 7f76def12640 1 --2- 172.21.15.43:0/1755899851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d80bd860 0x7f76d813efa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.171+0000 7f76def12640 1 -- 172.21.15.43:0/1755899851 >> 172.21.15.43:0/1755899851 conn(0x7f76d8072f20 msgr2=0x7f76d8074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:42.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.171+0000 7f76def12640 1 -- 172.21.15.43:0/1755899851 shutdown_connections 2024-04-24T23:00:42.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.171+0000 7f76def12640 1 -- 172.21.15.43:0/1755899851 wait complete. 2024-04-24T23:00:42.194 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:00:42.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.307+0000 7fdf297b5640 1 Processor -- start 2024-04-24T23:00:42.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.307+0000 7fdf297b5640 1 -- start start 2024-04-24T23:00:42.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf297b5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2414aef0 0x7fdf240b3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf297b5640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdf240b3eb0 0x7fdf240b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf297b5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdf240b1f80 0x7fdf240adf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf297b5640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fdf240b01c0 con 0x7fdf240b3eb0 2024-04-24T23:00:42.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf297b5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdf240b4330 con 0x7fdf240b1f80 2024-04-24T23:00:42.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf297b5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdf240adaf0 con 0x7fdf2414aef0 2024-04-24T23:00:42.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf227fc640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdf240b3eb0 0x7fdf240b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf227fc640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdf240b3eb0 0x7fdf240b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34724/0 (socket says 172.21.15.43:34724) 2024-04-24T23:00:42.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf227fc640 1 -- 172.21.15.43:0/2640288866 learned_addr learned my addr 172.21.15.43:0/2640288866 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:42.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf22ffd640 1 --2- 172.21.15.43:0/2640288866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2414aef0 0x7fdf240b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf237fe640 1 --2- 172.21.15.43:0/2640288866 >> v2:172.21.15.162:3300/0 conn(0x7fdf240b1f80 0x7fdf240adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf227fc640 1 -- 172.21.15.43:0/2640288866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2414aef0 msgr2=0x7fdf240b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:42.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf227fc640 1 --2- 172.21.15.43:0/2640288866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2414aef0 0x7fdf240b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf227fc640 1 -- 172.21.15.43:0/2640288866 >> v2:172.21.15.162:3300/0 conn(0x7fdf240b1f80 msgr2=0x7fdf240adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:42.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf227fc640 1 --2- 172.21.15.43:0/2640288866 >> v2:172.21.15.162:3300/0 conn(0x7fdf240b1f80 0x7fdf240adf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf227fc640 1 -- 172.21.15.43:0/2640288866 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2414b690 con 0x7fdf240b3eb0 2024-04-24T23:00:42.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.311+0000 7fdf22ffd640 1 --2- 172.21.15.43:0/2640288866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2414aef0 0x7fdf240b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:00:42.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf227fc640 1 --2- 172.21.15.43:0/2640288866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf240b3eb0 0x7fdf240b1a40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdf240b6a40 tx=0x7fdf0c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb8c431f9d10ad0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:42.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf21ffb640 1 -- 172.21.15.43:0/2640288866 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0b0070 con 0x7fdf240b3eb0 2024-04-24T23:00:42.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf21ffb640 1 -- 172.21.15.43:0/2640288866 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf0c0a4e50 con 0x7fdf240b3eb0 2024-04-24T23:00:42.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf21ffb640 1 -- 172.21.15.43:0/2640288866 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0ab820 con 0x7fdf240b3eb0 2024-04-24T23:00:42.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 -- 172.21.15.43:0/2640288866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf240b3eb0 msgr2=0x7fdf240b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 --2- 172.21.15.43:0/2640288866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf240b3eb0 0x7fdf240b1a40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdf240b6a40 tx=0x7fdf0c01c400 comp rx=0 tx=0).stop 2024-04-24T23:00:42.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 -- 172.21.15.43:0/2640288866 shutdown_connections 2024-04-24T23:00:42.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 --2- 172.21.15.43:0/2640288866 >> v2:172.21.15.162:3300/0 conn(0x7fdf240b1f80 0x7fdf240adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 --2- 172.21.15.43:0/2640288866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf240b3eb0 0x7fdf240b1a40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 --2- 172.21.15.43:0/2640288866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2414aef0 0x7fdf240b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 -- 172.21.15.43:0/2640288866 >> 172.21.15.43:0/2640288866 conn(0x7fdf240b5690 msgr2=0x7fdf240b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:42.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 -- 172.21.15.43:0/2640288866 shutdown_connections 2024-04-24T23:00:42.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 -- 172.21.15.43:0/2640288866 wait complete. 2024-04-24T23:00:42.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 Processor -- start 2024-04-24T23:00:42.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 -- start start 2024-04-24T23:00:42.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf240b1f80 0x7fdf241e32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf240b3eb0 0x7fdf24140850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2414aef0 0x7fdf24140d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdf240b6330 con 0x7fdf240b3eb0 2024-04-24T23:00:42.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdf240b61b0 con 0x7fdf240b1f80 2024-04-24T23:00:42.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf297b5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdf240aec90 con 0x7fdf2414aef0 2024-04-24T23:00:42.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf227fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf240b3eb0 0x7fdf24140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf227fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf240b3eb0 0x7fdf24140850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34738/0 (socket says 172.21.15.43:34738) 2024-04-24T23:00:42.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf227fc640 1 -- 172.21.15.43:0/2399642224 learned_addr learned my addr 172.21.15.43:0/2399642224 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf22ffd640 1 --2- 172.21.15.43:0/2399642224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf240b1f80 0x7fdf241e32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf237fe640 1 --2- 172.21.15.43:0/2399642224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2414aef0 0x7fdf24140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf227fc640 1 -- 172.21.15.43:0/2399642224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2414aef0 msgr2=0x7fdf24140d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf227fc640 1 --2- 172.21.15.43:0/2399642224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2414aef0 0x7fdf24140d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf227fc640 1 -- 172.21.15.43:0/2399642224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf240b1f80 msgr2=0x7fdf241e32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf227fc640 1 --2- 172.21.15.43:0/2399642224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf240b1f80 0x7fdf241e32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.315+0000 7fdf227fc640 1 -- 172.21.15.43:0/2399642224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2414c4c0 con 0x7fdf240b3eb0 2024-04-24T23:00:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.319+0000 7fdf227fc640 1 --2- 172.21.15.43:0/2399642224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf240b3eb0 0x7fdf24140850 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0ae040 tx=0x7fdf0c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.319+0000 7fdf1b7fe640 1 -- 172.21.15.43:0/2399642224 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0b0040 con 0x7fdf240b3eb0 2024-04-24T23:00:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.319+0000 7fdf1b7fe640 1 -- 172.21.15.43:0/2399642224 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf0c0abdb0 con 0x7fdf240b3eb0 2024-04-24T23:00:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.319+0000 7fdf297b5640 1 -- 172.21.15.43:0/2399642224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2414d3c0 con 0x7fdf240b3eb0 2024-04-24T23:00:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.319+0000 7fdf1b7fe640 1 -- 172.21.15.43:0/2399642224 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0b4610 con 0x7fdf240b3eb0 2024-04-24T23:00:42.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.319+0000 7fdf297b5640 1 -- 172.21.15.43:0/2399642224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf241e3810 con 0x7fdf240b3eb0 2024-04-24T23:00:42.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.319+0000 7fdf297b5640 1 -- 172.21.15.43:0/2399642224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf241452d0 con 0x7fdf240b3eb0 2024-04-24T23:00:42.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.319+0000 7fdf1b7fe640 1 -- 172.21.15.43:0/2399642224 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdf0c0b47b0 con 0x7fdf240b3eb0 2024-04-24T23:00:42.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.319+0000 7fdf1b7fe640 1 --2- 172.21.15.43:0/2399642224 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fdf040678c0 0x7fdf04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.319+0000 7fdf1b7fe640 1 -- 172.21.15.43:0/2399642224 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdf0c11fa00 con 0x7fdf240b3eb0 2024-04-24T23:00:42.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.319+0000 7fdf22ffd640 1 --2- 172.21.15.43:0/2399642224 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fdf040678c0 0x7fdf04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.319+0000 7fdf22ffd640 1 --2- 172.21.15.43:0/2399642224 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fdf040678c0 0x7fdf04069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdf24071350 tx=0x7fdf1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:42.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.323+0000 7fdf1b7fe640 1 -- 172.21.15.43:0/2399642224 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fdf2414c4c0 con 0x7fdf240b3eb0 2024-04-24T23:00:42.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.519+0000 7fdf297b5640 1 -- 172.21.15.43:0/2399642224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf2404f580 con 0x7fdf240b3eb0 2024-04-24T23:00:42.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.519+0000 7fdf1b7fe640 1 -- 172.21.15.43:0/2399642224 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3529 (secure 0 0 0) 0x7fdf0c016110 con 0x7fdf240b3eb0 2024-04-24T23:00:42.525 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:00:42.525 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/2236776475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2236776475},{"type":"v1","addr":"172.21.15.162:6833","nonce":2236776475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:00:15.762941+0000","modified":"2024-04-24T23:00:32.909117+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6835/152091432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":152091432},{"type":"v1","addr":"172.21.15.43:6835","nonce":152091432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-04-24T23:00:42.526 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-04-24T23:00:42.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.523+0000 7fdf297b5640 1 -- 172.21.15.43:0/2399642224 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fdf040678c0 msgr2=0x7fdf04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.523+0000 7fdf297b5640 1 --2- 172.21.15.43:0/2399642224 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fdf040678c0 0x7fdf04069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdf24071350 tx=0x7fdf1c008040 comp rx=0 tx=0).stop 2024-04-24T23:00:42.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.523+0000 7fdf297b5640 1 -- 172.21.15.43:0/2399642224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf240b3eb0 msgr2=0x7fdf24140850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.523+0000 7fdf297b5640 1 --2- 172.21.15.43:0/2399642224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf240b3eb0 0x7fdf24140850 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0ae040 tx=0x7fdf0c0191a0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.523+0000 7fdf297b5640 1 -- 172.21.15.43:0/2399642224 shutdown_connections 2024-04-24T23:00:42.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.523+0000 7fdf297b5640 1 --2- 172.21.15.43:0/2399642224 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fdf040678c0 0x7fdf04069d80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.523+0000 7fdf297b5640 1 --2- 172.21.15.43:0/2399642224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2414aef0 0x7fdf24140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.523+0000 7fdf297b5640 1 --2- 172.21.15.43:0/2399642224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf240b3eb0 0x7fdf24140850 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.523+0000 7fdf297b5640 1 --2- 172.21.15.43:0/2399642224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf240b1f80 0x7fdf241e32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.523+0000 7fdf297b5640 1 -- 172.21.15.43:0/2399642224 >> 172.21.15.43:0/2399642224 conn(0x7fdf240b5690 msgr2=0x7fdf24074170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:42.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.523+0000 7fdf297b5640 1 -- 172.21.15.43:0/2399642224 shutdown_connections 2024-04-24T23:00:42.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.523+0000 7fdf297b5640 1 -- 172.21.15.43:0/2399642224 wait complete. 2024-04-24T23:00:42.744 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-24T23:00:15.762941+0000', 'modified': '2024-04-24T23:00:32.909117+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4248}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4248': {'gid': 4248, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6835/152091432', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 152091432}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 152091432}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4248, 'qdb_cluster': [4248]} 2024-04-24T23:00:42.744 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-24T23:00:42.745 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-24T23:00:42.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.867+0000 7ffbcb2a4640 1 Processor -- start 2024-04-24T23:00:42.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.867+0000 7ffbcb2a4640 1 -- start start 2024-04-24T23:00:42.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.867+0000 7ffbcb2a4640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ffbc413f1f0 0x7ffbc413f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.867+0000 7ffbcb2a4640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc4070060 con 0x7ffbc40b2500 2024-04-24T23:00:42.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.867+0000 7ffbcb2a4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc413fbc0 con 0x7ffbc414dce0 2024-04-24T23:00:42.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.867+0000 7ffbcb2a4640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc40b28e0 con 0x7ffbc413f1f0 2024-04-24T23:00:42.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.867+0000 7ffbc883f640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ffbc413f1f0 0x7ffbc413f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.867+0000 7ffbc883f640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ffbc413f1f0 0x7ffbc413f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34740/0 (socket says 172.21.15.43:34740) 2024-04-24T23:00:42.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.867+0000 7ffbc883f640 1 -- 172.21.15.43:0/114611509 learned_addr learned my addr 172.21.15.43:0/114611509 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:42.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.867+0000 7ffbc9040640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ffbc40b2500 0x7ffbc4145450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:51132/0 (socket says 172.21.15.43:51132) 2024-04-24T23:00:42.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.867+0000 7ffbc883f640 1 -- 172.21.15.43:0/114611509 >> v1:172.21.15.162:6789/0 conn(0x7ffbc414dce0 legacy=0x7ffbc41500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:42.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.867+0000 7ffbc883f640 1 -- 172.21.15.43:0/114611509 >> v1:172.21.15.43:6789/0 conn(0x7ffbc40b2500 legacy=0x7ffbc4145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.867+0000 7ffbc883f640 1 -- 172.21.15.43:0/114611509 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc40af8f0 con 0x7ffbc413f1f0 2024-04-24T23:00:42.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc883f640 1 --2- 172.21.15.43:0/114611509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbc413f1f0 0x7ffbc413f680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009e50 tx=0x7ffbb401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227200d64b62667d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:42.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc3fff640 1 -- 172.21.15.43:0/114611509 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40a5710 con 0x7ffbc413f1f0 2024-04-24T23:00:42.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc3fff640 1 -- 172.21.15.43:0/114611509 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb40a58b0 con 0x7ffbc413f1f0 2024-04-24T23:00:42.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc3fff640 1 -- 172.21.15.43:0/114611509 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40a5c80 con 0x7ffbc413f1f0 2024-04-24T23:00:42.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbcb2a4640 1 -- 172.21.15.43:0/114611509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbc413f1f0 msgr2=0x7ffbc413f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbcb2a4640 1 --2- 172.21.15.43:0/114611509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbc413f1f0 0x7ffbc413f680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009e50 tx=0x7ffbb401c9f0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbcb2a4640 1 -- 172.21.15.43:0/114611509 shutdown_connections 2024-04-24T23:00:42.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbcb2a4640 1 --2- 172.21.15.43:0/114611509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbc413f1f0 0x7ffbc413f680 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbcb2a4640 1 -- 172.21.15.43:0/114611509 >> 172.21.15.43:0/114611509 conn(0x7ffbc40b5690 msgr2=0x7ffbc40b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:42.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbcb2a4640 1 -- 172.21.15.43:0/114611509 shutdown_connections 2024-04-24T23:00:42.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbcb2a4640 1 -- 172.21.15.43:0/114611509 wait complete. 2024-04-24T23:00:42.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbcb2a4640 1 Processor -- start 2024-04-24T23:00:42.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbcb2a4640 1 -- start start 2024-04-24T23:00:42.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbcb2a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbc40b2500 0x7ffbc4141b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbcb2a4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc413f1f0 0x7ffbc414fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbcb2a4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbc414dce0 0x7ffbc41e1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbcb2a4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc40b5410 con 0x7ffbc40b2500 2024-04-24T23:00:42.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbcb2a4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc40b5290 con 0x7ffbc413f1f0 2024-04-24T23:00:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbcb2a4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc40b4af0 con 0x7ffbc414dce0 2024-04-24T23:00:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc9040640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbc40b2500 0x7ffbc4141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc9040640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbc40b2500 0x7ffbc4141b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34746/0 (socket says 172.21.15.43:34746) 2024-04-24T23:00:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc9040640 1 -- 172.21.15.43:0/1827775126 learned_addr learned my addr 172.21.15.43:0/1827775126 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc883f640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc413f1f0 0x7ffbc414fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc9040640 1 -- 172.21.15.43:0/1827775126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbc414dce0 msgr2=0x7ffbc41e1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc9841640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbc414dce0 0x7ffbc41e1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc9040640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbc414dce0 0x7ffbc41e1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc9040640 1 -- 172.21.15.43:0/1827775126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc413f1f0 msgr2=0x7ffbc414fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc9040640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc413f1f0 0x7ffbc414fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc9040640 1 -- 172.21.15.43:0/1827775126 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc40a94d0 con 0x7ffbc40b2500 2024-04-24T23:00:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc883f640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc413f1f0 0x7ffbc414fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc9841640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbc414dce0 0x7ffbc41e1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.871+0000 7ffbc9040640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbc40b2500 0x7ffbc4141b20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800c420 tx=0x7ffbb800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:42.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbc1ffb640 1 -- 172.21.15.43:0/1827775126 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80074e0 con 0x7ffbc40b2500 2024-04-24T23:00:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbc1ffb640 1 -- 172.21.15.43:0/1827775126 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb8007680 con 0x7ffbc40b2500 2024-04-24T23:00:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbcb2a4640 1 -- 172.21.15.43:0/1827775126 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc4142770 con 0x7ffbc40b2500 2024-04-24T23:00:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbc1ffb640 1 -- 172.21.15.43:0/1827775126 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8004a30 con 0x7ffbc40b2500 2024-04-24T23:00:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbcb2a4640 1 -- 172.21.15.43:0/1827775126 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc40aa670 con 0x7ffbc40b2500 2024-04-24T23:00:42.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbc1ffb640 1 -- 172.21.15.43:0/1827775126 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffbb801a020 con 0x7ffbc40b2500 2024-04-24T23:00:42.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbc1ffb640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ffbb00678c0 0x7ffbb0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbc1ffb640 1 -- 172.21.15.43:0/1827775126 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ffbb8085780 con 0x7ffbc40b2500 2024-04-24T23:00:42.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbc883f640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ffbb00678c0 0x7ffbb0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbc883f640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ffbb00678c0 0x7ffbb0069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40ae000 tx=0x7ffbb40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:42.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbce41d000 1 Processor -- start 2024-04-24T23:00:42.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbce41d000 1 -- start start 2024-04-24T23:00:42.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbce41d000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d61d90 0x5653b6d35c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbce41d000 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d36140 0x5653b6d60310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbce41d000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d60850 0x5653b6d60c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbce41d000 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5653b6b7e5e0 con 0x5653b6d36140 2024-04-24T23:00:42.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbce41d000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5653b6b05c50 con 0x5653b6d61d90 2024-04-24T23:00:42.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbce41d000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5653b6b7a5a0 con 0x5653b6d60850 2024-04-24T23:00:42.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.875+0000 7ffbc883f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d36140 0x5653b6d60310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d36140 0x5653b6d60310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34754/0 (socket says 172.21.15.43:34754) 2024-04-24T23:00:42.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 -- 172.21.15.43:0/2132043990 learned_addr learned my addr 172.21.15.43:0/2132043990 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:42.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc9841640 1 --2- 172.21.15.43:0/2132043990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d60850 0x5653b6d60c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc9040640 1 --2- 172.21.15.43:0/2132043990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d61d90 0x5653b6d35c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 -- 172.21.15.43:0/2132043990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d60850 msgr2=0x5653b6d60c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:42.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 --2- 172.21.15.43:0/2132043990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d60850 0x5653b6d60c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 -- 172.21.15.43:0/2132043990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d61d90 msgr2=0x5653b6d35c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:42.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 --2- 172.21.15.43:0/2132043990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d61d90 0x5653b6d35c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 -- 172.21.15.43:0/2132043990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653b6b03d10 con 0x5653b6d36140 2024-04-24T23:00:42.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 --2- 172.21.15.43:0/2132043990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d36140 0x5653b6d60310 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4019600 tx=0x7ffbb4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5c865c7f818337 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:42.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbaaffd640 1 -- 172.21.15.43:0/2132043990 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40c9070 con 0x5653b6d36140 2024-04-24T23:00:42.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbaaffd640 1 -- 172.21.15.43:0/2132043990 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb40a5e10 con 0x5653b6d36140 2024-04-24T23:00:42.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbaaffd640 1 -- 172.21.15.43:0/2132043990 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40c4670 con 0x5653b6d36140 2024-04-24T23:00:42.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 -- 172.21.15.43:0/2132043990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d36140 msgr2=0x5653b6d60310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 --2- 172.21.15.43:0/2132043990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d36140 0x5653b6d60310 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4019600 tx=0x7ffbb4004ac0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 -- 172.21.15.43:0/2132043990 shutdown_connections 2024-04-24T23:00:42.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 --2- 172.21.15.43:0/2132043990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d60850 0x5653b6d60c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 --2- 172.21.15.43:0/2132043990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d36140 0x5653b6d60310 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 --2- 172.21.15.43:0/2132043990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d61d90 0x5653b6d35c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 -- 172.21.15.43:0/2132043990 >> 172.21.15.43:0/2132043990 conn(0x5653b6d5c0c0 msgr2=0x5653b6d5e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 -- 172.21.15.43:0/2132043990 shutdown_connections 2024-04-24T23:00:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 -- 172.21.15.43:0/2132043990 wait complete. 2024-04-24T23:00:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 -- start start 2024-04-24T23:00:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 Processor -- start 2024-04-24T23:00:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d36140 0x5653b6d34d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d60850 0x5653b6d31cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d61d90 0x5653b6d32230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5653b6b82c10 con 0x5653b6d60850 2024-04-24T23:00:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5653b6b38520 con 0x5653b6d61d90 2024-04-24T23:00:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5653b6b4b340 con 0x5653b6d36140 2024-04-24T23:00:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 10 client.0 _ll_register_callbacks cb 0x5653b6d1b5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:00:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d60850 0x5653b6d31cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d60850 0x5653b6d31cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34764/0 (socket says 172.21.15.43:34764) 2024-04-24T23:00:42.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 -- 172.21.15.43:0/2436915521 learned_addr learned my addr 172.21.15.43:0/2436915521 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:42.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc9841640 1 --2- 172.21.15.43:0/2436915521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d61d90 0x5653b6d32230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc9040640 1 --2- 172.21.15.43:0/2436915521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d36140 0x5653b6d34d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 -- 172.21.15.43:0/2436915521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d36140 msgr2=0x5653b6d34d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:42.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 --2- 172.21.15.43:0/2436915521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d36140 0x5653b6d34d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 -- 172.21.15.43:0/2436915521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d61d90 msgr2=0x5653b6d32230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:42.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 --2- 172.21.15.43:0/2436915521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d61d90 0x5653b6d32230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 -- 172.21.15.43:0/2436915521 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653b6b167b0 con 0x5653b6d60850 2024-04-24T23:00:42.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbc883f640 1 --2- 172.21.15.43:0/2436915521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d60850 0x5653b6d31cf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4019600 tx=0x7ffbb401b230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d014e27855f08643 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:42.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffba3fff640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-24T23:00:42.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffba3fff640 1 -- 172.21.15.43:0/2436915521 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40c9030 con 0x5653b6d60850 2024-04-24T23:00:42.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffba3fff640 1 -- 172.21.15.43:0/2436915521 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ffbb40c0040 con 0x5653b6d60850 2024-04-24T23:00:42.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 -- 172.21.15.43:0/2436915521 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbb40a5e10 con 0x5653b6d60850 2024-04-24T23:00:42.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffba3fff640 1 -- 172.21.15.43:0/2436915521 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ffbb4004040 con 0x5653b6d60850 2024-04-24T23:00:42.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 10 client.4794 fetch_fsmap learned FSMap version 9 2024-04-24T23:00:42.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffbce41d000 1 -- 172.21.15.43:0/2436915521 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5653b6b05ea0 con 0x5653b6d60850 2024-04-24T23:00:42.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.879+0000 7ffba3fff640 1 -- 172.21.15.43:0/2436915521 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb40a5e10 con 0x5653b6d60850 2024-04-24T23:00:42.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffba3fff640 1 -- 172.21.15.43:0/2436915521 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 9) ==== 2292+0+0 (secure 0 0 0) 0x7ffbb4008040 con 0x5653b6d60850 2024-04-24T23:00:42.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 10 client.4794 fetch_fsmap finished waiting for FSMap version 9 2024-04-24T23:00:42.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 10 client.4794 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T23:00:42.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 20 client.4794 populate_metadata read hostname 'smithi043' 2024-04-24T23:00:42.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 1 --2- 172.21.15.43:0/2436915521 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x5653b6d35b80 0x5653b6d77560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 4 client.4794 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-24T23:00:42.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 1 -- 172.21.15.43:0/2436915521 --> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653b6b19ab0 con 0x5653b6d35b80 2024-04-24T23:00:42.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbc9040640 1 --2- 172.21.15.43:0/2436915521 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x5653b6d35b80 0x5653b6d77560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbc9040640 1 --2- 172.21.15.43:0/2436915521 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x5653b6d35b80 0x5653b6d77560 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92490468265edfa8 server_cookie=9b1bc2f98ace7344 in_seq=0 out_seq=0 2024-04-24T23:00:42.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffba3fff640 10 client.4794 ms_handle_connect on v2:172.21.15.43:6834/152091432 2024-04-24T23:00:42.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffba3fff640 1 -- 172.21.15.43:0/2436915521 <== mds.0 v2:172.21.15.43:6834/152091432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5653b6b19ab0 con 0x5653b6d35b80 2024-04-24T23:00:42.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffba3fff640 10 client.4794 handle_command_reply: tid=0 2024-04-24T23:00:42.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 1 client.4794 shutdown 2024-04-24T23:00:42.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 1 -- 172.21.15.43:0/2436915521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d60850 msgr2=0x5653b6d31cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 1 --2- 172.21.15.43:0/2436915521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d60850 0x5653b6d31cf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4019600 tx=0x7ffbb401b230 comp rx=0 tx=0).stop 2024-04-24T23:00:42.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 1 -- 172.21.15.43:0/2436915521 shutdown_connections 2024-04-24T23:00:42.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 1 --2- 172.21.15.43:0/2436915521 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x5653b6d35b80 0x5653b6d77560 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 1 --2- 172.21.15.43:0/2436915521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d61d90 0x5653b6d32230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 1 --2- 172.21.15.43:0/2436915521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d60850 0x5653b6d31cf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 1 --2- 172.21.15.43:0/2436915521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d36140 0x5653b6d34d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffba3fff640 0 client.4794 ms_handle_reset on v2:172.21.15.43:6834/152091432 2024-04-24T23:00:42.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 1 -- 172.21.15.43:0/2436915521 >> 172.21.15.43:0/2436915521 conn(0x5653b6d5c0c0 msgr2=0x5653b6d5e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:42.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 1 -- 172.21.15.43:0/2436915521 shutdown_connections 2024-04-24T23:00:42.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 1 -- 172.21.15.43:0/2436915521 wait complete. 2024-04-24T23:00:42.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.883+0000 7ffbce41d000 20 client.4794 trim_cache size 0 max 16384 2024-04-24T23:00:42.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.899+0000 7ffbce41d000 1 Processor -- start 2024-04-24T23:00:42.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.899+0000 7ffbce41d000 1 -- start start 2024-04-24T23:00:42.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.899+0000 7ffbce41d000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d36140 0x5653b6d60030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.899+0000 7ffbce41d000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d60850 0x5653b6d5b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.899+0000 7ffbce41d000 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d61d90 0x5653b6d7a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.899+0000 7ffbce41d000 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41ec060 con 0x5653b6d61d90 2024-04-24T23:00:42.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.899+0000 7ffbce41d000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41eb1c0 con 0x5653b6d60850 2024-04-24T23:00:42.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.899+0000 7ffbce41d000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5653b6b7d8f0 con 0x5653b6d36140 2024-04-24T23:00:42.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.899+0000 7ffbc9841640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d61d90 0x5653b6d7a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9841640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d61d90 0x5653b6d7a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34778/0 (socket says 172.21.15.43:34778) 2024-04-24T23:00:42.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9841640 1 -- 172.21.15.43:0/2400983376 learned_addr learned my addr 172.21.15.43:0/2400983376 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:42.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9841640 1 -- 172.21.15.43:0/2400983376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d36140 msgr2=0x5653b6d60030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:42.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9040640 1 --2- 172.21.15.43:0/2400983376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d36140 0x5653b6d60030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc883f640 1 --2- 172.21.15.43:0/2400983376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d60850 0x5653b6d5b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9841640 1 --2- 172.21.15.43:0/2400983376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d36140 0x5653b6d60030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9841640 1 -- 172.21.15.43:0/2400983376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d60850 msgr2=0x5653b6d5b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:42.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9841640 1 --2- 172.21.15.43:0/2400983376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d60850 0x5653b6d5b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9841640 1 -- 172.21.15.43:0/2400983376 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653b6d2e9b0 con 0x5653b6d61d90 2024-04-24T23:00:42.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9841640 1 --2- 172.21.15.43:0/2400983376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d61d90 0x5653b6d7a590 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00e9d0 tx=0x7ffbbc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b36e98817ac70 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:42.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbaa7fc640 1 -- 172.21.15.43:0/2400983376 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc018070 con 0x5653b6d61d90 2024-04-24T23:00:42.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbaa7fc640 1 -- 172.21.15.43:0/2400983376 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbbc010b60 con 0x5653b6d61d90 2024-04-24T23:00:42.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbaa7fc640 1 -- 172.21.15.43:0/2400983376 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc010d50 con 0x5653b6d61d90 2024-04-24T23:00:42.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 -- 172.21.15.43:0/2400983376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d61d90 msgr2=0x5653b6d7a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 --2- 172.21.15.43:0/2400983376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d61d90 0x5653b6d7a590 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00e9d0 tx=0x7ffbbc00ee90 comp rx=0 tx=0).stop 2024-04-24T23:00:42.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 -- 172.21.15.43:0/2400983376 shutdown_connections 2024-04-24T23:00:42.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 --2- 172.21.15.43:0/2400983376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d61d90 0x5653b6d7a590 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 --2- 172.21.15.43:0/2400983376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d60850 0x5653b6d5b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 --2- 172.21.15.43:0/2400983376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d36140 0x5653b6d60030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 -- 172.21.15.43:0/2400983376 >> 172.21.15.43:0/2400983376 conn(0x5653b6d5c0c0 msgr2=0x5653b6d5ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:42.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 -- 172.21.15.43:0/2400983376 shutdown_connections 2024-04-24T23:00:42.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 -- 172.21.15.43:0/2400983376 wait complete. 2024-04-24T23:00:42.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 -- start start 2024-04-24T23:00:42.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 Processor -- start 2024-04-24T23:00:42.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d36140 0x5653b6d5e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d60850 0x5653b6d31d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d61d90 0x5653b6d7a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5653b6b82c10 con 0x5653b6d36140 2024-04-24T23:00:42.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5653b6d39250 con 0x5653b6d60850 2024-04-24T23:00:42.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5653b6b42670 con 0x5653b6d61d90 2024-04-24T23:00:42.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 10 client.0 _ll_register_callbacks cb 0x7ffbb40c7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-24T23:00:42.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9040640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d36140 0x5653b6d5e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9040640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d36140 0x5653b6d5e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34786/0 (socket says 172.21.15.43:34786) 2024-04-24T23:00:42.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9040640 1 -- 172.21.15.43:0/205600228 learned_addr learned my addr 172.21.15.43:0/205600228 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:42.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc883f640 1 --2- 172.21.15.43:0/205600228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d60850 0x5653b6d31d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9040640 1 -- 172.21.15.43:0/205600228 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d61d90 msgr2=0x5653b6d7a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:42.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9040640 1 --2- 172.21.15.43:0/205600228 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d61d90 0x5653b6d7a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9040640 1 -- 172.21.15.43:0/205600228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d60850 msgr2=0x5653b6d31d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:42.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9040640 1 --2- 172.21.15.43:0/205600228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d60850 0x5653b6d31d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9040640 1 -- 172.21.15.43:0/205600228 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653b6b06e80 con 0x5653b6d36140 2024-04-24T23:00:42.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc9040640 1 --2- 172.21.15.43:0/205600228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d36140 0x5653b6d5e700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80558a0 tx=0x7ffbb8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a127b2c1e60d3c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:42.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffba3fff640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-24T23:00:42.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffba3fff640 1 -- 172.21.15.43:0/205600228 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb805c0b0 con 0x5653b6d36140 2024-04-24T23:00:42.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 -- 172.21.15.43:0/205600228 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbbc010b60 con 0x5653b6d36140 2024-04-24T23:00:42.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffba3fff640 1 -- 172.21.15.43:0/205600228 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ffbb801dde0 con 0x5653b6d36140 2024-04-24T23:00:42.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffba3fff640 1 -- 172.21.15.43:0/205600228 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ffbb8051f80 con 0x5653b6d36140 2024-04-24T23:00:42.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 10 client.4800 fetch_fsmap learned FSMap version 9 2024-04-24T23:00:42.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 -- 172.21.15.43:0/205600228 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5653b6b4b760 con 0x5653b6d36140 2024-04-24T23:00:42.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffba3fff640 1 -- 172.21.15.43:0/205600228 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbbc010b60 con 0x5653b6d36140 2024-04-24T23:00:42.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffba3fff640 1 -- 172.21.15.43:0/205600228 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 9) ==== 2292+0+0 (secure 0 0 0) 0x7ffbb8055b70 con 0x5653b6d36140 2024-04-24T23:00:42.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 10 client.4800 fetch_fsmap finished waiting for FSMap version 9 2024-04-24T23:00:42.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 10 client.4800 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-24T23:00:42.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 20 client.4800 populate_metadata read hostname 'smithi043' 2024-04-24T23:00:42.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 --2- 172.21.15.43:0/205600228 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x5653b6d7aad0 0x5653b6d77560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:42.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 4 client.4800 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-24T23:00:42.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbce41d000 1 -- 172.21.15.43:0/205600228 --> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] -- command(tid 0: {"prefix": "status"}) -- 0x5653b6b8bb20 con 0x5653b6d7aad0 2024-04-24T23:00:42.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc883f640 1 --2- 172.21.15.43:0/205600228 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x5653b6d7aad0 0x5653b6d77560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:42.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffba3fff640 10 client.4800 ms_handle_connect on v2:172.21.15.43:6834/152091432 2024-04-24T23:00:42.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.903+0000 7ffbc883f640 1 --2- 172.21.15.43:0/205600228 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x5653b6d7aad0 0x5653b6d77560 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fed10f11a32868b8 server_cookie=c9d1e4c3bebf8a84 in_seq=0 out_seq=0 2024-04-24T23:00:42.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffba3fff640 1 -- 172.21.15.43:0/205600228 <== mds.0 v2:172.21.15.43:6834/152091432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5653b6b8bb20 con 0x5653b6d7aad0 2024-04-24T23:00:42.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffba3fff640 10 client.4800 handle_command_reply: tid=0 2024-04-24T23:00:42.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbce41d000 1 client.4800 shutdown 2024-04-24T23:00:42.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbce41d000 1 -- 172.21.15.43:0/205600228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d36140 msgr2=0x5653b6d5e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbce41d000 1 --2- 172.21.15.43:0/205600228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d36140 0x5653b6d5e700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80558a0 tx=0x7ffbb8000ee0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbce41d000 1 -- 172.21.15.43:0/205600228 shutdown_connections 2024-04-24T23:00:42.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbce41d000 1 --2- 172.21.15.43:0/205600228 >> [v2:172.21.15.43:6834/152091432,v1:172.21.15.43:6835/152091432] conn(0x5653b6d7aad0 0x5653b6d77560 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbce41d000 1 --2- 172.21.15.43:0/205600228 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5653b6d61d90 0x5653b6d7a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbce41d000 1 --2- 172.21.15.43:0/205600228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653b6d60850 0x5653b6d31d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbce41d000 1 --2- 172.21.15.43:0/205600228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653b6d36140 0x5653b6d5e700 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffba3fff640 0 client.4800 ms_handle_reset on v2:172.21.15.43:6834/152091432 2024-04-24T23:00:42.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbce41d000 1 -- 172.21.15.43:0/205600228 >> 172.21.15.43:0/205600228 conn(0x5653b6d5c0c0 msgr2=0x5653b6d5b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:42.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbce41d000 1 -- 172.21.15.43:0/205600228 shutdown_connections 2024-04-24T23:00:42.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbce41d000 1 -- 172.21.15.43:0/205600228 wait complete. 2024-04-24T23:00:42.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbce41d000 20 client.4800 trim_cache size 0 max 16384 2024-04-24T23:00:42.918 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-24T23:00:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "97891efb-e5ff-41f6-b724-29d534e60717", 2024-04-24T23:00:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-04-24T23:00:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4248, 2024-04-24T23:00:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-24T23:00:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-24T23:00:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-24T23:00:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 26.487653328, 2024-04-24T23:00:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 9, 2024-04-24T23:00:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 25, 2024-04-24T23:00:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 25, 2024-04-24T23:00:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 33.288262914999997 2024-04-24T23:00:42.919 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-24T23:00:42.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbcb2a4640 1 -- 172.21.15.43:0/1827775126 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ffbb00678c0 msgr2=0x7ffbb0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbcb2a4640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ffbb00678c0 0x7ffbb0069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40ae000 tx=0x7ffbb40a7070 comp rx=0 tx=0).stop 2024-04-24T23:00:42.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbcb2a4640 1 -- 172.21.15.43:0/1827775126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbc40b2500 msgr2=0x7ffbc4141b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:42.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbcb2a4640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbc40b2500 0x7ffbc4141b20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800c420 tx=0x7ffbb800c8e0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbcb2a4640 1 -- 172.21.15.43:0/1827775126 shutdown_connections 2024-04-24T23:00:42.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbcb2a4640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ffbb00678c0 0x7ffbb0069d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbcb2a4640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbc414dce0 0x7ffbc41e1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbcb2a4640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc413f1f0 0x7ffbc414fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbcb2a4640 1 --2- 172.21.15.43:0/1827775126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbc40b2500 0x7ffbc4141b20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:42.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbcb2a4640 1 -- 172.21.15.43:0/1827775126 >> 172.21.15.43:0/1827775126 conn(0x7ffbc40b5690 msgr2=0x7ffbc40b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:42.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbcb2a4640 1 -- 172.21.15.43:0/1827775126 shutdown_connections 2024-04-24T23:00:42.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:42.907+0000 7ffbcb2a4640 1 -- 172.21.15.43:0/1827775126 wait complete. 2024-04-24T23:00:42.927 INFO:teuthology.run_tasks:Running task sequential... 2024-04-24T23:00:42.936 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-24T23:00:42.937 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-24T23:00:42.937 INFO:teuthology.task.print:Enabling mgr modules 2024-04-24T23:00:42.937 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-24T23:00:42.949 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-24T23:00:42.949 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-24T23:00:42.949 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-24T23:00:42.949 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-24T23:00:42.949 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:42.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:42.949 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-24T23:00:42.955 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-24T23:00:42.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:42.956 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-24T23:00:43.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:43.010 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-04-24T23:00:43.058 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:00:43.100 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:00:43.204 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-24T23:00:43.204 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-24T23:00:43.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.367+0000 7f03a6e34640 1 Processor -- start 2024-04-24T23:00:43.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.367+0000 7f03a6e34640 1 -- start start 2024-04-24T23:00:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f03a6e34640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f03a00b4080 0x7f03a0143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f03a6e34640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a00afa00 0x7f03a01441e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f03a6e34640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03a00b2ed0 con 0x7f03a0142de0 2024-04-24T23:00:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f03a6e34640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f03a00b1a10 con 0x7f03a00b4080 2024-04-24T23:00:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f03a6e34640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f03a00b4460 con 0x7f03a00afa00 2024-04-24T23:00:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f03a4bd0640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f03a00b4080 0x7f03a0143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f03a53d1640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f03a0142de0 0x7f03a0143290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:51134/0 (socket says 172.21.15.43:51134) 2024-04-24T23:00:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f03a53d1640 1 -- 172.21.15.43:0/1830952410 learned_addr learned my addr 172.21.15.43:0/1830952410 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:00:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f03a4bd0640 1 -- 172.21.15.43:0/1830952410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a00afa00 msgr2=0x7f03a01441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:00:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f03a4bd0640 1 --2- 172.21.15.43:0/1830952410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a00afa00 0x7f03a01441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f03a4bd0640 1 -- 172.21.15.43:0/1830952410 >> v1:172.21.15.43:6789/0 conn(0x7f03a0142de0 legacy=0x7f03a0143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f03a4bd0640 1 -- 172.21.15.43:0/1830952410 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a00b1c60 con 0x7f03a00b4080 2024-04-24T23:00:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f039f7fe640 1 -- 172.21.15.43:0/1830952410 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1521191975 0 0) 0x7f03a00b2ed0 con 0x7f03a0142de0 2024-04-24T23:00:43.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f03a4bd0640 1 --2- 172.21.15.43:0/1830952410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a00b4080 0x7f03a0143ca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f03900097c0 tx=0x7f039001d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db65560c4676c4c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:43.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f039f7fe640 1 -- 172.21.15.43:0/1830952410 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03900b2070 con 0x7f03a00b4080 2024-04-24T23:00:43.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f039f7fe640 1 -- 172.21.15.43:0/1830952410 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03900ad620 con 0x7f03a00b4080 2024-04-24T23:00:43.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.371+0000 7f039f7fe640 1 -- 172.21.15.43:0/1830952410 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03900ad9f0 con 0x7f03a00b4080 2024-04-24T23:00:43.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 -- 172.21.15.43:0/1830952410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a00b4080 msgr2=0x7f03a0143ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:43.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 --2- 172.21.15.43:0/1830952410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a00b4080 0x7f03a0143ca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f03900097c0 tx=0x7f039001d520 comp rx=0 tx=0).stop 2024-04-24T23:00:43.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 -- 172.21.15.43:0/1830952410 shutdown_connections 2024-04-24T23:00:43.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 --2- 172.21.15.43:0/1830952410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a00afa00 0x7f03a01441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:43.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 --2- 172.21.15.43:0/1830952410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a00b4080 0x7f03a0143ca0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:43.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 -- 172.21.15.43:0/1830952410 >> 172.21.15.43:0/1830952410 conn(0x7f03a00b5690 msgr2=0x7f03a00b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:43.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 -- 172.21.15.43:0/1830952410 shutdown_connections 2024-04-24T23:00:43.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 -- 172.21.15.43:0/1830952410 wait complete. 2024-04-24T23:00:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 Processor -- start 2024-04-24T23:00:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 -- start start 2024-04-24T23:00:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a00afa00 0x7f03a013a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a00b4080 0x7f03a01e1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a0142de0 0x7f03a01dde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f03a0152650 con 0x7f03a00b4080 2024-04-24T23:00:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01524d0 con 0x7f03a0142de0 2024-04-24T23:00:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f03a01527d0 con 0x7f03a00afa00 2024-04-24T23:00:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f039ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a00b4080 0x7f03a01e1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f039ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a00b4080 0x7f03a01e1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34806/0 (socket says 172.21.15.43:34806) 2024-04-24T23:00:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f039ffff640 1 -- 172.21.15.43:0/3391913356 learned_addr learned my addr 172.21.15.43:0/3391913356 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:00:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a53d1640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a0142de0 0x7f03a01dde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a4bd0640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a00afa00 0x7f03a013a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f039ffff640 1 -- 172.21.15.43:0/3391913356 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a00afa00 msgr2=0x7f03a013a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f039ffff640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a00afa00 0x7f03a013a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f039ffff640 1 -- 172.21.15.43:0/3391913356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a0142de0 msgr2=0x7f03a01dde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f039ffff640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a0142de0 0x7f03a01dde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f039ffff640 1 -- 172.21.15.43:0/3391913356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a01e0e60 con 0x7f03a00b4080 2024-04-24T23:00:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a4bd0640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a00afa00 0x7f03a013a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a53d1640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a0142de0 0x7f03a01dde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:00:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f039ffff640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a00b4080 0x7f03a01e1660 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f039400b410 tx=0x7f039400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f039d7fa640 1 -- 172.21.15.43:0/3391913356 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0394015020 con 0x7f03a00b4080 2024-04-24T23:00:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f039d7fa640 1 -- 172.21.15.43:0/3391913356 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0394011830 con 0x7f03a00b4080 2024-04-24T23:00:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 -- 172.21.15.43:0/3391913356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a01e1140 con 0x7f03a00b4080 2024-04-24T23:00:43.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f039d7fa640 1 -- 172.21.15.43:0/3391913356 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0394011c20 con 0x7f03a00b4080 2024-04-24T23:00:43.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 -- 172.21.15.43:0/3391913356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a0141ef0 con 0x7f03a00b4080 2024-04-24T23:00:43.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.375+0000 7f03a6e34640 1 -- 172.21.15.43:0/3391913356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a004f580 con 0x7f03a00b4080 2024-04-24T23:00:43.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.379+0000 7f039d7fa640 1 -- 172.21.15.43:0/3391913356 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0394018020 con 0x7f03a00b4080 2024-04-24T23:00:43.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.379+0000 7f039d7fa640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f038c0678c0 0x7f038c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:00:43.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.379+0000 7f039d7fa640 1 -- 172.21.15.43:0/3391913356 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0394085e30 con 0x7f03a00b4080 2024-04-24T23:00:43.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.379+0000 7f03a4bd0640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f038c0678c0 0x7f038c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:00:43.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.379+0000 7f03a4bd0640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f038c0678c0 0x7f038c069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f03900af000 tx=0x7f0390008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:00:43.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.383+0000 7f039d7fa640 1 -- 172.21.15.43:0/3391913356 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f039401f020 con 0x7f03a00b4080 2024-04-24T23:00:43.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.579+0000 7f03a6e34640 1 -- 172.21.15.43:0/3391913356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f03a00b6fe0 con 0x7f03a00b4080 2024-04-24T23:00:43.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.579+0000 7f039d7fa640 1 -- 172.21.15.43:0/3391913356 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f03940172c0 con 0x7f03a00b4080 2024-04-24T23:00:43.584 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-24T23:00:43.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.579+0000 7f03a6e34640 1 -- 172.21.15.43:0/3391913356 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f038c0678c0 msgr2=0x7f038c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:43.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.579+0000 7f03a6e34640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f038c0678c0 0x7f038c069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f03900af000 tx=0x7f0390008040 comp rx=0 tx=0).stop 2024-04-24T23:00:43.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.579+0000 7f03a6e34640 1 -- 172.21.15.43:0/3391913356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a00b4080 msgr2=0x7f03a01e1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:00:43.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.579+0000 7f03a6e34640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a00b4080 0x7f03a01e1660 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f039400b410 tx=0x7f039400b8d0 comp rx=0 tx=0).stop 2024-04-24T23:00:43.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.579+0000 7f03a6e34640 1 -- 172.21.15.43:0/3391913356 shutdown_connections 2024-04-24T23:00:43.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.579+0000 7f03a6e34640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f038c0678c0 0x7f038c069d80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:43.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.579+0000 7f03a6e34640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a0142de0 0x7f03a01dde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:43.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.579+0000 7f03a6e34640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a00b4080 0x7f03a01e1660 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:43.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.579+0000 7f03a6e34640 1 --2- 172.21.15.43:0/3391913356 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a00afa00 0x7f03a013a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:00:43.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.579+0000 7f03a6e34640 1 -- 172.21.15.43:0/3391913356 >> 172.21.15.43:0/3391913356 conn(0x7f03a00b5690 msgr2=0x7f03a00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:00:43.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.579+0000 7f03a6e34640 1 -- 172.21.15.43:0/3391913356 shutdown_connections 2024-04-24T23:00:43.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43.579+0000 7f03a6e34640 1 -- 172.21.15.43:0/3391913356 wait complete. 2024-04-24T23:00:43.602 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-24T23:00:43.602 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-24T23:00:43.602 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-04-24T23:00:43.602 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-24T23:00:43.602 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:43.602 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-24T23:00:43.602 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-24T23:00:43.602 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-24T23:00:43.602 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:00:43.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:43.603 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-04-24T23:00:43.608 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-24T23:00:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-24T23:00:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-04-24T23:00:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-04-24T23:00:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:43.609 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T23:00:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-04-24T23:00:43.609 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T23:00:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-04-24T23:00:43.609 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-24T23:00:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-04-24T23:00:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-24T23:00:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42469sec preferred_lft 42469sec 2024-04-24T23:00:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link 2024-04-24T23:00:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:43.610 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-24T23:00:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-04-24T23:00:43.610 INFO:teuthology.orchestra.run.smithi043.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-24T23:00:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 02:42:3d:31:53:9e brd ff:ff:ff:ff:ff:ff 2024-04-24T23:00:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-24T23:00:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-24T23:00:43.611 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-24T23:00:43.611 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:43.611 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-24T23:00:43.611 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2024-04-24T23:00:43.611 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2024-04-24T23:00:43.611 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2024-04-24T23:00:43.611 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-24T23:00:43.611 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-24T23:00:43.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:43.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:43.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:43.738 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-24T23:00:43.791 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-04-24T23:00:43.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:43.793 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-04-24T23:00:43.840 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-04-24T23:00:43.840 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-24T23:00:43.840 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-24T23:00:43.840 INFO:teuthology.orchestra.run.smithi043.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-24T23:00:43.840 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-24T23:00:43.840 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-24T23:00:43.841 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:43.841 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-24T23:00:43.841 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-24T23:00:43.841 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-24T23:00:43.841 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-24T23:00:43.841 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-24T23:00:43.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:43.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:43.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:43.965 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-24T23:00:43.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:43.971 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-04-24T23:00:44.019 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:44.019 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-24T23:00:44.019 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:00:44.019 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-24T23:00:44.019 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-24T23:00:44.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:44.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:44.144 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-24T23:00:44.145 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:44.145 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-24T23:00:44.145 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-24T23:00:44.145 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-24T23:00:44.145 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-24T23:00:44.145 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-24T23:00:44.145 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-24T23:00:44.145 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-24T23:00:44.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:44.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:44.244 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-24T23:00:44.244 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-24T23:00:44.244 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-04-24T23:00:44.244 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2024-04-24T23:00:44.244 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-24T23:00:44.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-24T23:00:44.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:44.358 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-24T23:00:44.358 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:00:44.358 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:44.403 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-24T23:00:44.403 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-24T23:00:44.403 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:44.454 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-04-24T23:00:44.511 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:00:44.562 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-04-24T23:00:44.562 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-04-24T23:00:44.562 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-04-24T23:00:44.562 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-04-24T23:00:44.562 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-04-24T23:00:44.562 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-04-24T23:00:44.562 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-04-24T23:00:44.562 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-04-24T23:00:44.562 INFO:teuthology.orchestra.run.smithi043.stdout:/run/lock 2024-04-24T23:00:44.562 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-04-24T23:00:44.562 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-04-24T23:00:44.563 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-04-24T23:00:44.563 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:00:44.563 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-04-24T23:00:44.563 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-04-24T23:00:44.563 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-04-24T23:00:44.563 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-04-24T23:00:44.563 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/fs/nfsd 2024-04-24T23:00:44.563 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-04-24T23:00:44.563 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-04-24T23:00:44.563 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T23:00:44.563 INFO:teuthology.orchestra.run.smithi043.stdout:/run/rpc_pipefs 2024-04-24T23:00:44.563 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-04-24T23:00:44.563 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-04-24T23:00:44.563 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-0 2024-04-24T23:00:44.563 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-1 2024-04-24T23:00:44.564 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-2 2024-04-24T23:00:44.564 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-3 2024-04-24T23:00:44.564 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-04-24T23:00:44.564 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:00:44.564 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:00:44.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:44.565 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-04-24T23:00:44.616 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-24T23:00:44.616 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-24T23:00:44.660 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-04-24T23:00:44.678 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:00:44.723 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-04-24T23:00:44.724 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-04-24T23:00:44.724 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-04-24T23:00:44.724 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-04-24T23:00:44.724 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-04-24T23:00:44.724 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-04-24T23:00:44.724 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-04-24T23:00:44.724 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-04-24T23:00:44.724 INFO:teuthology.orchestra.run.smithi043.stdout:/run/lock 2024-04-24T23:00:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-04-24T23:00:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-04-24T23:00:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-04-24T23:00:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:00:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-04-24T23:00:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-04-24T23:00:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-04-24T23:00:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-04-24T23:00:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/fs/nfsd 2024-04-24T23:00:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-04-24T23:00:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-04-24T23:00:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T23:00:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:/run/rpc_pipefs 2024-04-24T23:00:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-04-24T23:00:44.726 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-04-24T23:00:44.726 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-0 2024-04-24T23:00:44.726 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-1 2024-04-24T23:00:44.726 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-2 2024-04-24T23:00:44.726 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-3 2024-04-24T23:00:44.726 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-04-24T23:00:44.726 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:00:44.726 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:00:44.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:44.727 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-04-24T23:00:44.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi043.stderr:2024-04-24T23:00:44.739+0000 7f8aa3193580 -1 init, newargv = 0x55aade144460 newargc=15 2024-04-24T23:00:44.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi043.stderr:ceph-fuse[33807]: starting ceph client 2024-04-24T23:00:44.749 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi043.stderr:ceph-fuse[33807]: starting fuse 2024-04-24T23:00:45.850 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-04-24T23:00:45.866 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-04-24T23:00:45.916 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-04-24T23:00:45.916 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-04-24T23:00:45.916 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-04-24T23:00:45.916 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-04-24T23:00:45.917 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-04-24T23:00:45.917 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-04-24T23:00:45.917 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-04-24T23:00:45.917 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-04-24T23:00:45.917 INFO:teuthology.orchestra.run.smithi043.stdout:/run/lock 2024-04-24T23:00:45.917 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-04-24T23:00:45.917 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-04-24T23:00:45.917 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-04-24T23:00:45.917 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-24T23:00:45.917 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-04-24T23:00:45.917 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-04-24T23:00:45.917 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-04-24T23:00:45.917 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-04-24T23:00:45.917 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/fs/nfsd 2024-04-24T23:00:45.918 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-04-24T23:00:45.918 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-04-24T23:00:45.918 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysusers.service 2024-04-24T23:00:45.918 INFO:teuthology.orchestra.run.smithi043.stdout:/run/rpc_pipefs 2024-04-24T23:00:45.918 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-04-24T23:00:45.918 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-04-24T23:00:45.918 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-0 2024-04-24T23:00:45.918 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-1 2024-04-24T23:00:45.918 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-2 2024-04-24T23:00:45.918 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-3 2024-04-24T23:00:45.918 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-04-24T23:00:45.918 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:00:45.918 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:00:45.919 INFO:teuthology.orchestra.run.smithi043.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:45.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:45.920 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-04-24T23:00:45.968 INFO:teuthology.orchestra.run.smithi043.stdout:45 2024-04-24T23:00:45.968 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-24T23:00:45.968 DEBUG:teuthology.orchestra.run.smithi043:> sudo stdin-killer -- python3 -c ' 2024-04-24T23:00:45.968 DEBUG:teuthology.orchestra.run.smithi043:> import glob 2024-04-24T23:00:45.968 DEBUG:teuthology.orchestra.run.smithi043:> import re 2024-04-24T23:00:45.968 DEBUG:teuthology.orchestra.run.smithi043:> import os 2024-04-24T23:00:45.968 DEBUG:teuthology.orchestra.run.smithi043:> import subprocess 2024-04-24T23:00:45.968 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-24T23:00:45.968 DEBUG:teuthology.orchestra.run.smithi043:> def _find_admin_socket(client_name): 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> files = glob.glob(asok_path) 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> # Given a non-glob path, it better be there 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> if "*" not in asok_path: 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> assert(len(files) == 1) 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> return files[0] 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> for f in files: 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> contents = proc_f.read() 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> if mountpoint in contents: 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> return f 2024-04-24T23:00:45.969 DEBUG:teuthology.orchestra.run.smithi043:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-24T23:00:45.970 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-24T23:00:45.970 DEBUG:teuthology.orchestra.run.smithi043:> print(_find_admin_socket("client.0")) 2024-04-24T23:00:45.970 DEBUG:teuthology.orchestra.run.smithi043:> ' 2024-04-24T23:00:46.095 INFO:teuthology.orchestra.run.smithi043.stdout:/var/run/ceph/ceph-client.0.33807.asok 2024-04-24T23:00:46.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:00:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-24T23:00:46.107 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33807.asok 2024-04-24T23:00:46.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:46.107 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33807.asok status 2024-04-24T23:00:46.269 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-24T23:00:46.270 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": { 2024-04-24T23:00:46.270 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_sha1": "d2c45d977142e024a59b68a8f1dce8f0b9840551", 2024-04-24T23:00:46.270 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_version": "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)", 2024-04-24T23:00:46.270 INFO:teuthology.orchestra.run.smithi043.stdout: "entity_id": "0", 2024-04-24T23:00:46.270 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": "smithi043", 2024-04-24T23:00:46.270 INFO:teuthology.orchestra.run.smithi043.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-24T23:00:46.270 INFO:teuthology.orchestra.run.smithi043.stdout: "pid": "33807", 2024-04-24T23:00:46.270 INFO:teuthology.orchestra.run.smithi043.stdout: "root": "/" 2024-04-24T23:00:46.270 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:00:46.270 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_count": 0, 2024-04-24T23:00:46.270 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_pinned_count": 0, 2024-04-24T23:00:46.270 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4818, 2024-04-24T23:00:46.270 INFO:teuthology.orchestra.run.smithi043.stdout: "inst": { 2024-04-24T23:00:46.270 INFO:teuthology.orchestra.run.smithi043.stdout: "name": { 2024-04-24T23:00:46.271 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "client", 2024-04-24T23:00:46.271 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 4818 2024-04-24T23:00:46.271 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:00:46.271 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2024-04-24T23:00:46.271 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-24T23:00:46.271 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2024-04-24T23:00:46.271 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2560004818 2024-04-24T23:00:46.271 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:00:46.271 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:00:46.271 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2024-04-24T23:00:46.271 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-24T23:00:46.271 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2024-04-24T23:00:46.271 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2560004818 2024-04-24T23:00:46.271 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:00:46.272 INFO:teuthology.orchestra.run.smithi043.stdout: "inst_str": "client.4818 192.168.0.1:0/2560004818", 2024-04-24T23:00:46.272 INFO:teuthology.orchestra.run.smithi043.stdout: "addr_str": "192.168.0.1:0/2560004818", 2024-04-24T23:00:46.272 INFO:teuthology.orchestra.run.smithi043.stdout: "inode_count": 1, 2024-04-24T23:00:46.272 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_epoch": 9, 2024-04-24T23:00:46.272 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch": 25, 2024-04-24T23:00:46.272 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch_barrier": 0, 2024-04-24T23:00:46.272 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklisted": false, 2024-04-24T23:00:46.273 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs" 2024-04-24T23:00:46.273 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-24T23:00:46.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:46.284 DEBUG:teuthology.orchestra.run.smithi043:> stat --file-system '--printf=%T 2024-04-24T23:00:46.284 DEBUG:teuthology.orchestra.run.smithi043:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:46.290 INFO:teuthology.orchestra.run.smithi043.stdout:fuseblk 2024-04-24T23:00:46.290 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:46.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:00:46.291 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:46.351 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-24T23:00:46.373 INFO:teuthology.run_tasks:Running task workunit... 2024-04-24T23:00:46.387 INFO:tasks.workunit:Pulling workunits from ref d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:00:46.388 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-24T23:00:46.388 INFO:tasks.workunit:timeout=3h 2024-04-24T23:00:46.388 INFO:tasks.workunit:cleanup=True 2024-04-24T23:00:46.388 DEBUG:teuthology.orchestra.run.smithi043:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:46.400 INFO:teuthology.orchestra.run.smithi043.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:46.401 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-24T23:00:46.401 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-24T23:00:46.401 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T23:00:46.401 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-24T23:00:46.401 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-24 23:00:16.424752679 +0000 2024-04-24T23:00:46.401 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-24 23:00:26.743197522 +0000 2024-04-24T23:00:46.401 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2024-04-24T23:00:46.401 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-24T23:00:46.401 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-24T23:00:46.465 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-24T23:00:46.513 INFO:tasks.workunit.client.0.smithi043.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-24T23:01:13.206 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:01:13.210 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:01:43.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:01:43.252 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:01:56.077 INFO:tasks.workunit.client.0.smithi043.stderr:Updating files: 97% (12225/12492) Updating files: 98% (12243/12492) Updating files: 99% (12368/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-24T23:01:56.338 INFO:tasks.workunit.client.0.smithi043.stderr:Note: switching to 'd2c45d977142e024a59b68a8f1dce8f0b9840551'. 2024-04-24T23:01:56.338 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-24T23:01:56.338 INFO:tasks.workunit.client.0.smithi043.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-24T23:01:56.338 INFO:tasks.workunit.client.0.smithi043.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-24T23:01:56.339 INFO:tasks.workunit.client.0.smithi043.stderr:state without impacting any branches by switching back to a branch. 2024-04-24T23:01:56.339 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-24T23:01:56.339 INFO:tasks.workunit.client.0.smithi043.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-24T23:01:56.339 INFO:tasks.workunit.client.0.smithi043.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-24T23:01:56.339 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-24T23:01:56.339 INFO:tasks.workunit.client.0.smithi043.stderr: git switch -c 2024-04-24T23:01:56.339 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-24T23:01:56.339 INFO:tasks.workunit.client.0.smithi043.stderr:Or undo this operation with: 2024-04-24T23:01:56.339 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-24T23:01:56.339 INFO:tasks.workunit.client.0.smithi043.stderr: git switch - 2024-04-24T23:01:56.339 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-24T23:01:56.340 INFO:tasks.workunit.client.0.smithi043.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-24T23:01:56.340 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-24T23:01:56.340 INFO:tasks.workunit.client.0.smithi043.stderr:HEAD is now at d2c45d97714 Merge pull request #56528 from adk3798/squid-mypy-bump 2024-04-24T23:01:56.343 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-24T23:01:56.350 INFO:tasks.workunit.client.0.smithi043.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-24T23:01:56.353 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-24T23:01:56.353 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-24T23:01:57.127 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-24T23:01:57.214 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-24T23:01:57.275 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-24T23:01:57.276 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-24T23:01:57.276 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-24T23:01:57.325 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-24T23:01:57.330 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T23:01:57.330 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-24T23:01:57.380 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-04-24T23:01:57.381 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-04-24T23:01:57.381 DEBUG:teuthology.orchestra.run.smithi043:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2c45d977142e024a59b68a8f1dce8f0b9840551 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-04-24T23:01:57.441 INFO:tasks.workunit.client.0.smithi043.stdout:getting blogbench 2024-04-24T23:01:57.441 INFO:tasks.workunit.client.0.smithi043.stderr:+ echo 'getting blogbench' 2024-04-24T23:01:57.441 INFO:tasks.workunit.client.0.smithi043.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-04-24T23:01:57.470 INFO:tasks.workunit.client.0.smithi043.stderr:--2024-04-24 23:01:57-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-04-24T23:01:57.472 INFO:tasks.workunit.client.0.smithi043.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-04-24T23:01:57.508 INFO:tasks.workunit.client.0.smithi043.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-04-24T23:01:57.544 INFO:tasks.workunit.client.0.smithi043.stderr:HTTP request sent, awaiting response... 200 OK 2024-04-24T23:01:57.544 INFO:tasks.workunit.client.0.smithi043.stderr:Length: 103355 (101K) [application/octet-stream] 2024-04-24T23:01:57.547 INFO:tasks.workunit.client.0.smithi043.stderr:Saving to: 'blogbench-1.0.tar.bz2' 2024-04-24T23:01:57.554 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-24T23:01:57.617 INFO:tasks.workunit.client.0.smithi043.stderr: 0K .......... .......... .......... .......... .......... 49% 733K 0s 2024-04-24T23:01:57.652 INFO:tasks.workunit.client.0.smithi043.stderr: 50K .......... .......... .......... .......... .......... 99% 1.42M 0s 2024-04-24T23:01:57.652 INFO:tasks.workunit.client.0.smithi043.stderr: 100K 100% 1.74T=0.1s 2024-04-24T23:01:57.652 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-24T23:01:57.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-04-24 23:01:57 (983 KB/s) - 'blogbench-1.0.tar.bz2' saved [103355/103355] 2024-04-24T23:01:57.652 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-24T23:01:57.653 INFO:tasks.workunit.client.0.smithi043.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-04-24T23:01:57.687 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/ 2024-04-24T23:01:57.689 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/m4/ 2024-04-24T23:01:57.691 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-04-24T23:01:57.696 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/man/ 2024-04-24T23:01:57.700 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/man/blogbench.8 2024-04-24T23:01:57.706 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/man/Makefile.am 2024-04-24T23:01:57.714 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/man/Makefile.in 2024-04-24T23:01:57.722 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/ 2024-04-24T23:01:57.727 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/mysnprintf.c 2024-04-24T23:01:57.731 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/mysnprintf.h 2024-04-24T23:01:57.735 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/blogbench.c 2024-04-24T23:01:57.741 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/blogbench.h 2024-04-24T23:01:57.747 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/fakesnprintf.c 2024-04-24T23:01:57.753 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/fakesnprintf.h 2024-04-24T23:01:57.757 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/blogbench_p.h 2024-04-24T23:01:57.763 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-04-24T23:01:57.769 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-04-24T23:01:57.774 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/Makefile.am 2024-04-24T23:01:57.779 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/Makefile.in 2024-04-24T23:01:57.784 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/process.c 2024-04-24T23:01:57.790 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/globals.h 2024-04-24T23:01:57.796 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/commenter.c 2024-04-24T23:01:57.801 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/rewriter.c 2024-04-24T23:01:57.805 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/reader.c 2024-04-24T23:01:57.810 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/writer.c 2024-04-24T23:01:57.814 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/src/helpers.c 2024-04-24T23:01:57.818 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/NEWS 2024-04-24T23:01:57.821 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/compile 2024-04-24T23:01:57.825 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/depcomp 2024-04-24T23:01:57.830 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/aclocal.m4 2024-04-24T23:01:57.836 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/README 2024-04-24T23:01:57.840 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/configure 2024-04-24T23:01:57.852 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/configure.ac 2024-04-24T23:01:57.856 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/config.guess 2024-04-24T23:01:57.861 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/install-sh 2024-04-24T23:01:57.865 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/config.sub 2024-04-24T23:01:57.870 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/missing 2024-04-24T23:01:57.874 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/mkinstalldirs 2024-04-24T23:01:57.877 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/Makefile.am 2024-04-24T23:01:57.881 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/Makefile.in 2024-04-24T23:01:57.886 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/config.h.in 2024-04-24T23:01:57.889 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/AUTHORS 2024-04-24T23:01:57.893 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/INSTALL 2024-04-24T23:01:57.897 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/ChangeLog 2024-04-24T23:01:57.899 INFO:tasks.workunit.client.0.smithi043.stdout:blogbench-1.0/COPYING 2024-04-24T23:01:57.903 INFO:tasks.workunit.client.0.smithi043.stderr:+ cd blogbench-1.0/ 2024-04-24T23:01:57.905 INFO:tasks.workunit.client.0.smithi043.stdout:making blogbench 2024-04-24T23:01:57.905 INFO:tasks.workunit.client.0.smithi043.stderr:+ echo 'making blogbench' 2024-04-24T23:01:57.905 INFO:tasks.workunit.client.0.smithi043.stderr:+ ./configure 2024-04-24T23:01:58.046 INFO:tasks.workunit.client.0.smithi043.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-24T23:01:59.066 INFO:tasks.workunit.client.0.smithi043.stdout:checking whether build environment is sane... yes 2024-04-24T23:01:59.090 INFO:tasks.workunit.client.0.smithi043.stdout:checking for gawk... gawk 2024-04-24T23:01:59.119 INFO:tasks.workunit.client.0.smithi043.stdout:checking whether make sets $(MAKE)... yes 2024-04-24T23:01:59.140 INFO:tasks.workunit.client.0.smithi043.stdout:checking for gcc... gcc 2024-04-24T23:01:59.233 INFO:tasks.workunit.client.0.smithi043.stdout:checking for C compiler default output file name... a.out 2024-04-24T23:01:59.237 INFO:tasks.workunit.client.0.smithi043.stdout:checking whether the C compiler works... yes 2024-04-24T23:01:59.243 INFO:tasks.workunit.client.0.smithi043.stdout:checking whether we are cross compiling... no 2024-04-24T23:01:59.310 INFO:tasks.workunit.client.0.smithi043.stdout:checking for suffix of executables... 2024-04-24T23:01:59.368 INFO:tasks.workunit.client.0.smithi043.stdout:checking for suffix of object files... o 2024-04-24T23:01:59.421 INFO:tasks.workunit.client.0.smithi043.stdout:checking whether we are using the GNU C compiler... yes 2024-04-24T23:01:59.472 INFO:tasks.workunit.client.0.smithi043.stdout:checking whether gcc accepts -g... yes 2024-04-24T23:01:59.571 INFO:tasks.workunit.client.0.smithi043.stdout:checking for gcc option to accept ANSI C... none needed 2024-04-24T23:01:59.657 INFO:tasks.workunit.client.0.smithi043.stdout:checking for style of include used by make... GNU 2024-04-24T23:01:59.827 INFO:tasks.workunit.client.0.smithi043.stdout:checking dependency style of gcc... gcc3 2024-04-24T23:01:59.828 INFO:tasks.workunit.client.0.smithi043.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-24T23:01:59.901 INFO:tasks.workunit.client.0.smithi043.stdout:checking how to run the C preprocessor... gcc -E 2024-04-24T23:01:59.960 INFO:tasks.workunit.client.0.smithi043.stdout:checking for egrep... grep -E 2024-04-24T23:01:59.972 INFO:tasks.workunit.client.0.smithi043.stdout:checking for AIX... no 2024-04-24T23:02:00.078 INFO:tasks.workunit.client.0.smithi043.stdout:checking for library containing strerror... none required 2024-04-24T23:02:00.277 INFO:tasks.workunit.client.0.smithi043.stdout:checking for ANSI C header files... yes 2024-04-24T23:02:00.329 INFO:tasks.workunit.client.0.smithi043.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-04-24T23:02:00.392 INFO:tasks.workunit.client.0.smithi043.stdout:checking for sys/types.h... yes 2024-04-24T23:02:00.466 INFO:tasks.workunit.client.0.smithi043.stdout:checking for sys/stat.h... yes 2024-04-24T23:02:00.538 INFO:tasks.workunit.client.0.smithi043.stdout:checking for stdlib.h... yes 2024-04-24T23:02:00.610 INFO:tasks.workunit.client.0.smithi043.stdout:checking for string.h... yes 2024-04-24T23:02:00.679 INFO:tasks.workunit.client.0.smithi043.stdout:checking for memory.h... yes 2024-04-24T23:02:00.748 INFO:tasks.workunit.client.0.smithi043.stdout:checking for strings.h... yes 2024-04-24T23:02:00.817 INFO:tasks.workunit.client.0.smithi043.stdout:checking for inttypes.h... yes 2024-04-24T23:02:00.891 INFO:tasks.workunit.client.0.smithi043.stdout:checking for stdint.h... yes 2024-04-24T23:02:00.964 INFO:tasks.workunit.client.0.smithi043.stdout:checking for unistd.h... yes 2024-04-24T23:02:00.981 INFO:tasks.workunit.client.0.smithi043.stdout:checking for memory.h... (cached) yes 2024-04-24T23:02:00.992 INFO:tasks.workunit.client.0.smithi043.stdout:checking for strings.h... (cached) yes 2024-04-24T23:02:01.002 INFO:tasks.workunit.client.0.smithi043.stdout:checking for unistd.h... (cached) yes 2024-04-24T23:02:01.078 INFO:tasks.workunit.client.0.smithi043.stdout:checking locale.h usability... yes 2024-04-24T23:02:01.106 INFO:tasks.workunit.client.0.smithi043.stdout:checking locale.h presence... yes 2024-04-24T23:02:01.107 INFO:tasks.workunit.client.0.smithi043.stdout:checking for locale.h... yes 2024-04-24T23:02:01.131 INFO:tasks.workunit.client.0.smithi043.stdout:checking for stdlib.h... (cached) yes 2024-04-24T23:02:01.142 INFO:tasks.workunit.client.0.smithi043.stdout:checking for string.h... (cached) yes 2024-04-24T23:02:01.217 INFO:tasks.workunit.client.0.smithi043.stdout:checking sys/socket.h usability... yes 2024-04-24T23:02:01.245 INFO:tasks.workunit.client.0.smithi043.stdout:checking sys/socket.h presence... yes 2024-04-24T23:02:01.246 INFO:tasks.workunit.client.0.smithi043.stdout:checking for sys/socket.h... yes 2024-04-24T23:02:01.327 INFO:tasks.workunit.client.0.smithi043.stdout:checking sys/time.h usability... yes 2024-04-24T23:02:01.352 INFO:tasks.workunit.client.0.smithi043.stdout:checking sys/time.h presence... yes 2024-04-24T23:02:01.352 INFO:tasks.workunit.client.0.smithi043.stdout:checking for sys/time.h... yes 2024-04-24T23:02:01.445 INFO:tasks.workunit.client.0.smithi043.stdout:checking fcntl.h usability... yes 2024-04-24T23:02:01.471 INFO:tasks.workunit.client.0.smithi043.stdout:checking fcntl.h presence... yes 2024-04-24T23:02:01.472 INFO:tasks.workunit.client.0.smithi043.stdout:checking for fcntl.h... yes 2024-04-24T23:02:01.561 INFO:tasks.workunit.client.0.smithi043.stdout:checking sys/fcntl.h usability... yes 2024-04-24T23:02:01.586 INFO:tasks.workunit.client.0.smithi043.stdout:checking sys/fcntl.h presence... yes 2024-04-24T23:02:01.587 INFO:tasks.workunit.client.0.smithi043.stdout:checking for sys/fcntl.h... yes 2024-04-24T23:02:01.686 INFO:tasks.workunit.client.0.smithi043.stdout:checking sys/param.h usability... yes 2024-04-24T23:02:01.719 INFO:tasks.workunit.client.0.smithi043.stdout:checking sys/param.h presence... yes 2024-04-24T23:02:01.720 INFO:tasks.workunit.client.0.smithi043.stdout:checking for sys/param.h... yes 2024-04-24T23:02:01.791 INFO:tasks.workunit.client.0.smithi043.stdout:checking ioctl.h usability... no 2024-04-24T23:02:01.821 INFO:tasks.workunit.client.0.smithi043.stdout:checking ioctl.h presence... no 2024-04-24T23:02:01.822 INFO:tasks.workunit.client.0.smithi043.stdout:checking for ioctl.h... no 2024-04-24T23:02:01.895 INFO:tasks.workunit.client.0.smithi043.stdout:checking sys/ioctl.h usability... yes 2024-04-24T23:02:01.921 INFO:tasks.workunit.client.0.smithi043.stdout:checking sys/ioctl.h presence... yes 2024-04-24T23:02:01.922 INFO:tasks.workunit.client.0.smithi043.stdout:checking for sys/ioctl.h... yes 2024-04-24T23:02:01.988 INFO:tasks.workunit.client.0.smithi043.stdout:checking return type of signal handlers... void 2024-04-24T23:02:02.049 INFO:tasks.workunit.client.0.smithi043.stdout:checking for size_t... yes 2024-04-24T23:02:02.099 INFO:tasks.workunit.client.0.smithi043.stdout:checking for dev_t... yes 2024-04-24T23:02:02.159 INFO:tasks.workunit.client.0.smithi043.stdout:checking for short... yes 2024-04-24T23:02:02.280 INFO:tasks.workunit.client.0.smithi043.stdout:checking size of short... 2 2024-04-24T23:02:02.350 INFO:tasks.workunit.client.0.smithi043.stdout:checking for int... yes 2024-04-24T23:02:02.457 INFO:tasks.workunit.client.0.smithi043.stdout:checking size of int... 4 2024-04-24T23:02:02.544 INFO:tasks.workunit.client.0.smithi043.stdout:checking for long... yes 2024-04-24T23:02:02.666 INFO:tasks.workunit.client.0.smithi043.stdout:checking size of long... 8 2024-04-24T23:02:02.734 INFO:tasks.workunit.client.0.smithi043.stdout:checking for long long... yes 2024-04-24T23:02:02.843 INFO:tasks.workunit.client.0.smithi043.stdout:checking size of long long... 8 2024-04-24T23:02:02.905 INFO:tasks.workunit.client.0.smithi043.stdout:checking for ssize_t... yes 2024-04-24T23:02:02.957 INFO:tasks.workunit.client.0.smithi043.stdout:checking for sig_atomic_t... yes 2024-04-24T23:02:03.013 INFO:tasks.workunit.client.0.smithi043.stdout:checking whether gcc needs -traditional... no 2024-04-24T23:02:03.060 INFO:tasks.workunit.client.0.smithi043.stdout:checking for an ANSI C-conforming const... yes 2024-04-24T23:02:03.094 INFO:tasks.workunit.client.0.smithi043.stdout:checking for inline... inline 2024-04-24T23:02:03.185 INFO:tasks.workunit.client.0.smithi043.stdout:checking for working alloca.h... yes 2024-04-24T23:02:03.259 INFO:tasks.workunit.client.0.smithi043.stdout:checking for alloca... yes 2024-04-24T23:02:03.354 INFO:tasks.workunit.client.0.smithi043.stdout:checking for working memcmp... yes 2024-04-24T23:02:03.444 INFO:tasks.workunit.client.0.smithi043.stdout:checking for strftime... yes 2024-04-24T23:02:03.591 INFO:tasks.workunit.client.0.smithi043.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-04-24T23:02:03.694 INFO:tasks.workunit.client.0.smithi043.stdout:checking whether stat accepts an empty string... no 2024-04-24T23:02:03.795 INFO:tasks.workunit.client.0.smithi043.stdout:checking for vprintf... yes 2024-04-24T23:02:03.888 INFO:tasks.workunit.client.0.smithi043.stdout:checking for _doprnt... no 2024-04-24T23:02:03.920 INFO:tasks.workunit.client.0.smithi043.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-04-24T23:02:03.935 INFO:tasks.workunit.client.0.smithi043.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-04-24T23:02:04.018 INFO:tasks.workunit.client.0.smithi043.stdout:checking for the pthreads library -lpthreads... no 2024-04-24T23:02:04.101 INFO:tasks.workunit.client.0.smithi043.stdout:checking whether pthreads work without any flags... yes 2024-04-24T23:02:04.174 INFO:tasks.workunit.client.0.smithi043.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-04-24T23:02:04.174 INFO:tasks.workunit.client.0.smithi043.stdout:checking if more special flags are required for pthreads... no 2024-04-24T23:02:04.174 INFO:tasks.workunit.client.0.smithi043.stdout:checking for cc_r... gcc 2024-04-24T23:02:04.273 INFO:tasks.workunit.client.0.smithi043.stdout:checking for setrlimit... yes 2024-04-24T23:02:04.365 INFO:tasks.workunit.client.0.smithi043.stdout:checking for setproctitle... no 2024-04-24T23:02:04.460 INFO:tasks.workunit.client.0.smithi043.stdout:checking for getopt_long... yes 2024-04-24T23:02:04.574 INFO:tasks.workunit.client.0.smithi043.stdout:checking for strtoull... yes 2024-04-24T23:02:04.683 INFO:tasks.workunit.client.0.smithi043.stdout:checking for strtoq... yes 2024-04-24T23:02:04.783 INFO:tasks.workunit.client.0.smithi043.stdout:checking for snprintf... yes 2024-04-24T23:02:04.879 INFO:tasks.workunit.client.0.smithi043.stdout:checking for vsnprintf... yes 2024-04-24T23:02:04.978 INFO:tasks.workunit.client.0.smithi043.stdout:checking for vfprintf... yes 2024-04-24T23:02:05.069 INFO:tasks.workunit.client.0.smithi043.stdout:checking for gethostname... yes 2024-04-24T23:02:05.164 INFO:tasks.workunit.client.0.smithi043.stdout:checking for setlocale... yes 2024-04-24T23:02:05.260 INFO:tasks.workunit.client.0.smithi043.stdout:checking for sync... yes 2024-04-24T23:02:05.370 INFO:tasks.workunit.client.0.smithi043.stdout:checking whether snprintf is C99 conformant... done 2024-04-24T23:02:05.399 INFO:tasks.workunit.client.0.smithi043.stdout:configure: creating ./config.status 2024-04-24T23:02:05.687 INFO:tasks.workunit.client.0.smithi043.stdout:config.status: creating Makefile 2024-04-24T23:02:05.719 INFO:tasks.workunit.client.0.smithi043.stdout:config.status: creating src/Makefile 2024-04-24T23:02:05.750 INFO:tasks.workunit.client.0.smithi043.stdout:config.status: creating man/Makefile 2024-04-24T23:02:05.764 INFO:tasks.workunit.client.0.smithi043.stdout:config.status: creating config.h 2024-04-24T23:02:05.847 INFO:tasks.workunit.client.0.smithi043.stdout:config.status: executing depfiles commands 2024-04-24T23:02:06.038 INFO:tasks.workunit.client.0.smithi043.stderr:+ make 2024-04-24T23:02:06.054 INFO:tasks.workunit.client.0.smithi043.stdout:make all-recursive 2024-04-24T23:02:06.062 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-04-24T23:02:06.066 INFO:tasks.workunit.client.0.smithi043.stdout:Making all in src 2024-04-24T23:02:06.091 INFO:tasks.workunit.client.0.smithi043.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-04-24T23:02:06.091 INFO:tasks.workunit.client.0.smithi043.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-04-24T23:02:06.092 INFO:tasks.workunit.client.0.smithi043.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-04-24T23:02:06.251 INFO:tasks.workunit.client.0.smithi043.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-04-24T23:02:06.251 INFO:tasks.workunit.client.0.smithi043.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-04-24T23:02:06.462 INFO:tasks.workunit.client.0.smithi043.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-04-24T23:02:06.462 INFO:tasks.workunit.client.0.smithi043.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-04-24T23:02:06.719 INFO:tasks.workunit.client.0.smithi043.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-04-24T23:02:06.719 INFO:tasks.workunit.client.0.smithi043.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-04-24T23:02:06.970 INFO:tasks.workunit.client.0.smithi043.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-04-24T23:02:06.970 INFO:tasks.workunit.client.0.smithi043.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-04-24T23:02:07.208 INFO:tasks.workunit.client.0.smithi043.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-04-24T23:02:07.208 INFO:tasks.workunit.client.0.smithi043.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-04-24T23:02:07.472 INFO:tasks.workunit.client.0.smithi043.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-04-24T23:02:07.473 INFO:tasks.workunit.client.0.smithi043.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-04-24T23:02:08.048 INFO:tasks.workunit.client.0.smithi043.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-04-24T23:02:08.048 INFO:tasks.workunit.client.0.smithi043.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-04-24T23:02:08.238 INFO:tasks.workunit.client.0.smithi043.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-04-24T23:02:08.239 INFO:tasks.workunit.client.0.smithi043.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-04-24T23:02:08.401 INFO:tasks.workunit.client.0.smithi043.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-04-24T23:02:08.402 INFO:tasks.workunit.client.0.smithi043.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-04-24T23:02:08.517 INFO:tasks.workunit.client.0.smithi043.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-04-24T23:02:08.622 INFO:tasks.workunit.client.0.smithi043.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-04-24T23:02:08.622 INFO:tasks.workunit.client.0.smithi043.stdout:Making all in man 2024-04-24T23:02:08.634 INFO:tasks.workunit.client.0.smithi043.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-04-24T23:02:08.634 INFO:tasks.workunit.client.0.smithi043.stdout:make[2]: Nothing to be done for 'all'. 2024-04-24T23:02:08.634 INFO:tasks.workunit.client.0.smithi043.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-04-24T23:02:08.643 INFO:tasks.workunit.client.0.smithi043.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-04-24T23:02:08.646 INFO:tasks.workunit.client.0.smithi043.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-04-24T23:02:08.647 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-04-24T23:02:08.648 INFO:tasks.workunit.client.0.smithi043.stderr:+ cd src 2024-04-24T23:02:08.650 INFO:tasks.workunit.client.0.smithi043.stderr:+ mkdir blogtest_in 2024-04-24T23:02:08.653 INFO:tasks.workunit.client.0.smithi043.stdout:running blogbench 2024-04-24T23:02:08.653 INFO:tasks.workunit.client.0.smithi043.stderr:+ echo 'running blogbench' 2024-04-24T23:02:08.653 INFO:tasks.workunit.client.0.smithi043.stderr:+ ./blogbench -d blogtest_in 2024-04-24T23:02:08.653 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-04-24T23:02:08.654 INFO:tasks.workunit.client.0.smithi043.stdout:Frequency = 10 secs 2024-04-24T23:02:08.654 INFO:tasks.workunit.client.0.smithi043.stdout:Scratch dir = [blogtest_in] 2024-04-24T23:02:10.653 INFO:tasks.workunit.client.0.smithi043.stdout:Spawning 3 writers... 2024-04-24T23:02:10.653 INFO:tasks.workunit.client.0.smithi043.stdout:Spawning 1 rewriters... 2024-04-24T23:02:10.653 INFO:tasks.workunit.client.0.smithi043.stdout:Spawning 5 commenters... 2024-04-24T23:02:10.654 INFO:tasks.workunit.client.0.smithi043.stdout:Spawning 100 readers... 2024-04-24T23:02:10.655 INFO:tasks.workunit.client.0.smithi043.stdout:Benchmarking for 30 iterations. 2024-04-24T23:02:10.655 INFO:tasks.workunit.client.0.smithi043.stdout:The test will run during 5 minutes. 2024-04-24T23:02:10.655 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-04-24T23:02:10.655 INFO:tasks.workunit.client.0.smithi043.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-04-24T23:02:13.320 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:02:13.323 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:02:20.655 INFO:tasks.workunit.client.0.smithi043.stdout: 4 4190 383 1032 300 1628 629 2024-04-24T23:02:30.656 INFO:tasks.workunit.client.0.smithi043.stdout: 7 11027 244 8406 161 1862 207 2024-04-24T23:02:40.655 INFO:tasks.workunit.client.0.smithi043.stdout: 10 11976 98 9806 150 3520 53 2024-04-24T23:02:43.365 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:02:43.367 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:02:50.655 INFO:tasks.workunit.client.0.smithi043.stdout: 12 12049 167 9376 82 2812 91 2024-04-24T23:03:00.656 INFO:tasks.workunit.client.0.smithi043.stdout: 14 11477 146 8037 102 2837 247 2024-04-24T23:03:10.656 INFO:tasks.workunit.client.0.smithi043.stdout: 17 10339 105 6656 176 2526 447 2024-04-24T23:03:13.867 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:03:13.870 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:03:20.656 INFO:tasks.workunit.client.0.smithi043.stdout: 19 9792 180 7332 110 3922 321 2024-04-24T23:03:30.656 INFO:tasks.workunit.client.0.smithi043.stdout: 21 9757 167 6785 135 4530 255 2024-04-24T23:03:40.656 INFO:tasks.workunit.client.0.smithi043.stdout: 23 10507 146 7852 85 3884 254 2024-04-24T23:03:43.913 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:03:43.917 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:03:50.656 INFO:tasks.workunit.client.0.smithi043.stdout: 26 10378 191 7320 110 4137 187 2024-04-24T23:04:00.656 INFO:tasks.workunit.client.0.smithi043.stdout: 28 10486 184 7324 139 3787 147 2024-04-24T23:04:10.656 INFO:tasks.workunit.client.0.smithi043.stdout: 30 10097 146 6921 67 3193 143 2024-04-24T23:04:14.050 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:04:14.053 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:04:20.656 INFO:tasks.workunit.client.0.smithi043.stdout: 32 11201 96 7113 119 3609 92 2024-04-24T23:04:30.656 INFO:tasks.workunit.client.0.smithi043.stdout: 35 11106 137 7240 124 3483 89 2024-04-24T23:04:40.656 INFO:tasks.workunit.client.0.smithi043.stdout: 36 10748 141 7192 59 3312 81 2024-04-24T23:04:44.362 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:04:44.364 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:04:50.656 INFO:tasks.workunit.client.0.smithi043.stdout: 37 10290 108 7480 69 3700 81 2024-04-24T23:05:00.656 INFO:tasks.workunit.client.0.smithi043.stdout: 39 10652 194 6850 74 3156 54 2024-04-24T23:05:10.656 INFO:tasks.workunit.client.0.smithi043.stdout: 41 10811 86 7018 120 3331 62 2024-04-24T23:05:14.712 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:05:14.715 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:05:20.656 INFO:tasks.workunit.client.0.smithi043.stdout: 43 10760 129 7052 92 3514 82 2024-04-24T23:05:30.656 INFO:tasks.workunit.client.0.smithi043.stdout: 43 10699 117 7475 62 3454 103 2024-04-24T23:05:40.656 INFO:tasks.workunit.client.0.smithi043.stdout: 45 10782 84 7140 79 3258 84 2024-04-24T23:05:44.771 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:05:44.773 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:05:50.656 INFO:tasks.workunit.client.0.smithi043.stdout: 46 10338 133 6978 57 3514 98 2024-04-24T23:06:00.656 INFO:tasks.workunit.client.0.smithi043.stdout: 49 10976 83 7216 109 2627 108 2024-04-24T23:06:10.657 INFO:tasks.workunit.client.0.smithi043.stdout: 49 10781 95 7913 51 3443 83 2024-04-24T23:06:15.206 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:06:15.208 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:06:20.658 INFO:tasks.workunit.client.0.smithi043.stdout: 49 10548 83 6674 86 3665 110 2024-04-24T23:06:30.657 INFO:tasks.workunit.client.0.smithi043.stdout: 51 10740 69 7076 48 3970 59 2024-04-24T23:06:40.658 INFO:tasks.workunit.client.0.smithi043.stdout: 52 10916 90 7487 68 3426 43 2024-04-24T23:06:45.612 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:06:45.616 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:06:45.638 INFO:tasks.ceph.mds.a.smithi043.stderr:2024-04-24T23:06:45.631+0000 7f1d0d0c7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 139815) UID: 0 2024-04-24T23:06:50.656 INFO:tasks.workunit.client.0.smithi043.stdout: 53 10793 90 7187 53 3070 51 2024-04-24T23:07:00.657 INFO:tasks.workunit.client.0.smithi043.stdout: 53 10105 39 6613 120 2887 70 2024-04-24T23:07:10.802 INFO:tasks.workunit.client.0.smithi043.stdout: 55 9631 56 6555 82 3603 67 2024-04-24T23:07:15.527 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-04-24T23:07:15.527 INFO:tasks.workunit.client.0.smithi043.stdout:Final score for writes: 55 2024-04-24T23:07:15.527 INFO:tasks.workunit.client.0.smithi043.stdout:Final score for reads : 5681 2024-04-24T23:07:15.527 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-04-24T23:07:15.735 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-24T23:07:15.736 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-24T23:07:53.987 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-04-24T23:07:53.988 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-24T23:07:54.258 DEBUG:teuthology.parallel:result is None 2024-04-24T23:07:54.258 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-24T23:07:54.279 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-24T23:07:54.279 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-24T23:07:54.297 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:07:54.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.742+0000 7f67bde6a640 1 Processor -- start 2024-04-24T23:07:54.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.742+0000 7f67bde6a640 1 -- start start 2024-04-24T23:07:54.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.742+0000 7f67bde6a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67b80b3590 0x7f67b80b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:54.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.742+0000 7f67bde6a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f67b80afa80 0x7f67b80b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:54.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.742+0000 7f67bde6a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b80b28f0 con 0x7f67b806cb30 2024-04-24T23:07:54.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.742+0000 7f67bde6a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f67b80b1bd0 con 0x7f67b80afa80 2024-04-24T23:07:54.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.742+0000 7f67bde6a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f67b806cf10 con 0x7f67b80b3590 2024-04-24T23:07:54.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.742+0000 7f67b7fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f67b80afa80 0x7f67b80b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:54.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.742+0000 7f67b7fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f67b80afa80 0x7f67b80b4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.43:49996/0 (socket says 172.21.15.43:49996) 2024-04-24T23:07:54.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.742+0000 7f67b7fff640 1 -- 172.21.15.43:0/181964258 learned_addr learned my addr 172.21.15.43:0/181964258 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:54.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.742+0000 7f67b6ffd640 1 --2- 172.21.15.43:0/181964258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67b80b3590 0x7f67b80b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:54.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.742+0000 7f67b7fff640 1 -- 172.21.15.43:0/181964258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67b80b3590 msgr2=0x7f67b80b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:54.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.742+0000 7f67b7fff640 1 --2- 172.21.15.43:0/181964258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67b80b3590 0x7f67b80b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:54.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.742+0000 7f67b7fff640 1 -- 172.21.15.43:0/181964258 >> v1:172.21.15.162:6789/0 conn(0x7f67b806cb30 legacy=0x7f67b814c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:54.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.742+0000 7f67b7fff640 1 -- 172.21.15.43:0/181964258 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b80b4650 con 0x7f67b80afa80 2024-04-24T23:07:54.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.746+0000 7f67b7fff640 1 --2- 172.21.15.43:0/181964258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67b80afa80 0x7f67b80b4110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009e50 tx=0x7f67b001c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dc10d6b43adfee0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:54.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.746+0000 7f67b67fc640 1 -- 172.21.15.43:0/181964258 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b00a56d0 con 0x7f67b80afa80 2024-04-24T23:07:54.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.746+0000 7f67b67fc640 1 -- 172.21.15.43:0/181964258 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b00a5870 con 0x7f67b80afa80 2024-04-24T23:07:54.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.746+0000 7f67b67fc640 1 -- 172.21.15.43:0/181964258 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b00a5c40 con 0x7f67b80afa80 2024-04-24T23:07:54.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.750+0000 7f67bde6a640 1 -- 172.21.15.43:0/181964258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67b80afa80 msgr2=0x7f67b80b4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:54.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.750+0000 7f67bde6a640 1 --2- 172.21.15.43:0/181964258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67b80afa80 0x7f67b80b4110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009e50 tx=0x7f67b001c960 comp rx=0 tx=0).stop 2024-04-24T23:07:54.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.750+0000 7f67bde6a640 1 -- 172.21.15.43:0/181964258 shutdown_connections 2024-04-24T23:07:54.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.750+0000 7f67bde6a640 1 --2- 172.21.15.43:0/181964258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67b80b3590 0x7f67b80b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:54.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.750+0000 7f67bde6a640 1 --2- 172.21.15.43:0/181964258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67b80afa80 0x7f67b80b4110 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:54.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.750+0000 7f67bde6a640 1 -- 172.21.15.43:0/181964258 >> 172.21.15.43:0/181964258 conn(0x7f67b80b8d60 msgr2=0x7f67b80b9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:54.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.750+0000 7f67bde6a640 1 -- 172.21.15.43:0/181964258 shutdown_connections 2024-04-24T23:07:54.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.750+0000 7f67bde6a640 1 -- 172.21.15.43:0/181964258 wait complete. 2024-04-24T23:07:54.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67bde6a640 1 Processor -- start 2024-04-24T23:07:54.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67bde6a640 1 -- start start 2024-04-24T23:07:54.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67bde6a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67b806cb30 0x7f67b8150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:54.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67bde6a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b80afa80 0x7f67b8071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:54.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67bde6a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67b80b3590 0x7f67b8146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:54.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67bde6a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f67b80b2e90 con 0x7f67b80afa80 2024-04-24T23:07:54.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67bde6a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f67b80b2d10 con 0x7f67b80b3590 2024-04-24T23:07:54.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67bde6a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f67b8156b10 con 0x7f67b806cb30 2024-04-24T23:07:54.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67b6ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b80afa80 0x7f67b8071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:54.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67b6ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b80afa80 0x7f67b8071a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50546/0 (socket says 172.21.15.43:50546) 2024-04-24T23:07:54.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67b6ffd640 1 -- 172.21.15.43:0/34453249 learned_addr learned my addr 172.21.15.43:0/34453249 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:54.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67b7fff640 1 --2- 172.21.15.43:0/34453249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67b80b3590 0x7f67b8146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:54.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67b6ffd640 1 -- 172.21.15.43:0/34453249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67b806cb30 msgr2=0x7f67b8150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:54.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67b6ffd640 1 --2- 172.21.15.43:0/34453249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67b806cb30 0x7f67b8150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:54.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67b6ffd640 1 -- 172.21.15.43:0/34453249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67b80b3590 msgr2=0x7f67b8146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:54.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67b6ffd640 1 --2- 172.21.15.43:0/34453249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67b80b3590 0x7f67b8146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:54.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67b6ffd640 1 -- 172.21.15.43:0/34453249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b8150dc0 con 0x7f67b80afa80 2024-04-24T23:07:54.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67b6ffd640 1 --2- 172.21.15.43:0/34453249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b80afa80 0x7f67b8071a00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f67a800e840 tx=0x7f67a800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:54.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f679ffff640 1 -- 172.21.15.43:0/34453249 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8017070 con 0x7f67b80afa80 2024-04-24T23:07:54.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f679ffff640 1 -- 172.21.15.43:0/34453249 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a800ee90 con 0x7f67b80afa80 2024-04-24T23:07:54.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67bde6a640 1 -- 172.21.15.43:0/34453249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b81510a0 con 0x7f67b80afa80 2024-04-24T23:07:54.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f679ffff640 1 -- 172.21.15.43:0/34453249 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a800cb80 con 0x7f67b80afa80 2024-04-24T23:07:54.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f67bde6a640 1 -- 172.21.15.43:0/34453249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b8149390 con 0x7f67b80afa80 2024-04-24T23:07:54.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.754+0000 7f679dffb640 1 -- 172.21.15.43:0/34453249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67900052a0 con 0x7f67b80afa80 2024-04-24T23:07:54.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.758+0000 7f679ffff640 1 -- 172.21.15.43:0/34453249 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f67a801a070 con 0x7f67b80afa80 2024-04-24T23:07:54.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.758+0000 7f679ffff640 1 --2- 172.21.15.43:0/34453249 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f67a40678f0 0x7f67a4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:54.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.758+0000 7f679ffff640 1 -- 172.21.15.43:0/34453249 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f67a8086240 con 0x7f67b80afa80 2024-04-24T23:07:54.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.758+0000 7f67b77fe640 1 --2- 172.21.15.43:0/34453249 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f67a40678f0 0x7f67a4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:54.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.758+0000 7f67b77fe640 1 --2- 172.21.15.43:0/34453249 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f67a40678f0 0x7f67a4069db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f67b80b8840 tx=0x7f67ac0079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:54.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:54.774+0000 7f679ffff640 1 -- 172.21.15.43:0/34453249 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f67a8056a40 con 0x7f67b80afa80 2024-04-24T23:07:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.178+0000 7f679dffb640 1 -- 172.21.15.43:0/34453249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6790005590 con 0x7f67b80afa80 2024-04-24T23:07:55.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.178+0000 7f679ffff640 1 -- 172.21.15.43:0/34453249 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18754 (secure 0 0 0) 0x7f67a8056a40 con 0x7f67b80afa80 2024-04-24T23:07:55.182 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:07:55.182 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:57.637496+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":5}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.1a","mappings":[{"from":7,"to":4}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:07:55.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.182+0000 7f679dffb640 1 -- 172.21.15.43:0/34453249 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f67a40678f0 msgr2=0x7f67a4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.182+0000 7f679dffb640 1 --2- 172.21.15.43:0/34453249 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f67a40678f0 0x7f67a4069db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f67b80b8840 tx=0x7f67ac0079c0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.182+0000 7f679dffb640 1 -- 172.21.15.43:0/34453249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b80afa80 msgr2=0x7f67b8071a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.182+0000 7f679dffb640 1 --2- 172.21.15.43:0/34453249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b80afa80 0x7f67b8071a00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f67a800e840 tx=0x7f67a800ec40 comp rx=0 tx=0).stop 2024-04-24T23:07:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.182+0000 7f679dffb640 1 -- 172.21.15.43:0/34453249 shutdown_connections 2024-04-24T23:07:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.182+0000 7f679dffb640 1 --2- 172.21.15.43:0/34453249 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f67a40678f0 0x7f67a4069db0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.182+0000 7f679dffb640 1 --2- 172.21.15.43:0/34453249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67b80b3590 0x7f67b8146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.182+0000 7f679dffb640 1 --2- 172.21.15.43:0/34453249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b80afa80 0x7f67b8071a00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.182+0000 7f679dffb640 1 --2- 172.21.15.43:0/34453249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67b806cb30 0x7f67b8150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.182+0000 7f679dffb640 1 -- 172.21.15.43:0/34453249 >> 172.21.15.43:0/34453249 conn(0x7f67b80b8d60 msgr2=0x7f67b80b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.182+0000 7f679dffb640 1 -- 172.21.15.43:0/34453249 shutdown_connections 2024-04-24T23:07:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.182+0000 7f679dffb640 1 -- 172.21.15.43:0/34453249 wait complete. 2024-04-24T23:07:55.211 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:00:02.322280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:00:14.136303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:00:14.764010+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T23:00:18.504756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:07:55.212 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:07:55.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f86a31640 1 Processor -- start 2024-04-24T23:07:55.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f86a31640 1 -- start start 2024-04-24T23:07:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f86a31640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9f80061e90 0x7f9f80144230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f86a31640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f80070610 con 0x7f9f800b5a60 2024-04-24T23:07:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f86a31640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f80062270 con 0x7f9f80147820 2024-04-24T23:07:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f86a31640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9f80148790 con 0x7f9f80061e90 2024-04-24T23:07:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f84fce640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9f800b5a60 0x7f9f8014ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33044/0 (socket says 172.21.15.43:33044) 2024-04-24T23:07:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f84fce640 1 -- 172.21.15.43:0/574645362 learned_addr learned my addr 172.21.15.43:0/574645362 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:07:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7effd640 1 -- 172.21.15.43:0/574645362 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512145708 0 0) 0x7f9f80070610 con 0x7f9f800b5a60 2024-04-24T23:07:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7ffff640 1 --2- 172.21.15.43:0/574645362 >> v2:172.21.15.162:3300/0 conn(0x7f9f80061e90 0x7f9f80144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7effd640 1 -- 172.21.15.43:0/574645362 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f68003530 con 0x7f9f800b5a60 2024-04-24T23:07:55.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7effd640 1 -- 172.21.15.43:0/574645362 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2651257994 0 0) 0x7f9f68003530 con 0x7f9f800b5a60 2024-04-24T23:07:55.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7effd640 1 -- 172.21.15.43:0/574645362 >> v2:172.21.15.162:3300/0 conn(0x7f9f80061e90 msgr2=0x7f9f80144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:55.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7effd640 1 --2- 172.21.15.43:0/574645362 >> v2:172.21.15.162:3300/0 conn(0x7f9f80061e90 0x7f9f80144230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7effd640 1 -- 172.21.15.43:0/574645362 >> v1:172.21.15.162:6789/0 conn(0x7f9f80147820 legacy=0x7f9f8013dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7effd640 1 -- 172.21.15.43:0/574645362 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f80147cb0 con 0x7f9f800b5a60 2024-04-24T23:07:55.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7effd640 1 -- 172.21.15.43:0/574645362 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f9f78001a00 con 0x7f9f800b5a60 2024-04-24T23:07:55.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7ffff640 1 --2- 172.21.15.43:0/574645362 >> v2:172.21.15.162:3300/0 conn(0x7f9f80061e90 0x7f9f80144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:07:55.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7effd640 1 -- 172.21.15.43:0/574645362 >> v1:172.21.15.43:6789/0 conn(0x7f9f800b5a60 legacy=0x7f9f8014ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7effd640 1 --2- 172.21.15.43:0/574645362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f68003a10 0x7f9f68003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7effd640 1 --2- 172.21.15.43:0/574645362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f68004810 0x7f9f68004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7effd640 1 --2- 172.21.15.43:0/574645362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f680053d0 0x7f9f6800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7effd640 1 -- 172.21.15.43:0/574645362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9f80148790 con 0x7f9f68004810 2024-04-24T23:07:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7effd640 1 -- 172.21.15.43:0/574645362 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6800c2b0 con 0x7f9f680053d0 2024-04-24T23:07:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7effd640 1 -- 172.21.15.43:0/574645362 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6800c4b0 con 0x7f9f68003a10 2024-04-24T23:07:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7f7fe640 1 --2- 172.21.15.43:0/574645362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f68004810 0x7f9f68004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f84fce640 1 --2- 172.21.15.43:0/574645362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f680053d0 0x7f9f6800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7ffff640 1 --2- 172.21.15.43:0/574645362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f68003a10 0x7f9f68003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7f7fe640 1 -- 172.21.15.43:0/574645362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f68003a10 msgr2=0x7f9f68003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7f7fe640 1 --2- 172.21.15.43:0/574645362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f68003a10 0x7f9f68003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7f7fe640 1 -- 172.21.15.43:0/574645362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f680053d0 msgr2=0x7f9f6800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7f7fe640 1 --2- 172.21.15.43:0/574645362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f680053d0 0x7f9f6800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f7f7fe640 1 -- 172.21.15.43:0/574645362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f68003530 con 0x7f9f68004810 2024-04-24T23:07:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.334+0000 7f9f84fce640 1 -- 172.21.15.43:0/574645362 reap_dead start 2024-04-24T23:07:55.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.338+0000 7f9f7f7fe640 1 --2- 172.21.15.43:0/574645362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f68004810 0x7f9f68004c90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9f74001750 tx=0x7f9f7401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26acc59f97126993 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:55.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.338+0000 7f9f7effd640 1 -- 172.21.15.43:0/574645362 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f740013a0 con 0x7f9f68004810 2024-04-24T23:07:55.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.338+0000 7f9f7effd640 1 -- 172.21.15.43:0/574645362 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f740052f0 con 0x7f9f68004810 2024-04-24T23:07:55.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.338+0000 7f9f7effd640 1 -- 172.21.15.43:0/574645362 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f74003840 con 0x7f9f68004810 2024-04-24T23:07:55.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.338+0000 7f9f86a31640 1 -- 172.21.15.43:0/574645362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f68004810 msgr2=0x7f9f68004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.338+0000 7f9f86a31640 1 --2- 172.21.15.43:0/574645362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f68004810 0x7f9f68004c90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9f74001750 tx=0x7f9f7401c390 comp rx=0 tx=0).stop 2024-04-24T23:07:55.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.338+0000 7f9f86a31640 1 -- 172.21.15.43:0/574645362 shutdown_connections 2024-04-24T23:07:55.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.338+0000 7f9f86a31640 1 --2- 172.21.15.43:0/574645362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f68004810 0x7f9f68004c90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.338+0000 7f9f86a31640 1 -- 172.21.15.43:0/574645362 >> 172.21.15.43:0/574645362 conn(0x7f9f800b93e0 msgr2=0x7f9f800b97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:55.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.338+0000 7f9f86a31640 1 -- 172.21.15.43:0/574645362 shutdown_connections 2024-04-24T23:07:55.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.338+0000 7f9f86a31640 1 -- 172.21.15.43:0/574645362 wait complete. 2024-04-24T23:07:55.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f86a31640 1 Processor -- start 2024-04-24T23:07:55.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f86a31640 1 -- start start 2024-04-24T23:07:55.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f86a31640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f68004810 0x7f9f80070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f86a31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f801e0060 0x7f9f801e04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f86a31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f801381c0 0x7f9f80138640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f86a31640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8013de60 con 0x7f9f68004810 2024-04-24T23:07:55.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f86a31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8013dce0 con 0x7f9f801381c0 2024-04-24T23:07:55.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f86a31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9f8013dfe0 con 0x7f9f801e0060 2024-04-24T23:07:55.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f68004810 0x7f9f80070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f68004810 0x7f9f80070c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50556/0 (socket says 172.21.15.43:50556) 2024-04-24T23:07:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7ffff640 1 -- 172.21.15.43:0/217848486 learned_addr learned my addr 172.21.15.43:0/217848486 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7ffff640 1 -- 172.21.15.43:0/217848486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f801e0060 msgr2=0x7f9f801e04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f84fce640 1 --2- 172.21.15.43:0/217848486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f801381c0 0x7f9f80138640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7f7fe640 1 --2- 172.21.15.43:0/217848486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f801e0060 0x7f9f801e04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7ffff640 1 --2- 172.21.15.43:0/217848486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f801e0060 0x7f9f801e04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7ffff640 1 -- 172.21.15.43:0/217848486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f801381c0 msgr2=0x7f9f80138640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7ffff640 1 --2- 172.21.15.43:0/217848486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f801381c0 0x7f9f80138640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7ffff640 1 -- 172.21.15.43:0/217848486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f80073110 con 0x7f9f68004810 2024-04-24T23:07:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f84fce640 1 --2- 172.21.15.43:0/217848486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f801381c0 0x7f9f80138640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7ffff640 1 --2- 172.21.15.43:0/217848486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f68004810 0x7f9f80070c50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000f5b0 tx=0x7f9f7000fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7cff9640 1 -- 172.21.15.43:0/217848486 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f70018070 con 0x7f9f68004810 2024-04-24T23:07:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7cff9640 1 -- 172.21.15.43:0/217848486 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f70014890 con 0x7f9f68004810 2024-04-24T23:07:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f86a31640 1 -- 172.21.15.43:0/217848486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f801e0a20 con 0x7f9f68004810 2024-04-24T23:07:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7cff9640 1 -- 172.21.15.43:0/217848486 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f70014c60 con 0x7f9f68004810 2024-04-24T23:07:55.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f86a31640 1 -- 172.21.15.43:0/217848486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f80071da0 con 0x7f9f68004810 2024-04-24T23:07:55.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f86a31640 1 -- 172.21.15.43:0/217848486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f8004f580 con 0x7f9f68004810 2024-04-24T23:07:55.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7cff9640 1 -- 172.21.15.43:0/217848486 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9f7001b070 con 0x7f9f68004810 2024-04-24T23:07:55.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7cff9640 1 --2- 172.21.15.43:0/217848486 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9f6c0678f0 0x7f9f6c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7cff9640 1 -- 172.21.15.43:0/217848486 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f9f700866c0 con 0x7f9f68004810 2024-04-24T23:07:55.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.342+0000 7f9f7f7fe640 1 --2- 172.21.15.43:0/217848486 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9f6c0678f0 0x7f9f6c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.346+0000 7f9f7f7fe640 1 --2- 172.21.15.43:0/217848486 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9f6c0678f0 0x7f9f6c069db0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f80141e20 tx=0x7f9f740011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:55.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.346+0000 7f9f7cff9640 1 -- 172.21.15.43:0/217848486 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9f70056fa0 con 0x7f9f68004810 2024-04-24T23:07:55.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.506+0000 7f9f86a31640 1 -- 172.21.15.43:0/217848486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9f800702c0 con 0x7f9f68004810 2024-04-24T23:07:55.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.506+0000 7f9f7cff9640 1 -- 172.21.15.43:0/217848486 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f9f700568a0 con 0x7f9f68004810 2024-04-24T23:07:55.509 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-24T23:07:55.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.510+0000 7f9f86a31640 1 -- 172.21.15.43:0/217848486 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9f6c0678f0 msgr2=0x7f9f6c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.510+0000 7f9f86a31640 1 --2- 172.21.15.43:0/217848486 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9f6c0678f0 0x7f9f6c069db0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f80141e20 tx=0x7f9f740011a0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.510+0000 7f9f86a31640 1 -- 172.21.15.43:0/217848486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f68004810 msgr2=0x7f9f80070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.510+0000 7f9f86a31640 1 --2- 172.21.15.43:0/217848486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f68004810 0x7f9f80070c50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000f5b0 tx=0x7f9f7000fa70 comp rx=0 tx=0).stop 2024-04-24T23:07:55.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.510+0000 7f9f86a31640 1 -- 172.21.15.43:0/217848486 shutdown_connections 2024-04-24T23:07:55.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.510+0000 7f9f86a31640 1 --2- 172.21.15.43:0/217848486 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f9f6c0678f0 0x7f9f6c069db0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.510+0000 7f9f86a31640 1 --2- 172.21.15.43:0/217848486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f801381c0 0x7f9f80138640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.510+0000 7f9f86a31640 1 --2- 172.21.15.43:0/217848486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f801e0060 0x7f9f801e04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.510+0000 7f9f86a31640 1 --2- 172.21.15.43:0/217848486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f68004810 0x7f9f80070c50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.510+0000 7f9f86a31640 1 -- 172.21.15.43:0/217848486 >> 172.21.15.43:0/217848486 conn(0x7f9f800b93e0 msgr2=0x7f9f800b1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:55.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.510+0000 7f9f86a31640 1 -- 172.21.15.43:0/217848486 shutdown_connections 2024-04-24T23:07:55.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.510+0000 7f9f86a31640 1 -- 172.21.15.43:0/217848486 wait complete. 2024-04-24T23:07:55.527 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:07:55.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.646+0000 7ff32808c640 1 Processor -- start 2024-04-24T23:07:55.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.646+0000 7ff32808c640 1 -- start start 2024-04-24T23:07:55.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff32808c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff320141bd0 0x7ff320152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff32808c640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3200b5ab0 con 0x7ff320072c30 2024-04-24T23:07:55.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff32808c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff320071110 con 0x7ff320070d30 2024-04-24T23:07:55.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff32808c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff3200b4fd0 con 0x7ff320141bd0 2024-04-24T23:07:55.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff325627640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff320072c30 0x7ff3201414c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33048/0 (socket says 172.21.15.43:33048) 2024-04-24T23:07:55.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff325627640 1 -- 172.21.15.43:0/3446221123 learned_addr learned my addr 172.21.15.43:0/3446221123 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:07:55.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff326629640 1 --2- 172.21.15.43:0/3446221123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff320141bd0 0x7ff320152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff324e26640 1 -- 172.21.15.43:0/3446221123 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207472538 0 0) 0x7ff310001120 con 0x7ff320072c30 2024-04-24T23:07:55.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff324e26640 1 -- 172.21.15.43:0/3446221123 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff30c003530 con 0x7ff320072c30 2024-04-24T23:07:55.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff324e26640 1 -- 172.21.15.43:0/3446221123 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2969075950 0 0) 0x7ff30c003530 con 0x7ff320072c30 2024-04-24T23:07:55.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff324e26640 1 -- 172.21.15.43:0/3446221123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff320141bd0 msgr2=0x7ff320152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff324e26640 1 --2- 172.21.15.43:0/3446221123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff320141bd0 0x7ff320152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff324e26640 1 -- 172.21.15.43:0/3446221123 >> v1:172.21.15.162:6789/0 conn(0x7ff320070d30 legacy=0x7ff3200b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff324e26640 1 -- 172.21.15.43:0/3446221123 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3200b52b0 con 0x7ff320072c30 2024-04-24T23:07:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff324e26640 1 -- 172.21.15.43:0/3446221123 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7ff310001850 con 0x7ff320072c30 2024-04-24T23:07:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff324e26640 1 -- 172.21.15.43:0/3446221123 >> v1:172.21.15.43:6789/0 conn(0x7ff320072c30 legacy=0x7ff3201414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff324e26640 1 --2- 172.21.15.43:0/3446221123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff320141bd0 0x7ff30c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff324e26640 1 --2- 172.21.15.43:0/3446221123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff30c003f70 0x7ff30c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff324e26640 1 --2- 172.21.15.43:0/3446221123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff30c004d50 0x7ff30c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff324e26640 1 -- 172.21.15.43:0/3446221123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff3200b4fd0 con 0x7ff30c004d50 2024-04-24T23:07:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff324e26640 1 -- 172.21.15.43:0/3446221123 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c00bab0 con 0x7ff30c003f70 2024-04-24T23:07:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff324e26640 1 -- 172.21.15.43:0/3446221123 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff30c00bcb0 con 0x7ff320141bd0 2024-04-24T23:07:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff326629640 1 --2- 172.21.15.43:0/3446221123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff30c004d50 0x7ff30c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff325e28640 1 --2- 172.21.15.43:0/3446221123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff320141bd0 0x7ff30c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff326629640 1 -- 172.21.15.43:0/3446221123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff320141bd0 msgr2=0x7ff30c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff326629640 1 --2- 172.21.15.43:0/3446221123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff320141bd0 0x7ff30c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff325627640 1 --2- 172.21.15.43:0/3446221123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff30c003f70 0x7ff30c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff326629640 1 -- 172.21.15.43:0/3446221123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff30c003f70 msgr2=0x7ff30c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:55.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff326629640 1 --2- 172.21.15.43:0/3446221123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff30c003f70 0x7ff30c004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff326629640 1 -- 172.21.15.43:0/3446221123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c003530 con 0x7ff30c004d50 2024-04-24T23:07:55.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.650+0000 7ff325e28640 1 --2- 172.21.15.43:0/3446221123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff320141bd0 0x7ff30c0039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:55.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff326629640 1 --2- 172.21.15.43:0/3446221123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff30c004d50 0x7ff30c0051d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff320141fe0 tx=0x7ff31801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23de2abe8e187ea8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:55.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff324e26640 1 -- 172.21.15.43:0/3446221123 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180b2070 con 0x7ff30c004d50 2024-04-24T23:07:55.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff324e26640 1 -- 172.21.15.43:0/3446221123 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3180a5c30 con 0x7ff30c004d50 2024-04-24T23:07:55.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff324e26640 1 -- 172.21.15.43:0/3446221123 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff318009c10 con 0x7ff30c004d50 2024-04-24T23:07:55.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 -- 172.21.15.43:0/3446221123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff30c004d50 msgr2=0x7ff30c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 --2- 172.21.15.43:0/3446221123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff30c004d50 0x7ff30c0051d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff320141fe0 tx=0x7ff31801cc20 comp rx=0 tx=0).stop 2024-04-24T23:07:55.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff326629640 1 -- 172.21.15.43:0/3446221123 reap_dead start 2024-04-24T23:07:55.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 -- 172.21.15.43:0/3446221123 shutdown_connections 2024-04-24T23:07:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 -- 172.21.15.43:0/3446221123 >> 172.21.15.43:0/3446221123 conn(0x7ff32006c300 msgr2=0x7ff32006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 -- 172.21.15.43:0/3446221123 shutdown_connections 2024-04-24T23:07:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 -- 172.21.15.43:0/3446221123 wait complete. 2024-04-24T23:07:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 Processor -- start 2024-04-24T23:07:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 -- start start 2024-04-24T23:07:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff320142270 0x7ff3201dd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3201d36c0 0x7ff3201dde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff320142650 0x7ff32013ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff3200b67a0 con 0x7ff320142650 2024-04-24T23:07:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff3200730a0 con 0x7ff320142270 2024-04-24T23:07:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff3201d26e0 con 0x7ff3201d36c0 2024-04-24T23:07:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff326629640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff320142650 0x7ff32013ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff326629640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff320142650 0x7ff32013ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50578/0 (socket says 172.21.15.43:50578) 2024-04-24T23:07:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff326629640 1 -- 172.21.15.43:0/1954336999 learned_addr learned my addr 172.21.15.43:0/1954336999 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff325e28640 1 --2- 172.21.15.43:0/1954336999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff320142270 0x7ff3201dd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff325627640 1 --2- 172.21.15.43:0/1954336999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3201d36c0 0x7ff3201dde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff326629640 1 -- 172.21.15.43:0/1954336999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3201d36c0 msgr2=0x7ff3201dde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff326629640 1 --2- 172.21.15.43:0/1954336999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3201d36c0 0x7ff3201dde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff326629640 1 -- 172.21.15.43:0/1954336999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff320142270 msgr2=0x7ff3201dd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff326629640 1 --2- 172.21.15.43:0/1954336999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff320142270 0x7ff3201dd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff326629640 1 -- 172.21.15.43:0/1954336999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3201d2930 con 0x7ff320142650 2024-04-24T23:07:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff325e28640 1 --2- 172.21.15.43:0/1954336999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff320142270 0x7ff3201dd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff326629640 1 --2- 172.21.15.43:0/1954336999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff320142650 0x7ff32013ad10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff3180b0040 tx=0x7ff318009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff3167fc640 1 -- 172.21.15.43:0/1954336999 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180bd070 con 0x7ff320142650 2024-04-24T23:07:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff3167fc640 1 -- 172.21.15.43:0/1954336999 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3180a5a30 con 0x7ff320142650 2024-04-24T23:07:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 -- 172.21.15.43:0/1954336999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3200b0980 con 0x7ff320142650 2024-04-24T23:07:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff3167fc640 1 -- 172.21.15.43:0/1954336999 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180b2040 con 0x7ff320142650 2024-04-24T23:07:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.654+0000 7ff32808c640 1 -- 172.21.15.43:0/1954336999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff32013b250 con 0x7ff320142650 2024-04-24T23:07:55.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.658+0000 7ff32808c640 1 -- 172.21.15.43:0/1954336999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff32004f580 con 0x7ff320142650 2024-04-24T23:07:55.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.658+0000 7ff3167fc640 1 -- 172.21.15.43:0/1954336999 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3180c0070 con 0x7ff320142650 2024-04-24T23:07:55.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.658+0000 7ff3167fc640 1 --2- 172.21.15.43:0/1954336999 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff3040678f0 0x7ff304069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:55.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.658+0000 7ff3167fc640 1 -- 172.21.15.43:0/1954336999 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7ff31811fd10 con 0x7ff320142650 2024-04-24T23:07:55.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.658+0000 7ff325e28640 1 --2- 172.21.15.43:0/1954336999 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff3040678f0 0x7ff304069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:55.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.658+0000 7ff325e28640 1 --2- 172.21.15.43:0/1954336999 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff3040678f0 0x7ff304069db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff31c001720 tx=0x7ff31c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:55.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.662+0000 7ff3167fc640 1 -- 172.21.15.43:0/1954336999 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ff318016930 con 0x7ff320142650 2024-04-24T23:07:55.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.978+0000 7ff32808c640 1 -- 172.21.15.43:0/1954336999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff32013df40 con 0x7ff320142650 2024-04-24T23:07:55.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.978+0000 7ff3167fc640 1 -- 172.21.15.43:0/1954336999 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7ff3180effe0 con 0x7ff320142650 2024-04-24T23:07:55.980 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-24T23:07:55.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.978+0000 7ff32808c640 1 -- 172.21.15.43:0/1954336999 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff3040678f0 msgr2=0x7ff304069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.978+0000 7ff32808c640 1 --2- 172.21.15.43:0/1954336999 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff3040678f0 0x7ff304069db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff31c001720 tx=0x7ff31c009040 comp rx=0 tx=0).stop 2024-04-24T23:07:55.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.978+0000 7ff32808c640 1 -- 172.21.15.43:0/1954336999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff320142650 msgr2=0x7ff32013ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:55.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.978+0000 7ff32808c640 1 --2- 172.21.15.43:0/1954336999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff320142650 0x7ff32013ad10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff3180b0040 tx=0x7ff318009750 comp rx=0 tx=0).stop 2024-04-24T23:07:55.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.978+0000 7ff32808c640 1 -- 172.21.15.43:0/1954336999 shutdown_connections 2024-04-24T23:07:55.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.978+0000 7ff32808c640 1 --2- 172.21.15.43:0/1954336999 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff3040678f0 0x7ff304069db0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.978+0000 7ff32808c640 1 --2- 172.21.15.43:0/1954336999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff320142650 0x7ff32013ad10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.978+0000 7ff32808c640 1 --2- 172.21.15.43:0/1954336999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3201d36c0 0x7ff3201dde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.978+0000 7ff32808c640 1 --2- 172.21.15.43:0/1954336999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff320142270 0x7ff3201dd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:55.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.978+0000 7ff32808c640 1 -- 172.21.15.43:0/1954336999 >> 172.21.15.43:0/1954336999 conn(0x7ff32006c300 msgr2=0x7ff32013f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:55.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.978+0000 7ff32808c640 1 -- 172.21.15.43:0/1954336999 shutdown_connections 2024-04-24T23:07:55.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:55.978+0000 7ff32808c640 1 -- 172.21.15.43:0/1954336999 wait complete. 2024-04-24T23:07:55.999 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:07:56.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.114+0000 7f26d2512640 1 Processor -- start 2024-04-24T23:07:56.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.114+0000 7f26d2512640 1 -- start start 2024-04-24T23:07:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.114+0000 7f26d2512640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26cc072f40 0x7f26cc145500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.114+0000 7f26d2512640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f26cc06be60 0x7f26cc145a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.114+0000 7f26d2512640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26cc0b5720 con 0x7f26cc0b4ed0 2024-04-24T23:07:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.114+0000 7f26d2512640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f26cc0b61c0 con 0x7f26cc06be60 2024-04-24T23:07:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.114+0000 7f26d2512640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f26cc0b5d30 con 0x7f26cc072f40 2024-04-24T23:07:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26cb7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f26cc06be60 0x7f26cc145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26d0aaf640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f26cc0b4ed0 0x7f26cc0b3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33064/0 (socket says 172.21.15.43:33064) 2024-04-24T23:07:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26d0aaf640 1 -- 172.21.15.43:0/3600184400 learned_addr learned my addr 172.21.15.43:0/3600184400 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:07:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26cbfff640 1 --2- 172.21.15.43:0/3600184400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26cc072f40 0x7f26cc145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26cb7fe640 1 -- 172.21.15.43:0/3600184400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26cc072f40 msgr2=0x7f26cc145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26cb7fe640 1 --2- 172.21.15.43:0/3600184400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26cc072f40 0x7f26cc145500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26cb7fe640 1 -- 172.21.15.43:0/3600184400 >> v1:172.21.15.43:6789/0 conn(0x7f26cc0b4ed0 legacy=0x7f26cc0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26cb7fe640 1 -- 172.21.15.43:0/3600184400 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26cc073320 con 0x7f26cc06be60 2024-04-24T23:07:56.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26caffd640 1 -- 172.21.15.43:0/3600184400 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3556667507 0 0) 0x7f26cc0b5720 con 0x7f26cc0b4ed0 2024-04-24T23:07:56.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26cb7fe640 1 --2- 172.21.15.43:0/3600184400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26cc06be60 0x7f26cc145a40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f26c00097c0 tx=0x7f26c001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4453eaa8b1822e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:56.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26caffd640 1 -- 172.21.15.43:0/3600184400 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c00b1070 con 0x7f26cc06be60 2024-04-24T23:07:56.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26caffd640 1 -- 172.21.15.43:0/3600184400 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c00ac600 con 0x7f26cc06be60 2024-04-24T23:07:56.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26caffd640 1 -- 172.21.15.43:0/3600184400 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c00ac9d0 con 0x7f26cc06be60 2024-04-24T23:07:56.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26d2512640 1 -- 172.21.15.43:0/3600184400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26cc06be60 msgr2=0x7f26cc145a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26d2512640 1 --2- 172.21.15.43:0/3600184400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26cc06be60 0x7f26cc145a40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f26c00097c0 tx=0x7f26c001c3e0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26d2512640 1 -- 172.21.15.43:0/3600184400 shutdown_connections 2024-04-24T23:07:56.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26d2512640 1 --2- 172.21.15.43:0/3600184400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26cc06be60 0x7f26cc145a40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26d2512640 1 --2- 172.21.15.43:0/3600184400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26cc072f40 0x7f26cc145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26d2512640 1 -- 172.21.15.43:0/3600184400 >> 172.21.15.43:0/3600184400 conn(0x7f26cc06c300 msgr2=0x7f26cc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:56.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26d2512640 1 -- 172.21.15.43:0/3600184400 shutdown_connections 2024-04-24T23:07:56.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.118+0000 7f26d2512640 1 -- 172.21.15.43:0/3600184400 wait complete. 2024-04-24T23:07:56.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26d2512640 1 Processor -- start 2024-04-24T23:07:56.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26d2512640 1 -- start start 2024-04-24T23:07:56.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26d2512640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26cc06be60 0x7f26cc148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26d2512640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26cc072f40 0x7f26cc1de080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26d2512640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26cc0b4ed0 0x7f26cc1de5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26d2512640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc152970 con 0x7f26cc06be60 2024-04-24T23:07:56.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26d2512640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1527f0 con 0x7f26cc0b4ed0 2024-04-24T23:07:56.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26d2512640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f26cc152af0 con 0x7f26cc072f40 2024-04-24T23:07:56.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26cbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26cc06be60 0x7f26cc148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26cbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26cc06be60 0x7f26cc148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50600/0 (socket says 172.21.15.43:50600) 2024-04-24T23:07:56.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26cbfff640 1 -- 172.21.15.43:0/1893842703 learned_addr learned my addr 172.21.15.43:0/1893842703 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:56.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26cbfff640 1 -- 172.21.15.43:0/1893842703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26cc072f40 msgr2=0x7f26cc1de080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26cbfff640 1 --2- 172.21.15.43:0/1893842703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26cc072f40 0x7f26cc1de080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26cbfff640 1 -- 172.21.15.43:0/1893842703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26cc0b4ed0 msgr2=0x7f26cc1de5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26cbfff640 1 --2- 172.21.15.43:0/1893842703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26cc0b4ed0 0x7f26cc1de5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26cbfff640 1 -- 172.21.15.43:0/1893842703 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26cc147ac0 con 0x7f26cc06be60 2024-04-24T23:07:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26cbfff640 1 --2- 172.21.15.43:0/1893842703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26cc06be60 0x7f26cc148970 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00d830 tx=0x7f26bc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26c8ff9640 1 -- 172.21.15.43:0/1893842703 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00b6c0 con 0x7f26cc06be60 2024-04-24T23:07:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26c8ff9640 1 -- 172.21.15.43:0/1893842703 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26bc019070 con 0x7f26cc06be60 2024-04-24T23:07:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26d2512640 1 -- 172.21.15.43:0/1893842703 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26cc148200 con 0x7f26cc06be60 2024-04-24T23:07:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26c8ff9640 1 -- 172.21.15.43:0/1893842703 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00bae0 con 0x7f26cc06be60 2024-04-24T23:07:56.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26d2512640 1 -- 172.21.15.43:0/1893842703 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26cc146830 con 0x7f26cc06be60 2024-04-24T23:07:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26d2512640 1 -- 172.21.15.43:0/1893842703 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26cc1478d0 con 0x7f26cc06be60 2024-04-24T23:07:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26c8ff9640 1 -- 172.21.15.43:0/1893842703 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f26bc01e460 con 0x7f26cc06be60 2024-04-24T23:07:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26c8ff9640 1 --2- 172.21.15.43:0/1893842703 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f26b80678f0 0x7f26b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26c8ff9640 1 -- 172.21.15.43:0/1893842703 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f26bc086720 con 0x7f26cc06be60 2024-04-24T23:07:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.122+0000 7f26cb7fe640 1 --2- 172.21.15.43:0/1893842703 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f26b80678f0 0x7f26b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.126+0000 7f26cb7fe640 1 --2- 172.21.15.43:0/1893842703 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f26b80678f0 0x7f26b8069db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f26c00ae000 tx=0x7f26c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:56.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.130+0000 7f26c8ff9640 1 -- 172.21.15.43:0/1893842703 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f26bc056f20 con 0x7f26cc06be60 2024-04-24T23:07:56.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.282+0000 7f26d2512640 1 -- 172.21.15.43:0/1893842703 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f26cc04f580 con 0x7f26cc06be60 2024-04-24T23:07:56.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.282+0000 7f26c8ff9640 1 -- 172.21.15.43:0/1893842703 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f26bc056820 con 0x7f26cc06be60 2024-04-24T23:07:56.286 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-24T23:07:56.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.286+0000 7f26d2512640 1 -- 172.21.15.43:0/1893842703 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f26b80678f0 msgr2=0x7f26b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.286+0000 7f26d2512640 1 --2- 172.21.15.43:0/1893842703 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f26b80678f0 0x7f26b8069db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f26c00ae000 tx=0x7f26c0008040 comp rx=0 tx=0).stop 2024-04-24T23:07:56.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.286+0000 7f26d2512640 1 -- 172.21.15.43:0/1893842703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26cc06be60 msgr2=0x7f26cc148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.286+0000 7f26d2512640 1 --2- 172.21.15.43:0/1893842703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26cc06be60 0x7f26cc148970 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00d830 tx=0x7f26bc00dcf0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.286+0000 7f26d2512640 1 -- 172.21.15.43:0/1893842703 shutdown_connections 2024-04-24T23:07:56.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.286+0000 7f26d2512640 1 --2- 172.21.15.43:0/1893842703 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f26b80678f0 0x7f26b8069db0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.286+0000 7f26d2512640 1 --2- 172.21.15.43:0/1893842703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26cc0b4ed0 0x7f26cc1de5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.286+0000 7f26d2512640 1 --2- 172.21.15.43:0/1893842703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26cc072f40 0x7f26cc1de080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.286+0000 7f26d2512640 1 --2- 172.21.15.43:0/1893842703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26cc06be60 0x7f26cc148970 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.286+0000 7f26d2512640 1 -- 172.21.15.43:0/1893842703 >> 172.21.15.43:0/1893842703 conn(0x7f26cc06c300 msgr2=0x7f26cc0b6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:56.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.286+0000 7f26d2512640 1 -- 172.21.15.43:0/1893842703 shutdown_connections 2024-04-24T23:07:56.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.286+0000 7f26d2512640 1 -- 172.21.15.43:0/1893842703 wait complete. 2024-04-24T23:07:56.304 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:07:56.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f74a05c9640 1 Processor -- start 2024-04-24T23:07:56.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f74a05c9640 1 -- start start 2024-04-24T23:07:56.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f74a05c9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7498061e90 0x7f749814b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f74a05c9640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f749814b800 0x7f74980b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f74a05c9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74980b72a0 con 0x7f74980b5990 2024-04-24T23:07:56.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f74a05c9640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f74980b4fc0 con 0x7f749814b800 2024-04-24T23:07:56.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f74a05c9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f74980b4c50 con 0x7f7498061e90 2024-04-24T23:07:56.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f749db64640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f749814b800 0x7f74980b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f749db64640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f749814b800 0x7f74980b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50616/0 (socket says 172.21.15.43:50616) 2024-04-24T23:07:56.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f749db64640 1 -- 172.21.15.43:0/2873186135 learned_addr learned my addr 172.21.15.43:0/2873186135 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:56.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f749db64640 1 -- 172.21.15.43:0/2873186135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7498061e90 msgr2=0x7f749814b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:56.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f749db64640 1 --2- 172.21.15.43:0/2873186135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7498061e90 0x7f749814b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f749db64640 1 -- 172.21.15.43:0/2873186135 >> v1:172.21.15.162:6789/0 conn(0x7f74980b5990 legacy=0x7f7498148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:56.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f749db64640 1 -- 172.21.15.43:0/2873186135 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7498062270 con 0x7f749814b800 2024-04-24T23:07:56.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f749db64640 1 --2- 172.21.15.43:0/2873186135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f749814b800 0x7f74980b5450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7488006fd0 tx=0x7f748801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bd3bd0f652a50b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:56.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f749d363640 1 -- 172.21.15.43:0/2873186135 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74880b1070 con 0x7f749814b800 2024-04-24T23:07:56.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f749d363640 1 -- 172.21.15.43:0/2873186135 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74880ac630 con 0x7f749814b800 2024-04-24T23:07:56.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.430+0000 7f749d363640 1 -- 172.21.15.43:0/2873186135 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74880a8050 con 0x7f749814b800 2024-04-24T23:07:56.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 -- 172.21.15.43:0/2873186135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f749814b800 msgr2=0x7f74980b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 --2- 172.21.15.43:0/2873186135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f749814b800 0x7f74980b5450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7488006fd0 tx=0x7f748801c500 comp rx=0 tx=0).stop 2024-04-24T23:07:56.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 -- 172.21.15.43:0/2873186135 shutdown_connections 2024-04-24T23:07:56.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 --2- 172.21.15.43:0/2873186135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f749814b800 0x7f74980b5450 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 --2- 172.21.15.43:0/2873186135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7498061e90 0x7f749814b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 -- 172.21.15.43:0/2873186135 >> 172.21.15.43:0/2873186135 conn(0x7f749809b250 msgr2=0x7f749809b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:56.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 -- 172.21.15.43:0/2873186135 shutdown_connections 2024-04-24T23:07:56.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 -- 172.21.15.43:0/2873186135 wait complete. 2024-04-24T23:07:56.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 Processor -- start 2024-04-24T23:07:56.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 -- start start 2024-04-24T23:07:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7498061e90 0x7f749809e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74980b5990 0x7f74981e31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f749814b800 0x7f74981465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7498154cf0 con 0x7f749814b800 2024-04-24T23:07:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7498154b70 con 0x7f74980b5990 2024-04-24T23:07:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7498154e70 con 0x7f7498061e90 2024-04-24T23:07:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f749eb66640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f749814b800 0x7f74981465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f749eb66640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f749814b800 0x7f74981465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50630/0 (socket says 172.21.15.43:50630) 2024-04-24T23:07:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f749eb66640 1 -- 172.21.15.43:0/1566257114 learned_addr learned my addr 172.21.15.43:0/1566257114 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f749db64640 1 --2- 172.21.15.43:0/1566257114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74980b5990 0x7f74981e31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f749e365640 1 --2- 172.21.15.43:0/1566257114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7498061e90 0x7f749809e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f749eb66640 1 -- 172.21.15.43:0/1566257114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7498061e90 msgr2=0x7f749809e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f749eb66640 1 --2- 172.21.15.43:0/1566257114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7498061e90 0x7f749809e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f749eb66640 1 -- 172.21.15.43:0/1566257114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74980b5990 msgr2=0x7f74981e31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f749eb66640 1 --2- 172.21.15.43:0/1566257114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74980b5990 0x7f74981e31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f749eb66640 1 -- 172.21.15.43:0/1566257114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74980b2370 con 0x7f749814b800 2024-04-24T23:07:56.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f749db64640 1 --2- 172.21.15.43:0/1566257114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74980b5990 0x7f74981e31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:56.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f749eb66640 1 --2- 172.21.15.43:0/1566257114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f749814b800 0x7f74981465f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f749400c3c0 tx=0x7f749400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:56.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f748effd640 1 -- 172.21.15.43:0/1566257114 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7494011790 con 0x7f749814b800 2024-04-24T23:07:56.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f748effd640 1 -- 172.21.15.43:0/1566257114 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7494017070 con 0x7f749814b800 2024-04-24T23:07:56.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 -- 172.21.15.43:0/1566257114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74980b2650 con 0x7f749814b800 2024-04-24T23:07:56.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f748effd640 1 -- 172.21.15.43:0/1566257114 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7494011b70 con 0x7f749814b800 2024-04-24T23:07:56.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 -- 172.21.15.43:0/1566257114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f749809f0e0 con 0x7f749814b800 2024-04-24T23:07:56.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.434+0000 7f74a05c9640 1 -- 172.21.15.43:0/1566257114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f749804f580 con 0x7f749814b800 2024-04-24T23:07:56.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.438+0000 7f748effd640 1 -- 172.21.15.43:0/1566257114 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7494011d10 con 0x7f749814b800 2024-04-24T23:07:56.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.438+0000 7f748effd640 1 --2- 172.21.15.43:0/1566257114 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f747c0678c0 0x7f747c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.438+0000 7f748effd640 1 -- 172.21.15.43:0/1566257114 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f7494085b60 con 0x7f749814b800 2024-04-24T23:07:56.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.438+0000 7f749e365640 1 --2- 172.21.15.43:0/1566257114 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f747c0678c0 0x7f747c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.438+0000 7f749e365640 1 --2- 172.21.15.43:0/1566257114 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f747c0678c0 0x7f747c069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f74981477c0 tx=0x7f7490007310 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:56.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.442+0000 7f748effd640 1 -- 172.21.15.43:0/1566257114 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f7494021020 con 0x7f749814b800 2024-04-24T23:07:56.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.606+0000 7f74a05c9640 1 -- 172.21.15.43:0/1566257114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f749814a3d0 con 0x7f749814b800 2024-04-24T23:07:56.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.606+0000 7f748effd640 1 -- 172.21.15.43:0/1566257114 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f7494056360 con 0x7f749814b800 2024-04-24T23:07:56.611 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-24T23:07:56.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.610+0000 7f74a05c9640 1 -- 172.21.15.43:0/1566257114 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f747c0678c0 msgr2=0x7f747c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.610+0000 7f74a05c9640 1 --2- 172.21.15.43:0/1566257114 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f747c0678c0 0x7f747c069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f74981477c0 tx=0x7f7490007310 comp rx=0 tx=0).stop 2024-04-24T23:07:56.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.610+0000 7f74a05c9640 1 -- 172.21.15.43:0/1566257114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f749814b800 msgr2=0x7f74981465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.610+0000 7f74a05c9640 1 --2- 172.21.15.43:0/1566257114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f749814b800 0x7f74981465f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f749400c3c0 tx=0x7f749400c880 comp rx=0 tx=0).stop 2024-04-24T23:07:56.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.610+0000 7f74a05c9640 1 -- 172.21.15.43:0/1566257114 shutdown_connections 2024-04-24T23:07:56.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.610+0000 7f74a05c9640 1 --2- 172.21.15.43:0/1566257114 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f747c0678c0 0x7f747c069d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.610+0000 7f74a05c9640 1 --2- 172.21.15.43:0/1566257114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f749814b800 0x7f74981465f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.610+0000 7f74a05c9640 1 --2- 172.21.15.43:0/1566257114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74980b5990 0x7f74981e31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.610+0000 7f74a05c9640 1 --2- 172.21.15.43:0/1566257114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7498061e90 0x7f749809e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.610+0000 7f74a05c9640 1 -- 172.21.15.43:0/1566257114 >> 172.21.15.43:0/1566257114 conn(0x7f749809b250 msgr2=0x7f7498148c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:56.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.610+0000 7f74a05c9640 1 -- 172.21.15.43:0/1566257114 shutdown_connections 2024-04-24T23:07:56.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.610+0000 7f74a05c9640 1 -- 172.21.15.43:0/1566257114 wait complete. 2024-04-24T23:07:56.627 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-24T23:07:56.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf61414640 1 Processor -- start 2024-04-24T23:07:56.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf61414640 1 -- start start 2024-04-24T23:07:56.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf61414640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcf5c147f40 0x7fcf5c14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf61414640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf5c070650 con 0x7fcf5c144260 2024-04-24T23:07:56.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf61414640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf5c1448f0 con 0x7fcf5c061e90 2024-04-24T23:07:56.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf61414640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcf5c1446c0 con 0x7fcf5c147f40 2024-04-24T23:07:56.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf5a7fc640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fcf5c144260 0x7fcf5c147830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33078/0 (socket says 172.21.15.43:33078) 2024-04-24T23:07:56.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf5a7fc640 1 -- 172.21.15.43:0/2216821365 learned_addr learned my addr 172.21.15.43:0/2216821365 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:07:56.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf5b7fe640 1 --2- 172.21.15.43:0/2216821365 >> v2:172.21.15.162:3300/0 conn(0x7fcf5c147f40 0x7fcf5c14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf59ffb640 1 -- 172.21.15.43:0/2216821365 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3868199465 0 0) 0x7fcf5c070650 con 0x7fcf5c144260 2024-04-24T23:07:56.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf59ffb640 1 -- 172.21.15.43:0/2216821365 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf44003530 con 0x7fcf5c144260 2024-04-24T23:07:56.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf59ffb640 1 -- 172.21.15.43:0/2216821365 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 747195178 0 0) 0x7fcf44003530 con 0x7fcf5c144260 2024-04-24T23:07:56.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf59ffb640 1 -- 172.21.15.43:0/2216821365 >> v2:172.21.15.162:3300/0 conn(0x7fcf5c147f40 msgr2=0x7fcf5c14fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:56.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf59ffb640 1 --2- 172.21.15.43:0/2216821365 >> v2:172.21.15.162:3300/0 conn(0x7fcf5c147f40 0x7fcf5c14fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf59ffb640 1 -- 172.21.15.43:0/2216821365 >> v1:172.21.15.162:6789/0 conn(0x7fcf5c061e90 legacy=0x7fcf5c13e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf59ffb640 1 -- 172.21.15.43:0/2216821365 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c144bd0 con 0x7fcf5c144260 2024-04-24T23:07:56.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf59ffb640 1 -- 172.21.15.43:0/2216821365 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7fcf50001680 con 0x7fcf5c144260 2024-04-24T23:07:56.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf59ffb640 1 -- 172.21.15.43:0/2216821365 >> v1:172.21.15.43:6789/0 conn(0x7fcf5c144260 legacy=0x7fcf5c147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf59ffb640 1 --2- 172.21.15.43:0/2216821365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf440039c0 0x7fcf44003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf59ffb640 1 --2- 172.21.15.43:0/2216821365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf44004810 0x7fcf44004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf59ffb640 1 --2- 172.21.15.43:0/2216821365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf440051d0 0x7fcf4400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf59ffb640 1 -- 172.21.15.43:0/2216821365 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4400c0a0 con 0x7fcf440051d0 2024-04-24T23:07:56.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf59ffb640 1 -- 172.21.15.43:0/2216821365 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4400c250 con 0x7fcf440039c0 2024-04-24T23:07:56.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf59ffb640 1 -- 172.21.15.43:0/2216821365 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcf4400c450 con 0x7fcf44004810 2024-04-24T23:07:56.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf5b7fe640 1 --2- 172.21.15.43:0/2216821365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf440051d0 0x7fcf4400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf5a7fc640 1 --2- 172.21.15.43:0/2216821365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf44004810 0x7fcf44004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf5affd640 1 --2- 172.21.15.43:0/2216821365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf440039c0 0x7fcf44003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf5b7fe640 1 -- 172.21.15.43:0/2216821365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf44004810 msgr2=0x7fcf44004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:56.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf5b7fe640 1 --2- 172.21.15.43:0/2216821365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf44004810 0x7fcf44004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf5b7fe640 1 -- 172.21.15.43:0/2216821365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf440039c0 msgr2=0x7fcf44003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:56.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf5b7fe640 1 --2- 172.21.15.43:0/2216821365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf440039c0 0x7fcf44003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.746+0000 7fcf5b7fe640 1 -- 172.21.15.43:0/2216821365 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf44003530 con 0x7fcf440051d0 2024-04-24T23:07:56.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.750+0000 7fcf5b7fe640 1 -- 172.21.15.43:0/2216821365 reap_dead start 2024-04-24T23:07:56.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.750+0000 7fcf5b7fe640 1 --2- 172.21.15.43:0/2216821365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf440051d0 0x7fcf4400b9d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009fa0 tx=0x7fcf5401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59446e77d250b8da server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:56.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.750+0000 7fcf59ffb640 1 -- 172.21.15.43:0/2216821365 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf540b2070 con 0x7fcf440051d0 2024-04-24T23:07:56.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.750+0000 7fcf59ffb640 1 -- 172.21.15.43:0/2216821365 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf540a5d50 con 0x7fcf440051d0 2024-04-24T23:07:56.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.750+0000 7fcf59ffb640 1 -- 172.21.15.43:0/2216821365 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54009bf0 con 0x7fcf440051d0 2024-04-24T23:07:56.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.750+0000 7fcf61414640 1 -- 172.21.15.43:0/2216821365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf440051d0 msgr2=0x7fcf4400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.750+0000 7fcf61414640 1 --2- 172.21.15.43:0/2216821365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf440051d0 0x7fcf4400b9d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009fa0 tx=0x7fcf5401cc80 comp rx=0 tx=0).stop 2024-04-24T23:07:56.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.750+0000 7fcf61414640 1 -- 172.21.15.43:0/2216821365 shutdown_connections 2024-04-24T23:07:56.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.750+0000 7fcf61414640 1 --2- 172.21.15.43:0/2216821365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf440051d0 0x7fcf4400b9d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.750+0000 7fcf61414640 1 -- 172.21.15.43:0/2216821365 >> 172.21.15.43:0/2216821365 conn(0x7fcf5c06b9f0 msgr2=0x7fcf5c0b93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:56.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.750+0000 7fcf61414640 1 -- 172.21.15.43:0/2216821365 shutdown_connections 2024-04-24T23:07:56.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.750+0000 7fcf61414640 1 -- 172.21.15.43:0/2216821365 wait complete. 2024-04-24T23:07:56.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf61414640 1 Processor -- start 2024-04-24T23:07:56.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf61414640 1 -- start start 2024-04-24T23:07:56.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf61414640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf440051d0 0x7fcf5c1dfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf61414640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf5c0b4040 0x7fcf5c0728b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf61414640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf5c0b0b40 0x7fcf5c0b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf61414640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c070820 con 0x7fcf440051d0 2024-04-24T23:07:56.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf61414640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c144f40 con 0x7fcf5c0b4040 2024-04-24T23:07:56.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf61414640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5c073d60 con 0x7fcf5c0b0b40 2024-04-24T23:07:56.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf5affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf440051d0 0x7fcf5c1dfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf5affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf440051d0 0x7fcf5c1dfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50642/0 (socket says 172.21.15.43:50642) 2024-04-24T23:07:56.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf5affd640 1 -- 172.21.15.43:0/512062569 learned_addr learned my addr 172.21.15.43:0/512062569 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:56.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf5a7fc640 1 --2- 172.21.15.43:0/512062569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf5c0b4040 0x7fcf5c0728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf5b7fe640 1 --2- 172.21.15.43:0/512062569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf5c0b0b40 0x7fcf5c0b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf5affd640 1 -- 172.21.15.43:0/512062569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf5c0b0b40 msgr2=0x7fcf5c0b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf5affd640 1 --2- 172.21.15.43:0/512062569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf5c0b0b40 0x7fcf5c0b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf5affd640 1 -- 172.21.15.43:0/512062569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf5c0b4040 msgr2=0x7fcf5c0728b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:56.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf5affd640 1 --2- 172.21.15.43:0/512062569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf5c0b4040 0x7fcf5c0728b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:56.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf5affd640 1 -- 172.21.15.43:0/512062569 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c141380 con 0x7fcf440051d0 2024-04-24T23:07:56.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf5a7fc640 1 --2- 172.21.15.43:0/512062569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf5c0b4040 0x7fcf5c0728b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:56.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf5affd640 1 --2- 172.21.15.43:0/512062569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf440051d0 0x7fcf5c1dfd40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c011c40 tx=0x7fcf4c00f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:56.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf437fe640 1 -- 172.21.15.43:0/512062569 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c019020 con 0x7fcf440051d0 2024-04-24T23:07:56.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf437fe640 1 -- 172.21.15.43:0/512062569 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4c00fcb0 con 0x7fcf440051d0 2024-04-24T23:07:56.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf61414640 1 -- 172.21.15.43:0/512062569 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5c0720b0 con 0x7fcf440051d0 2024-04-24T23:07:56.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf437fe640 1 -- 172.21.15.43:0/512062569 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c0052f0 con 0x7fcf440051d0 2024-04-24T23:07:56.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf61414640 1 -- 172.21.15.43:0/512062569 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5c1410a0 con 0x7fcf440051d0 2024-04-24T23:07:56.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.754+0000 7fcf61414640 1 -- 172.21.15.43:0/512062569 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf5c071ea0 con 0x7fcf440051d0 2024-04-24T23:07:56.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.758+0000 7fcf437fe640 1 -- 172.21.15.43:0/512062569 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf4c01c020 con 0x7fcf440051d0 2024-04-24T23:07:56.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.758+0000 7fcf437fe640 1 --2- 172.21.15.43:0/512062569 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcf480678c0 0x7fcf48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:56.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.758+0000 7fcf437fe640 1 -- 172.21.15.43:0/512062569 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fcf4c089d70 con 0x7fcf440051d0 2024-04-24T23:07:56.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.758+0000 7fcf5a7fc640 1 --2- 172.21.15.43:0/512062569 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcf480678c0 0x7fcf48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:56.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.758+0000 7fcf5a7fc640 1 --2- 172.21.15.43:0/512062569 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcf480678c0 0x7fcf48069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf50001210 tx=0x7fcf50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:56.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.762+0000 7fcf437fe640 1 -- 172.21.15.43:0/512062569 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fcf4c023020 con 0x7fcf440051d0 2024-04-24T23:07:56.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.958+0000 7fcf61414640 1 -- 172.21.15.43:0/512062569 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fcf5c04f580 con 0x7fcf440051d0 2024-04-24T23:07:56.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.966+0000 7fcf437fe640 1 -- 172.21.15.43:0/512062569 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v5) ==== 81+0+452092 (secure 0 0 0) 0x7fcf4c00fe60 con 0x7fcf440051d0 2024-04-24T23:07:56.973 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:07:56.973 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-24T23:07:56.974 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 5, 2024-04-24T23:07:56.974 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:56.974 INFO:teuthology.orchestra.run.smithi043.stdout: "active_gid": 4104, 2024-04-24T23:07:56.974 INFO:teuthology.orchestra.run.smithi043.stdout: "active_name": "y", 2024-04-24T23:07:56.974 INFO:teuthology.orchestra.run.smithi043.stdout: "active_addrs": { 2024-04-24T23:07:56.974 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-24T23:07:56.974 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:56.974 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-24T23:07:56.974 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6832", 2024-04-24T23:07:56.974 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 444634859 2024-04-24T23:07:56.974 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.974 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:56.974 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-24T23:07:56.974 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6833", 2024-04-24T23:07:56.975 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 444634859 2024-04-24T23:07:56.975 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:56.975 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-24T23:07:56.975 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.975 INFO:teuthology.orchestra.run.smithi043.stdout: "active_addr": "172.21.15.43:6833/444634859", 2024-04-24T23:07:56.975 INFO:teuthology.orchestra.run.smithi043.stdout: "active_change": "2024-04-24T22:59:56.244680+0000", 2024-04-24T23:07:56.975 INFO:teuthology.orchestra.run.smithi043.stdout: "active_mgr_features": 4540701547738038271, 2024-04-24T23:07:56.975 INFO:teuthology.orchestra.run.smithi043.stdout: "available": true, 2024-04-24T23:07:56.975 INFO:teuthology.orchestra.run.smithi043.stdout: "standbys": [ 2024-04-24T23:07:56.975 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:56.975 INFO:teuthology.orchestra.run.smithi043.stdout: "gid": 4100, 2024-04-24T23:07:56.975 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "x", 2024-04-24T23:07:56.975 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_features": 4540701547738038271, 2024-04-24T23:07:56.976 INFO:teuthology.orchestra.run.smithi043.stdout: "available_modules": [ 2024-04-24T23:07:56.976 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:56.976 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "alerts", 2024-04-24T23:07:56.976 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:56.976 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:56.976 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:56.976 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-24T23:07:56.976 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-24T23:07:56.976 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:56.976 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.976 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.976 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-24T23:07:56.976 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.976 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.976 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.977 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How frequently to reexamine health status", 2024-04-24T23:07:56.977 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:56.978 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.978 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.978 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.978 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:56.978 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:56.978 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:56.978 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.978 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.978 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:56.978 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.978 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.978 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:56.980 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.980 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.980 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:56.980 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.980 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.980 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.980 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:56.980 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:56.980 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.980 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.980 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.980 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:56.980 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:56.981 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:56.981 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.981 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.981 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:56.981 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.981 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.981 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:56.981 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:56.981 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:56.981 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:56.981 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:56.981 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:56.981 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:56.981 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:56.982 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:56.982 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:56.982 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.982 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.982 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.982 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:56.982 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:56.982 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:56.982 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.982 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.982 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:56.982 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.982 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.982 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.982 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:56.983 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:56.983 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.983 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.983 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.983 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_destination": { 2024-04-24T23:07:56.983 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_destination", 2024-04-24T23:07:56.983 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:56.983 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.983 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.983 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:56.983 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.983 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.983 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.983 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email address to send alerts to", 2024-04-24T23:07:56.984 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:56.984 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.984 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.984 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.984 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_from_name": { 2024-04-24T23:07:56.984 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_from_name", 2024-04-24T23:07:56.984 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:56.985 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.985 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.985 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "Ceph", 2024-04-24T23:07:56.985 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.985 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.985 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.985 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email From: name", 2024-04-24T23:07:56.985 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:56.985 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.985 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.985 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.985 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_host": { 2024-04-24T23:07:56.986 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_host", 2024-04-24T23:07:56.986 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:56.986 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.986 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.986 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:56.986 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.986 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.986 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.986 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP server", 2024-04-24T23:07:56.986 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:56.986 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.986 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.986 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.986 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_password": { 2024-04-24T23:07:56.987 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_password", 2024-04-24T23:07:56.987 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:56.987 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.987 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.987 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:56.987 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.987 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.987 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.987 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Password to authenticate with", 2024-04-24T23:07:56.987 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:56.987 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.987 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.987 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.987 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_port": { 2024-04-24T23:07:56.987 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_port", 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "465", 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP port", 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_sender": { 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_sender", 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.988 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.989 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:56.989 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.989 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.989 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.989 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP envelope sender", 2024-04-24T23:07:56.989 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:56.989 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.989 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.989 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.989 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_ssl": { 2024-04-24T23:07:56.989 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_ssl", 2024-04-24T23:07:56.989 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:56.989 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.989 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-24T23:07:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_user": { 2024-04-24T23:07:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_user", 2024-04-24T23:07:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.991 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.991 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:56.991 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.991 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.991 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.991 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "User to authenticate as", 2024-04-24T23:07:56.991 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:56.991 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.991 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.991 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:56.991 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:56.991 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.991 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:56.991 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "balancer", 2024-04-24T23:07:56.991 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:56.992 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:56.992 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:56.992 INFO:teuthology.orchestra.run.smithi043.stdout: "active": { 2024-04-24T23:07:56.992 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "active", 2024-04-24T23:07:56.992 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:56.992 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.992 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.992 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:56.992 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.992 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.992 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.992 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically balance PGs across cluster", 2024-04-24T23:07:56.992 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:56.992 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.993 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.993 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.993 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_time": { 2024-04-24T23:07:56.993 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_time", 2024-04-24T23:07:56.993 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:56.993 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.993 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.993 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0000", 2024-04-24T23:07:56.993 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.993 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.993 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.993 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "beginning time of day to automatically balance", 2024-04-24T23:07:56.993 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-24T23:07:56.993 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.994 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.994 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.994 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_weekday": { 2024-04-24T23:07:56.994 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_weekday", 2024-04-24T23:07:56.994 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-24T23:07:56.994 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.994 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.994 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-24T23:07:56.994 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-24T23:07:56.994 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-24T23:07:56.994 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.994 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-24T23:07:56.994 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-24T23:07:56.995 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.995 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.995 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.995 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_max_iterations": { 2024-04-24T23:07:56.995 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_max_iterations", 2024-04-24T23:07:56.995 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-24T23:07:56.995 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.995 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.995 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "25", 2024-04-24T23:07:56.995 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-24T23:07:56.995 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "250", 2024-04-24T23:07:56.995 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.995 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-24T23:07:56.995 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:56.995 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.996 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.996 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.996 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_metrics": { 2024-04-24T23:07:56.996 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_metrics", 2024-04-24T23:07:56.996 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:56.996 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.996 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.996 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "pgs,objects,bytes", 2024-04-24T23:07:56.996 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.996 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.996 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.996 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-24T23:07:56.996 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-24T23:07:56.996 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.997 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.997 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.997 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_step": { 2024-04-24T23:07:56.997 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_step", 2024-04-24T23:07:56.997 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-24T23:07:56.997 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.997 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.997 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.5", 2024-04-24T23:07:56.997 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0.001", 2024-04-24T23:07:56.997 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "0.999", 2024-04-24T23:07:56.997 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.997 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "aggressiveness of optimization", 2024-04-24T23:07:56.997 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-24T23:07:56.997 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.997 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.998 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.998 INFO:teuthology.orchestra.run.smithi043.stdout: "end_time": { 2024-04-24T23:07:56.998 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_time", 2024-04-24T23:07:56.998 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:56.998 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.998 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.998 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2359", 2024-04-24T23:07:56.998 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:56.998 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:56.998 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.998 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ending time of day to automatically balance", 2024-04-24T23:07:56.998 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-24T23:07:56.998 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.998 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.998 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:56.999 INFO:teuthology.orchestra.run.smithi043.stdout: "end_weekday": { 2024-04-24T23:07:56.999 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_weekday", 2024-04-24T23:07:56.999 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-24T23:07:56.999 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:56.999 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:56.999 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-24T23:07:56.999 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-24T23:07:56.999 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-24T23:07:56.999 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:56.999 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-24T23:07:56.999 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-24T23:07:56.999 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:56.999 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:56.999 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.000 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.000 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.000 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.000 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.000 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.000 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.000 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.000 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.000 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.000 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.000 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.000 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.000 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.000 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.000 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.001 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.001 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.001 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.001 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.001 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.001 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.001 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.001 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.001 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.001 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.001 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.001 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.001 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.002 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.002 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.002 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.002 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.002 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.002 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.002 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.002 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.002 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.002 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.002 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.002 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.002 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.002 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.003 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.003 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.003 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.003 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.003 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.003 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.003 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.003 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.003 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.003 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.003 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.003 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.003 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.003 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.004 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.004 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.004 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.004 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.004 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.004 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.004 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.004 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.004 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.004 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.004 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.004 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.004 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.004 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.005 INFO:teuthology.orchestra.run.smithi043.stdout: "min_score": { 2024-04-24T23:07:57.005 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_score", 2024-04-24T23:07:57.005 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-24T23:07:57.005 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.005 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.005 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-24T23:07:57.005 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.005 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.005 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.006 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-24T23:07:57.006 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.006 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.006 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.006 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.006 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-24T23:07:57.006 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-24T23:07:57.006 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.006 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.006 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.006 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "upmap", 2024-04-24T23:07:57.006 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.006 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.006 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.007 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-compat", 2024-04-24T23:07:57.007 INFO:teuthology.orchestra.run.smithi043.stdout: "none", 2024-04-24T23:07:57.007 INFO:teuthology.orchestra.run.smithi043.stdout: "read", 2024-04-24T23:07:57.007 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap", 2024-04-24T23:07:57.007 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap-read" 2024-04-24T23:07:57.007 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.007 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Balancer mode", 2024-04-24T23:07:57.007 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.007 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.007 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.007 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.007 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_ids": { 2024-04-24T23:07:57.007 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_ids", 2024-04-24T23:07:57.007 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.008 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.008 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.008 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.008 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.008 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.008 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.008 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-24T23:07:57.008 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.008 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.008 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.008 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.008 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-24T23:07:57.008 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-24T23:07:57.008 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.008 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_deviation": { 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_deviation", 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.009 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-24T23:07:57.010 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-24T23:07:57.010 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.010 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.010 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-24T23:07:57.010 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-24T23:07:57.010 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.010 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.010 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.010 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_optimizations": { 2024-04-24T23:07:57.010 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_optimizations", 2024-04-24T23:07:57.010 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-24T23:07:57.010 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.010 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.010 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-24T23:07:57.011 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.011 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.011 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.011 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-24T23:07:57.011 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.011 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.011 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.011 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.011 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.011 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.011 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.011 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm", 2024-04-24T23:07:57.011 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.011 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.011 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.012 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_down_multiplier": { 2024-04-24T23:07:57.012 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_down_multiplier", 2024-04-24T23:07:57.012 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-24T23:07:57.012 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.012 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.012 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-24T23:07:57.012 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.012 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.012 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.012 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-24T23:07:57.012 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.012 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.012 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.012 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.013 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_refresh_rate": { 2024-04-24T23:07:57.013 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_refresh_rate", 2024-04-24T23:07:57.013 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.013 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.013 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.013 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "20", 2024-04-24T23:07:57.013 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.013 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.013 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.013 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-24T23:07:57.013 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.013 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.013 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.013 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.013 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_starting_port": { 2024-04-24T23:07:57.014 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_starting_port", 2024-04-24T23:07:57.014 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.014 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.014 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.014 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4721", 2024-04-24T23:07:57.014 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.014 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.014 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.014 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-24T23:07:57.014 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.014 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.014 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.014 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.015 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_ptrace": { 2024-04-24T23:07:57.015 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_ptrace", 2024-04-24T23:07:57.015 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.015 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.015 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.015 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.015 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.015 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.015 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.015 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-24T23:07:57.015 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-24T23:07:57.015 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.015 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.015 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.016 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_interval": { 2024-04-24T23:07:57.016 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_interval", 2024-04-24T23:07:57.016 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.016 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.016 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.016 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-24T23:07:57.016 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.016 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.016 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.016 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-24T23:07:57.016 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.016 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.016 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.016 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.017 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_memory_target_ratio": { 2024-04-24T23:07:57.017 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_memory_target_ratio", 2024-04-24T23:07:57.017 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-24T23:07:57.017 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.017 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.017 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.7", 2024-04-24T23:07:57.017 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.017 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.017 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.017 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-24T23:07:57.017 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.017 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.017 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.017 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.017 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm_log_destination": { 2024-04-24T23:07:57.018 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm_log_destination", 2024-04-24T23:07:57.018 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.018 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.018 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.018 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.018 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.018 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.018 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.018 INFO:teuthology.orchestra.run.smithi043.stdout: "file", 2024-04-24T23:07:57.018 INFO:teuthology.orchestra.run.smithi043.stdout: "file,syslog", 2024-04-24T23:07:57.021 INFO:teuthology.orchestra.run.smithi043.stdout: "syslog" 2024-04-24T23:07:57.022 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.022 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-24T23:07:57.022 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.022 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.022 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.022 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.022 INFO:teuthology.orchestra.run.smithi043.stdout: "cgroups_split": { 2024-04-24T23:07:57.022 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cgroups_split", 2024-04-24T23:07:57.022 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.022 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.022 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.022 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.022 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: "config_checks_enabled": { 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_checks_enabled", 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.023 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.024 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-24T23:07:57.024 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.024 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.024 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.024 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.024 INFO:teuthology.orchestra.run.smithi043.stdout: "config_dashboard": { 2024-04-24T23:07:57.024 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_dashboard", 2024-04-24T23:07:57.024 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.024 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.024 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.024 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.024 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.024 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.024 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_alertmanager": { 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_alertmanager", 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-24T23:07:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.026 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.026 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.026 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.026 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_base": { 2024-04-24T23:07:57.026 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_base", 2024-04-24T23:07:57.026 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.026 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.026 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.026 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-24T23:07:57.026 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.026 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.026 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.026 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Container image name, without the tag", 2024-04-24T23:07:57.026 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_elasticsearch": { 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_elasticsearch", 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "elasticsearch container image", 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.027 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.028 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.028 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_grafana": { 2024-04-24T23:07:57.028 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_grafana", 2024-04-24T23:07:57.028 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.028 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.028 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.028 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-24T23:07:57.028 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.028 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.028 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.028 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-24T23:07:57.028 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.028 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.029 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.029 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.029 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_haproxy": { 2024-04-24T23:07:57.029 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_haproxy", 2024-04-24T23:07:57.029 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.029 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.029 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.029 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-24T23:07:57.029 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.029 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.029 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.029 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "HAproxy container image", 2024-04-24T23:07:57.029 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.030 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.030 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.030 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.030 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_agent": { 2024-04-24T23:07:57.030 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_agent", 2024-04-24T23:07:57.030 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.030 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.030 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.030 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-24T23:07:57.030 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.030 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.030 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.030 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger agent container image", 2024-04-24T23:07:57.030 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.031 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.031 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.031 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.031 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_collector": { 2024-04-24T23:07:57.031 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_collector", 2024-04-24T23:07:57.031 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.031 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.031 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.031 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-24T23:07:57.031 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.031 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.031 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.031 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger collector container image", 2024-04-24T23:07:57.031 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_query": { 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_query", 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger query container image", 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.032 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.033 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.033 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_keepalived": { 2024-04-24T23:07:57.033 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_keepalived", 2024-04-24T23:07:57.033 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.033 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.034 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.034 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-24T23:07:57.034 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.034 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.034 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.034 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Keepalived container image", 2024-04-24T23:07:57.034 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.035 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.035 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.035 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.035 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_loki": { 2024-04-24T23:07:57.035 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_loki", 2024-04-24T23:07:57.035 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.036 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.036 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.036 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-24T23:07:57.036 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.036 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.037 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.037 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Loki container image", 2024-04-24T23:07:57.037 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.037 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.037 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.037 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.037 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_node_exporter": { 2024-04-24T23:07:57.037 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_node_exporter", 2024-04-24T23:07:57.037 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.037 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.037 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.037 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-24T23:07:57.038 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.038 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.038 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.038 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-24T23:07:57.038 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.038 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.038 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.038 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.038 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_nvmeof": { 2024-04-24T23:07:57.038 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_nvmeof", 2024-04-24T23:07:57.038 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.038 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.039 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.039 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-24T23:07:57.039 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.039 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.039 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.039 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Nvme-of container image", 2024-04-24T23:07:57.040 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.040 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.040 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.040 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.040 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_prometheus": { 2024-04-24T23:07:57.040 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_prometheus", 2024-04-24T23:07:57.040 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.040 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.040 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.040 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-24T23:07:57.040 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.040 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.041 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.041 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-24T23:07:57.041 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.041 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.041 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.041 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.041 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_promtail": { 2024-04-24T23:07:57.041 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_promtail", 2024-04-24T23:07:57.041 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.041 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.041 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.041 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-24T23:07:57.041 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.041 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.041 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.042 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Promtail container image", 2024-04-24T23:07:57.042 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.042 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.042 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.042 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.042 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_samba": { 2024-04-24T23:07:57.042 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_samba", 2024-04-24T23:07:57.042 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.042 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.042 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.042 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-24T23:07:57.042 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.042 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.043 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.043 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Samba/SMB container image", 2024-04-24T23:07:57.043 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.043 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.043 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.043 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.043 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_snmp_gateway": { 2024-04-24T23:07:57.043 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_snmp_gateway", 2024-04-24T23:07:57.043 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.043 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.043 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.043 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-24T23:07:57.043 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.044 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.044 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.044 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SNMP Gateway container image", 2024-04-24T23:07:57.044 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.044 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.044 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.044 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.044 INFO:teuthology.orchestra.run.smithi043.stdout: "container_init": { 2024-04-24T23:07:57.044 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_init", 2024-04-24T23:07:57.044 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.044 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.044 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.044 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.044 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.044 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.045 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.045 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Run podman/docker with `--init`", 2024-04-24T23:07:57.045 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.045 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.045 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.045 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.045 INFO:teuthology.orchestra.run.smithi043.stdout: "daemon_cache_timeout": { 2024-04-24T23:07:57.045 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "daemon_cache_timeout", 2024-04-24T23:07:57.045 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.045 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.045 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.045 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-24T23:07:57.045 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.045 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.046 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.046 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-24T23:07:57.046 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.046 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.046 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.046 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.046 INFO:teuthology.orchestra.run.smithi043.stdout: "default_cephadm_command_timeout": { 2024-04-24T23:07:57.046 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_cephadm_command_timeout", 2024-04-24T23:07:57.046 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.046 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.046 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.046 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "900", 2024-04-24T23:07:57.046 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.047 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.047 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.047 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-24T23:07:57.047 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.047 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.047 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.047 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.047 INFO:teuthology.orchestra.run.smithi043.stdout: "default_registry": { 2024-04-24T23:07:57.047 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_registry", 2024-04-24T23:07:57.047 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.047 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.047 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.047 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io", 2024-04-24T23:07:57.047 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "device_cache_timeout": { 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_cache_timeout", 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1800", 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.048 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache device inventory", 2024-04-24T23:07:57.049 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.049 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.049 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.049 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.049 INFO:teuthology.orchestra.run.smithi043.stdout: "device_enhanced_scan": { 2024-04-24T23:07:57.049 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_enhanced_scan", 2024-04-24T23:07:57.049 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.049 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.049 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.049 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.049 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.049 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.049 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.049 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-24T23:07:57.050 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.050 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.050 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.050 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.050 INFO:teuthology.orchestra.run.smithi043.stdout: "facts_cache_timeout": { 2024-04-24T23:07:57.050 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "facts_cache_timeout", 2024-04-24T23:07:57.050 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.050 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.050 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.050 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-24T23:07:57.050 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.050 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.050 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.051 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache host facts data", 2024-04-24T23:07:57.051 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.051 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.051 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.051 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.051 INFO:teuthology.orchestra.run.smithi043.stdout: "grafana_dashboards_path": { 2024-04-24T23:07:57.051 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "grafana_dashboards_path", 2024-04-24T23:07:57.051 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.051 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.051 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.051 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-24T23:07:57.051 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.051 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.051 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.051 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: "host_check_interval": { 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "host_check_interval", 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to perform a host check", 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.052 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: "hw_monitoring": { 2024-04-24T23:07:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hw_monitoring", 2024-04-24T23:07:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-24T23:07:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.054 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.054 INFO:teuthology.orchestra.run.smithi043.stdout: "inventory_list_all": { 2024-04-24T23:07:57.054 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "inventory_list_all", 2024-04-24T23:07:57.054 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.054 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.054 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.054 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.054 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.054 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.054 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.054 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-24T23:07:57.054 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.054 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.054 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.055 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.055 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.055 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.055 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.055 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.055 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.055 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.055 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.055 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.055 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.055 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.055 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.055 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.055 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.055 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.056 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.056 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.056 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.056 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.056 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.056 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.056 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.056 INFO:teuthology.orchestra.run.smithi043.stdout: "log_refresh_metadata": { 2024-04-24T23:07:57.056 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_refresh_metadata", 2024-04-24T23:07:57.056 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.056 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.056 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.056 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.056 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.057 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.057 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.057 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-24T23:07:57.057 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.057 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.057 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.057 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.057 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.057 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.057 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.057 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.057 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.057 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.057 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.057 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.058 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.058 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-24T23:07:57.058 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.058 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.058 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.058 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.058 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.058 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.058 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.058 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.058 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.058 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.058 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.058 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.060 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.060 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.060 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.060 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.060 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.060 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.060 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.060 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.060 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.060 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.060 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.060 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.060 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.060 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.060 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.061 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-24T23:07:57.061 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-24T23:07:57.061 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.061 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.061 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.061 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.061 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.061 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.061 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.061 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-24T23:07:57.061 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.061 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.061 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.061 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.061 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-24T23:07:57.062 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-24T23:07:57.062 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.062 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.062 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.062 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "*", 2024-04-24T23:07:57.062 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.062 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.062 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.062 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-24T23:07:57.062 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.062 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.062 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.063 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.063 INFO:teuthology.orchestra.run.smithi043.stdout: "max_count_per_host": { 2024-04-24T23:07:57.063 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_count_per_host", 2024-04-24T23:07:57.063 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.063 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.063 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.063 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-24T23:07:57.063 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.063 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.063 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.063 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of daemons per service per host", 2024-04-24T23:07:57.063 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.063 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.063 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.063 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.064 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd_draining_count": { 2024-04-24T23:07:57.064 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_osd_draining_count", 2024-04-24T23:07:57.064 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.064 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.064 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.064 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-24T23:07:57.064 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.064 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.064 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.064 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-24T23:07:57.064 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.064 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.064 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.064 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.065 INFO:teuthology.orchestra.run.smithi043.stdout: "migration_current": { 2024-04-24T23:07:57.065 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "migration_current", 2024-04-24T23:07:57.065 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.065 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.065 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.065 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.065 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.065 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.065 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.065 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "internal - do not modify", 2024-04-24T23:07:57.065 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.065 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.065 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.065 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.066 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-24T23:07:57.066 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-24T23:07:57.066 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.066 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.066 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.066 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "root", 2024-04-24T23:07:57.066 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.066 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.066 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.066 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm-package", 2024-04-24T23:07:57.066 INFO:teuthology.orchestra.run.smithi043.stdout: "root" 2024-04-24T23:07:57.066 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.066 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "mode for remote execution of cephadm", 2024-04-24T23:07:57.066 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.067 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.067 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.067 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.067 INFO:teuthology.orchestra.run.smithi043.stdout: "oob_default_addr": { 2024-04-24T23:07:57.067 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "oob_default_addr", 2024-04-24T23:07:57.067 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.067 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.067 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.067 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "169.254.1.1", 2024-04-24T23:07:57.067 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.067 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.067 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.067 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-24T23:07:57.067 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: "prometheus_alerts_path": { 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus_alerts_path", 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.068 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.069 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.069 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_insecure": { 2024-04-24T23:07:57.069 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_insecure", 2024-04-24T23:07:57.069 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.069 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.069 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.069 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.069 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.069 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.069 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.069 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-24T23:07:57.069 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.069 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.069 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.070 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.070 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_password": { 2024-04-24T23:07:57.070 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_password", 2024-04-24T23:07:57.070 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.070 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.070 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.070 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.070 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.070 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.070 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.070 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-24T23:07:57.070 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.070 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.070 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_url": { 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_url", 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.071 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_username": { 2024-04-24T23:07:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_username", 2024-04-24T23:07:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-24T23:07:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: "secure_monitoring_stack": { 2024-04-24T23:07:57.072 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "secure_monitoring_stack", 2024-04-24T23:07:57.073 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.073 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.073 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.073 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.073 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.073 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.073 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.073 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-24T23:07:57.073 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.073 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.073 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.073 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.073 INFO:teuthology.orchestra.run.smithi043.stdout: "service_discovery_port": { 2024-04-24T23:07:57.073 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "service_discovery_port", 2024-04-24T23:07:57.074 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.074 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.074 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.074 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8765", 2024-04-24T23:07:57.074 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.074 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.074 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.074 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "cephadm service discovery port", 2024-04-24T23:07:57.074 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.075 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.075 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.075 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.075 INFO:teuthology.orchestra.run.smithi043.stdout: "ssh_config_file": { 2024-04-24T23:07:57.075 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssh_config_file", 2024-04-24T23:07:57.075 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.075 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.075 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.075 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.076 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.076 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.076 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.076 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-24T23:07:57.076 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.076 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.076 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.076 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.076 INFO:teuthology.orchestra.run.smithi043.stdout: "use_agent": { 2024-04-24T23:07:57.077 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_agent", 2024-04-24T23:07:57.077 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.077 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.077 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.077 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.077 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.077 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.077 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.078 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-24T23:07:57.078 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.078 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.078 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.078 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.078 INFO:teuthology.orchestra.run.smithi043.stdout: "use_repo_digest": { 2024-04-24T23:07:57.078 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_repo_digest", 2024-04-24T23:07:57.078 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.078 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.079 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.079 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.079 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.079 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.079 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.079 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-24T23:07:57.079 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.079 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.079 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.080 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.080 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_failed_host_check": { 2024-04-24T23:07:57.080 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_failed_host_check", 2024-04-24T23:07:57.080 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.080 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.080 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.080 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.080 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.081 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.081 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.081 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if the host check fails", 2024-04-24T23:07:57.081 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.081 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.081 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.081 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.081 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_daemons": { 2024-04-24T23:07:57.081 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_daemons", 2024-04-24T23:07:57.082 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.082 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.082 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.082 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.082 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.082 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.082 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.082 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-24T23:07:57.082 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.083 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.083 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.083 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.083 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_hosts": { 2024-04-24T23:07:57.083 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_hosts", 2024-04-24T23:07:57.083 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.083 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.083 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.084 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.084 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.084 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.084 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.084 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-24T23:07:57.084 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.084 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.084 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.084 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.085 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.085 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.085 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.085 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crash", 2024-04-24T23:07:57.085 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.085 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.085 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.085 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.086 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.086 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.086 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.086 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.086 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.086 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.086 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.086 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.087 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.087 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.087 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.087 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.087 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.087 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.087 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.087 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.087 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.088 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.088 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.088 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.088 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.088 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.088 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.088 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.088 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.088 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.088 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.088 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.089 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.089 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.089 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.089 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.089 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.089 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.089 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.089 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.089 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.089 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.089 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.089 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.089 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.090 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.090 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.090 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.090 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.090 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.090 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.090 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.090 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.090 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.090 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.090 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.090 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.090 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.090 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.091 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.091 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.091 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.091 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.091 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.091 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.091 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.091 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.091 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.091 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.091 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.091 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.091 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.091 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.092 INFO:teuthology.orchestra.run.smithi043.stdout: "retain_interval": { 2024-04-24T23:07:57.092 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retain_interval", 2024-04-24T23:07:57.092 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.092 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.092 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.092 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "31536000", 2024-04-24T23:07:57.092 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.092 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.092 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.092 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-24T23:07:57.092 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.092 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.092 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.092 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.093 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_recent_interval": { 2024-04-24T23:07:57.093 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_recent_interval", 2024-04-24T23:07:57.093 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.093 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.093 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.093 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1209600", 2024-04-24T23:07:57.093 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.093 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.093 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.093 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-24T23:07:57.093 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.093 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.093 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.093 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.094 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.094 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.094 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.094 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dashboard", 2024-04-24T23:07:57.094 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.094 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.094 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.094 INFO:teuthology.orchestra.run.smithi043.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-24T23:07:57.094 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-24T23:07:57.094 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.094 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.094 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.094 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-24T23:07:57.094 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.094 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.095 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.095 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.095 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.095 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.095 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.095 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.095 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_HOST": { 2024-04-24T23:07:57.095 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-24T23:07:57.095 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.095 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.095 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.095 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.095 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.095 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.095 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.096 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.096 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.096 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.096 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.096 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.096 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-24T23:07:57.096 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-24T23:07:57.096 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.096 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.096 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.096 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.096 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.096 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.096 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.096 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.097 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.097 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.097 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.097 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.097 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_ENABLED": { 2024-04-24T23:07:57.097 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_ENABLED", 2024-04-24T23:07:57.097 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.097 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.097 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.097 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.097 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.097 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.097 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.097 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.097 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.098 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.098 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.098 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.098 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-24T23:07:57.098 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-24T23:07:57.098 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.098 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.098 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.098 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.098 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.098 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.098 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.098 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.098 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.099 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.099 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.099 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.099 INFO:teuthology.orchestra.run.smithi043.stdout: "ENABLE_BROWSABLE_API": { 2024-04-24T23:07:57.099 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-24T23:07:57.099 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.099 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.099 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.100 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.100 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.100 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.100 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.100 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.100 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.101 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.101 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.101 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.101 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-24T23:07:57.101 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-24T23:07:57.102 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.102 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.102 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.102 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.102 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.102 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.102 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.103 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.103 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.103 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.103 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.103 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.103 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-24T23:07:57.104 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-24T23:07:57.104 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.104 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.104 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.104 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.104 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.105 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.105 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.105 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.105 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.105 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.105 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.105 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.106 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-24T23:07:57.106 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-24T23:07:57.106 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.106 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.106 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.106 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.107 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.107 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.107 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.107 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.107 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.107 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.107 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.108 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.108 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-24T23:07:57.108 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-24T23:07:57.108 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.108 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.108 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.109 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.109 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.109 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.109 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.109 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.109 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.110 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.110 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.110 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.110 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-24T23:07:57.110 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-24T23:07:57.110 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.111 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.111 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.111 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.111 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.111 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.111 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.111 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.111 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.112 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.112 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.112 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.112 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-24T23:07:57.112 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-24T23:07:57.112 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.112 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.113 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.113 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.113 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.113 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.113 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.113 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.114 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.114 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.114 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.114 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.114 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-24T23:07:57.114 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-24T23:07:57.115 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.115 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.115 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.115 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.115 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.115 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.115 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.116 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.116 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.116 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.116 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.116 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.116 INFO:teuthology.orchestra.run.smithi043.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-24T23:07:57.117 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-24T23:07:57.117 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.117 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.117 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.117 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.117 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.118 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.118 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.118 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.118 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.118 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.118 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.119 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.119 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_PASSWORD": { 2024-04-24T23:07:57.119 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-24T23:07:57.119 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.119 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.119 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.120 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-24T23:07:57.120 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.120 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.120 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.120 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.120 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.120 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.121 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.121 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.121 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-24T23:07:57.121 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-24T23:07:57.121 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.121 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.122 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.122 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.122 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.122 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.122 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.122 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.123 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.123 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.123 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.123 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.123 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_URL": { 2024-04-24T23:07:57.123 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_URL", 2024-04-24T23:07:57.124 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.124 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.124 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.124 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.124 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.124 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.124 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.125 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.125 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.125 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.125 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.125 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.125 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_USERNAME": { 2024-04-24T23:07:57.126 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-24T23:07:57.126 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.126 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.126 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.126 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-24T23:07:57.126 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.127 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.127 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.127 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.127 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.127 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.127 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.128 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.128 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-24T23:07:57.128 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-24T23:07:57.128 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.128 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.128 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.129 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.129 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.129 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.129 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.129 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.129 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.129 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.129 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.129 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.130 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-24T23:07:57.130 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-24T23:07:57.130 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.130 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.130 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.130 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.130 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.130 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.130 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.130 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.130 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.130 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.131 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.131 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.131 INFO:teuthology.orchestra.run.smithi043.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-24T23:07:57.131 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-24T23:07:57.131 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.131 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.131 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.131 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.131 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.131 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.131 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.131 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.131 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.131 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.132 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.132 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.132 INFO:teuthology.orchestra.run.smithi043.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-24T23:07:57.132 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-24T23:07:57.132 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.132 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.132 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.132 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.132 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.132 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.132 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.132 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.132 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.132 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.132 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.133 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.133 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_HOST": { 2024-04-24T23:07:57.133 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-24T23:07:57.133 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.133 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.133 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.133 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.133 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.133 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.133 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.133 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.133 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.133 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.133 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.134 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.134 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-24T23:07:57.134 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-24T23:07:57.134 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.134 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.134 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.134 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.134 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.134 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.134 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.134 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.134 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.134 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.135 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.135 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.135 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-24T23:07:57.135 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-24T23:07:57.135 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.135 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.135 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.135 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.135 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.135 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.135 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.135 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.135 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.135 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.135 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.136 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.136 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-24T23:07:57.136 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-24T23:07:57.136 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.136 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.136 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.136 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.136 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.136 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.136 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.136 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.136 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.136 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.136 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.136 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.137 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-24T23:07:57.137 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-24T23:07:57.137 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.137 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.137 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.137 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.137 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.137 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.137 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.137 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.137 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.137 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.137 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.137 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.137 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-24T23:07:57.138 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-24T23:07:57.138 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.138 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.138 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.138 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.138 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.138 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.138 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.138 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.138 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.138 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.138 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.138 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.138 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-24T23:07:57.139 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-24T23:07:57.139 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.139 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.139 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.139 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.139 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.139 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.139 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.139 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.139 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.139 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.139 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.139 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.139 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-24T23:07:57.139 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-24T23:07:57.140 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.140 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.140 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.140 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.140 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.140 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.140 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.140 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.140 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.140 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.140 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.140 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.140 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-24T23:07:57.140 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-24T23:07:57.141 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.141 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.141 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.141 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.141 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.141 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.141 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.141 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.141 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.141 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.141 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.141 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.141 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_ENABLED": { 2024-04-24T23:07:57.141 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-24T23:07:57.141 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.142 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.142 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.142 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.142 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.142 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.142 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.142 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.142 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.142 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.142 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.142 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.142 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-24T23:07:57.142 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-24T23:07:57.143 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.143 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.143 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.143 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-24T23:07:57.143 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.143 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.143 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.143 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.143 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.143 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.143 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.144 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.144 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-24T23:07:57.144 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-24T23:07:57.144 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.144 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.144 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.144 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-24T23:07:57.144 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.144 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.144 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.144 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.144 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.144 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.144 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-24T23:07:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-24T23:07:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8", 2024-04-24T23:07:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.146 INFO:teuthology.orchestra.run.smithi043.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-24T23:07:57.146 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-24T23:07:57.146 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.146 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.146 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.146 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "45", 2024-04-24T23:07:57.146 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.146 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.146 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.146 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.146 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.146 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.146 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.147 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.147 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ACCESS_KEY": { 2024-04-24T23:07:57.147 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-24T23:07:57.147 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.147 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.147 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.147 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.147 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.147 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.147 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.147 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.147 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.147 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.147 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.147 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.148 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-24T23:07:57.148 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-24T23:07:57.148 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.148 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.148 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.148 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-24T23:07:57.148 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.148 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.148 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.148 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.148 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.148 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.148 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.148 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.149 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SECRET_KEY": { 2024-04-24T23:07:57.149 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-24T23:07:57.149 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.149 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.149 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.149 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.149 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.149 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.149 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.149 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.149 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.149 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.149 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.149 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.149 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SSL_VERIFY": { 2024-04-24T23:07:57.150 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-24T23:07:57.150 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.150 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.150 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.150 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.150 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.150 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.150 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.150 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.150 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.150 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.151 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.151 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.151 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-24T23:07:57.151 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-24T23:07:57.151 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.151 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.151 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.151 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-24T23:07:57.151 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.151 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.151 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.152 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.152 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.152 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.152 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.152 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.152 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-24T23:07:57.152 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-24T23:07:57.152 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.152 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.153 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.153 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-24T23:07:57.153 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.153 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.153 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.153 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.153 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.153 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.153 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.154 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.154 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-24T23:07:57.154 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-24T23:07:57.154 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.154 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.154 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.154 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-24T23:07:57.154 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.154 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.155 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.155 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.155 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.155 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.155 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.155 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.155 INFO:teuthology.orchestra.run.smithi043.stdout: "cross_origin_url": { 2024-04-24T23:07:57.155 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cross_origin_url", 2024-04-24T23:07:57.155 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.155 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.156 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.156 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.156 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.156 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.156 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.156 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.156 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.156 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.157 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.157 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.157 INFO:teuthology.orchestra.run.smithi043.stdout: "crt_file": { 2024-04-24T23:07:57.157 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crt_file", 2024-04-24T23:07:57.157 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.157 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.157 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.157 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.157 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.158 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.158 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.158 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.158 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.158 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.158 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.158 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.158 INFO:teuthology.orchestra.run.smithi043.stdout: "debug": { 2024-04-24T23:07:57.158 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "debug", 2024-04-24T23:07:57.159 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.159 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.159 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.159 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.159 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.159 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.159 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.159 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable/disable debug options", 2024-04-24T23:07:57.160 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.160 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.160 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.160 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.160 INFO:teuthology.orchestra.run.smithi043.stdout: "jwt_token_ttl": { 2024-04-24T23:07:57.160 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "jwt_token_ttl", 2024-04-24T23:07:57.160 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.160 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.160 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.161 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "28800", 2024-04-24T23:07:57.161 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.161 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.161 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.161 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.161 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.161 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.161 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.161 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.162 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-24T23:07:57.162 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-24T23:07:57.162 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.162 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.162 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.162 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.162 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.162 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.162 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.163 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.163 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.163 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.163 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.163 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.163 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.163 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.163 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.163 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.163 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.164 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.164 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.164 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.164 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.164 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.164 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.164 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.164 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.164 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.165 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.165 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.165 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.165 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.165 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.165 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.165 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.165 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.165 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.166 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.166 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.166 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.166 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.166 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.166 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.166 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.166 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.166 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.166 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.167 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.167 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.167 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.167 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.167 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.167 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.167 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.167 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.167 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.167 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.167 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.167 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.167 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.168 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.168 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.168 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.168 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.168 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.168 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.168 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.168 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.168 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.168 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.168 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.168 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.168 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.168 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.168 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.169 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.169 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.169 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.169 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.169 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.169 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.169 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.169 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.169 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.169 INFO:teuthology.orchestra.run.smithi043.stdout: "motd": { 2024-04-24T23:07:57.169 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "motd", 2024-04-24T23:07:57.169 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.169 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.169 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.170 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.170 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.170 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.170 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.170 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "The message of the day", 2024-04-24T23:07:57.170 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.170 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.170 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.170 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.170 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect_resolve_ip_addr": { 2024-04-24T23:07:57.170 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "redirect_resolve_ip_addr", 2024-04-24T23:07:57.170 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.170 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.170 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.170 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.171 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.171 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.171 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.171 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.171 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.171 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.171 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.171 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.171 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-24T23:07:57.171 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-24T23:07:57.171 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.171 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.171 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.171 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-24T23:07:57.171 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.172 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.172 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.172 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.172 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.172 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.172 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.172 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.172 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-24T23:07:57.172 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-24T23:07:57.172 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.172 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.172 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.172 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8080", 2024-04-24T23:07:57.172 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.172 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.173 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.174 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.174 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.174 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.174 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.174 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl_server_port": { 2024-04-24T23:07:57.174 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl_server_port", 2024-04-24T23:07:57.174 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.174 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.174 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.174 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8443", 2024-04-24T23:07:57.174 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.174 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.174 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.174 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.174 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.175 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.175 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.175 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.175 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-24T23:07:57.175 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-24T23:07:57.175 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.175 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.175 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.175 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "redirect", 2024-04-24T23:07:57.175 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.175 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.175 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.175 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.175 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect" 2024-04-24T23:07:57.175 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.176 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: "url_prefix": { 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url_prefix", 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.177 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.178 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.178 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.178 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.178 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.178 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "devicehealth", 2024-04-24T23:07:57.178 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.178 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.178 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.178 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_monitoring": { 2024-04-24T23:07:57.178 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_monitoring", 2024-04-24T23:07:57.178 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.178 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.178 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.179 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.179 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.179 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.179 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.179 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "monitor device health metrics", 2024-04-24T23:07:57.179 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.179 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.179 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.179 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.179 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.179 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.179 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.179 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.179 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.179 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.180 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.181 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.182 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.182 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.182 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.182 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.182 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.182 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.182 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.182 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.182 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.182 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.182 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.182 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.182 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.182 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.183 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.183 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.183 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.183 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.183 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.183 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.183 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.183 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.183 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.183 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.183 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.183 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.183 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.183 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.183 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.184 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.184 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.184 INFO:teuthology.orchestra.run.smithi043.stdout: "mark_out_threshold": { 2024-04-24T23:07:57.184 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mark_out_threshold", 2024-04-24T23:07:57.184 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.184 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.184 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.184 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2419200", 2024-04-24T23:07:57.184 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.184 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.184 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.184 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-24T23:07:57.184 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.184 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.184 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.185 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.185 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": { 2024-04-24T23:07:57.185 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_name", 2024-04-24T23:07:57.185 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.185 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.185 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.185 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "device_health_metrics", 2024-04-24T23:07:57.185 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.185 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.185 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.185 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-24T23:07:57.185 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.185 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.185 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.186 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.186 INFO:teuthology.orchestra.run.smithi043.stdout: "retention_period": { 2024-04-24T23:07:57.186 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retention_period", 2024-04-24T23:07:57.186 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.186 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.186 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.186 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15552000", 2024-04-24T23:07:57.186 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.186 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.186 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.186 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain device health metrics", 2024-04-24T23:07:57.186 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.186 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.186 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.187 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.187 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_frequency": { 2024-04-24T23:07:57.187 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_frequency", 2024-04-24T23:07:57.187 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.187 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.187 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.187 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-24T23:07:57.187 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.187 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.187 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.187 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-24T23:07:57.187 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.187 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.187 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.188 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.188 INFO:teuthology.orchestra.run.smithi043.stdout: "self_heal": { 2024-04-24T23:07:57.188 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "self_heal", 2024-04-24T23:07:57.188 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.188 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.188 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.188 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.188 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.188 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.188 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.188 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-24T23:07:57.188 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.188 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.188 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.188 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.189 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-24T23:07:57.189 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-24T23:07:57.189 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.189 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.189 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.189 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-24T23:07:57.189 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.189 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.189 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.189 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and check device health", 2024-04-24T23:07:57.189 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.189 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.190 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.190 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.190 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_threshold": { 2024-04-24T23:07:57.190 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_threshold", 2024-04-24T23:07:57.190 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.190 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.190 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.190 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7257600", 2024-04-24T23:07:57.190 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.190 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.190 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.190 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-24T23:07:57.190 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.190 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.191 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.191 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.191 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.191 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.191 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.191 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "diskprediction_local", 2024-04-24T23:07:57.191 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.191 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.191 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.191 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.191 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.191 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.191 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.191 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.191 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.192 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.192 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.192 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.192 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.192 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.192 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.192 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.192 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.192 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.192 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.192 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.192 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.192 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.192 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.193 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.193 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.193 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.193 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.193 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.193 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.193 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.193 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.193 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.193 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.193 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.194 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.194 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.194 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.194 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.194 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.194 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.194 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.194 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.194 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.194 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.194 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.194 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.194 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: "predict_interval": { 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predict_interval", 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-24T23:07:57.196 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: "predictor_model": { 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predictor_model", 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "prophetstor", 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.197 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.198 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.198 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.198 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.198 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.198 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.198 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-24T23:07:57.198 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-24T23:07:57.198 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.198 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.198 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.198 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-24T23:07:57.198 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.199 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.199 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.199 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.199 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.199 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.199 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.199 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.199 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.199 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.199 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.199 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "influx", 2024-04-24T23:07:57.199 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": false, 2024-04-24T23:07:57.199 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "influxdb python module not found", 2024-04-24T23:07:57.199 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.199 INFO:teuthology.orchestra.run.smithi043.stdout: "batch_size": { 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "batch_size", 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5000", 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: "database": { 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "database", 2024-04-24T23:07:57.200 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.201 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.201 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.201 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "ceph", 2024-04-24T23:07:57.201 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.201 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.201 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.201 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-24T23:07:57.201 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.201 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.201 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.201 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.201 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": { 2024-04-24T23:07:57.201 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hostname", 2024-04-24T23:07:57.201 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.201 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.202 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.202 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.202 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.202 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.202 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.202 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server hostname", 2024-04-24T23:07:57.202 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.202 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.202 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.202 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.202 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-24T23:07:57.202 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-24T23:07:57.203 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.203 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.203 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.203 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "30", 2024-04-24T23:07:57.203 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "5", 2024-04-24T23:07:57.203 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.203 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.203 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-24T23:07:57.203 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.203 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.203 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.203 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.203 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.203 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.203 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.204 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.204 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.204 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.204 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.204 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.204 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.204 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.204 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.204 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.204 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.204 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.204 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.204 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.204 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.204 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.205 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.205 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.205 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.205 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.205 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.205 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.205 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.205 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.205 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.205 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.205 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.205 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.205 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.205 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.205 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.206 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.206 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.206 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.206 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.206 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.206 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.206 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.206 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.207 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.207 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.207 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.207 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.207 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.207 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.207 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.207 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.207 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.207 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.207 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.207 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.207 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.207 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.207 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.208 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.208 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.208 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.208 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.208 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.208 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.208 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.208 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.208 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.208 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.208 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.208 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.208 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.208 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: "password": { 2024-04-24T23:07:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "password", 2024-04-24T23:07:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "password of InfluxDB server user", 2024-04-24T23:07:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.209 INFO:teuthology.orchestra.run.smithi043.stdout: "port": { 2024-04-24T23:07:57.210 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "port", 2024-04-24T23:07:57.210 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.210 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.210 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.210 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8086", 2024-04-24T23:07:57.210 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.210 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.210 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.210 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server port", 2024-04-24T23:07:57.210 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.210 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.210 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.210 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.211 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-24T23:07:57.211 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-24T23:07:57.211 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.211 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.211 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.211 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "false", 2024-04-24T23:07:57.211 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.211 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.211 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.211 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-24T23:07:57.211 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.211 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.211 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.211 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.211 INFO:teuthology.orchestra.run.smithi043.stdout: "threads": { 2024-04-24T23:07:57.212 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threads", 2024-04-24T23:07:57.212 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.212 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.212 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.212 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-24T23:07:57.212 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-24T23:07:57.212 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "32", 2024-04-24T23:07:57.212 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.212 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-24T23:07:57.212 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.212 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.212 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.212 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.212 INFO:teuthology.orchestra.run.smithi043.stdout: "username": { 2024-04-24T23:07:57.212 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "username", 2024-04-24T23:07:57.213 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.213 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.213 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.213 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.213 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.213 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.213 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.213 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "username of InfluxDB server user", 2024-04-24T23:07:57.213 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.213 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.213 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.213 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.213 INFO:teuthology.orchestra.run.smithi043.stdout: "verify_ssl": { 2024-04-24T23:07:57.213 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "verify_ssl", 2024-04-24T23:07:57.214 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.214 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.214 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.214 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "true", 2024-04-24T23:07:57.214 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.214 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.214 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.214 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-24T23:07:57.214 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.214 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.214 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.214 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.214 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.214 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.215 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.215 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "insights", 2024-04-24T23:07:57.215 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.215 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.215 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.215 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.215 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.215 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.215 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.215 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.216 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.216 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.216 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.216 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.216 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.216 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.216 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.216 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.216 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.217 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.217 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.217 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.217 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.217 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.217 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.217 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.217 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.217 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.218 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.218 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.218 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.218 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.218 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.218 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.218 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.218 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.219 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.219 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.219 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.219 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.219 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.219 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.219 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.220 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.220 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.220 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.220 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.220 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.220 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.221 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.221 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.221 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.221 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.221 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.221 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.221 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.222 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.222 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.222 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.222 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.222 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.222 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.222 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.223 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.223 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.223 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.223 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.223 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.223 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.223 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.223 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.224 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.224 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.224 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.224 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.224 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.224 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.225 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.225 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "iostat", 2024-04-24T23:07:57.225 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.225 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.225 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.225 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.225 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.226 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.226 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.226 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.226 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.226 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.226 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.227 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.227 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.227 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.227 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.227 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.227 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.227 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.227 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.227 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.227 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.227 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.228 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.228 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.228 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.228 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.228 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.228 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.228 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.228 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.228 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.228 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.228 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.228 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.228 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.229 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.229 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.229 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.229 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.229 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.229 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.229 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.229 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.229 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.229 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.229 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.229 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.229 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.230 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.230 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.230 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.230 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.230 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.230 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.230 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.230 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.230 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.230 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.230 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.231 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "localpool", 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "failure_domain": { 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "failure_domain", 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "host", 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "failure domain for any created local pool", 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.232 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.233 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.233 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.233 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.233 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.233 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.233 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.233 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.233 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.233 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.233 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.233 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.233 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.233 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.233 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.234 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.234 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.234 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.234 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.234 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.234 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.234 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.234 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.234 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.234 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.234 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.234 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.234 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.235 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.235 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.235 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.235 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.235 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.235 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.235 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.235 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.235 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.235 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.235 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.235 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.236 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.237 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.237 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.237 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.237 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.237 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.237 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.237 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.237 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.237 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.238 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.238 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.238 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.238 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.238 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.238 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.238 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.238 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": { 2024-04-24T23:07:57.238 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_size", 2024-04-24T23:07:57.239 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.239 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.239 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.239 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.239 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.239 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.239 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.239 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default min_size for any created local pool", 2024-04-24T23:07:57.239 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-24T23:07:57.240 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.240 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.240 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.240 INFO:teuthology.orchestra.run.smithi043.stdout: "num_rep": { 2024-04-24T23:07:57.240 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "num_rep", 2024-04-24T23:07:57.240 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.240 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.240 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.241 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3", 2024-04-24T23:07:57.241 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.241 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.241 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.241 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default replica count for any created local pool", 2024-04-24T23:07:57.241 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.241 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.241 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.241 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.242 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": { 2024-04-24T23:07:57.242 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_num", 2024-04-24T23:07:57.242 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.242 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.242 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.242 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "128", 2024-04-24T23:07:57.242 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.242 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.243 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.243 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default pg_num for any created local pool", 2024-04-24T23:07:57.243 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.243 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.243 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.243 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.243 INFO:teuthology.orchestra.run.smithi043.stdout: "prefix": { 2024-04-24T23:07:57.243 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prefix", 2024-04-24T23:07:57.243 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.244 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.244 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.244 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.244 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.244 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.244 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.244 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name prefix for any created local pool", 2024-04-24T23:07:57.244 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.245 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.245 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.245 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.245 INFO:teuthology.orchestra.run.smithi043.stdout: "subtree": { 2024-04-24T23:07:57.245 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "subtree", 2024-04-24T23:07:57.245 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.245 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.245 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.245 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "rack", 2024-04-24T23:07:57.246 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.246 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.246 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.246 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-24T23:07:57.246 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-24T23:07:57.246 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.246 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.246 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.247 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.247 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.247 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.247 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirroring", 2024-04-24T23:07:57.247 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.247 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.247 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.247 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.247 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.248 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.248 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.248 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.248 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.248 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.248 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.248 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.248 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.248 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.249 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.249 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.249 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.249 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.249 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.249 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.249 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.249 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.249 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.250 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.250 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.250 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.250 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.250 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.250 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.250 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.250 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.250 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.251 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.251 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.251 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.251 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.251 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.251 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.251 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.252 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.252 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.252 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.252 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.252 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.252 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.252 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.252 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.252 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.253 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.253 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.253 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.253 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.253 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.253 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.253 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.253 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.253 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.253 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.253 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.254 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.254 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.254 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.254 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.254 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.254 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.254 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.254 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.254 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.254 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.254 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.254 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.254 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.254 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.255 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.255 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.255 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.255 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "nfs", 2024-04-24T23:07:57.255 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.255 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.255 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.255 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.255 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.255 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.255 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.255 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.255 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.255 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.255 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.256 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.256 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.256 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.256 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.256 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.256 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.256 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.256 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.256 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.256 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.256 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.256 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.256 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.256 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.257 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.258 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.258 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.258 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.258 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.258 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.258 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.258 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.258 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.258 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.258 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.258 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.258 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.258 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.259 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.259 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.259 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.259 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.259 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.259 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.259 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.259 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.259 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.259 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.259 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.259 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.259 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.259 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.259 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.260 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.260 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.260 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.260 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.260 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.260 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.260 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.260 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-24T23:07:57.260 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.260 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.260 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.260 INFO:teuthology.orchestra.run.smithi043.stdout: "fail_fs": { 2024-04-24T23:07:57.260 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "fail_fs", 2024-04-24T23:07:57.260 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.260 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.261 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.261 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.261 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.261 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.261 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.261 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-24T23:07:57.261 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.261 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.261 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.261 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.261 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.261 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.261 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.261 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.261 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.262 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.262 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.262 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.262 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.262 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.262 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.262 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.262 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.262 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.262 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.262 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.262 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.262 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.262 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.262 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.263 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.264 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.265 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator": { 2024-04-24T23:07:57.266 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-24T23:07:57.266 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.266 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.266 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.266 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.266 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.266 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.266 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.266 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm", 2024-04-24T23:07:57.266 INFO:teuthology.orchestra.run.smithi043.stdout: "rook", 2024-04-24T23:07:57.266 INFO:teuthology.orchestra.run.smithi043.stdout: "test_orchestrator" 2024-04-24T23:07:57.266 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.266 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Orchestrator backend", 2024-04-24T23:07:57.266 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_perf_query", 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.267 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.268 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.268 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.268 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.268 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.268 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.268 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.268 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.268 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.268 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.268 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.268 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.268 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.269 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.269 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.269 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.269 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.269 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.269 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.269 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.269 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.269 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.269 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.269 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.269 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.269 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.269 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.270 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.270 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.270 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.270 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.270 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.270 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.270 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.270 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.270 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.270 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.270 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.270 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.270 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.270 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.270 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_support", 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.272 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.273 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.274 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.274 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.274 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.274 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.274 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.274 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.274 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.274 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.274 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.274 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.274 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.274 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.274 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.274 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.274 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.275 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.276 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_autoscaler", 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.277 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.278 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.278 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.278 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.278 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.278 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.278 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.278 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.278 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.278 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.278 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.278 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.278 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.278 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.278 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.278 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.279 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.279 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.279 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.279 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.279 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.279 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.279 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.279 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.279 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.279 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.279 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.279 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.279 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.279 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.280 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.280 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.280 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.280 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.280 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.280 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.280 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.280 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.280 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.280 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.280 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.280 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.280 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.280 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.281 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.281 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.281 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.281 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.281 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.281 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.281 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.281 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.281 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.281 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.281 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.281 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.281 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.281 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.281 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.282 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.282 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.282 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.282 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.282 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.282 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.282 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-24T23:07:57.282 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-24T23:07:57.282 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.282 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.282 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.282 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-24T23:07:57.282 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.282 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.282 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: "threshold": { 2024-04-24T23:07:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threshold", 2024-04-24T23:07:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-24T23:07:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-24T23:07:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1.0", 2024-04-24T23:07:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "scaling threshold", 2024-04-24T23:07:57.284 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-24T23:07:57.284 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.284 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.284 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.284 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.284 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.284 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.284 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "progress", 2024-04-24T23:07:57.284 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.284 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.284 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.284 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_pg_recovery_event": { 2024-04-24T23:07:57.284 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_pg_recovery_event", 2024-04-24T23:07:57.284 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.284 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-24T23:07:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-24T23:07:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-24T23:07:57.286 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.286 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.286 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.286 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.286 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.286 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.286 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.286 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.287 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.287 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.287 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.287 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.287 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.287 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.287 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.287 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.288 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.288 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.288 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.288 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.288 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.288 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.288 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.289 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.289 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.289 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.289 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.289 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.289 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.289 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.290 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.290 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.290 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.290 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.290 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.290 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.290 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.291 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.291 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.291 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.291 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.291 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.291 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.291 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.292 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.292 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.292 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.292 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.292 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.292 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.293 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.293 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.293 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.293 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.293 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.293 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.293 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.294 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.294 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.294 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.294 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.294 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.294 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.295 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.295 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.295 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.295 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.295 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.295 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.295 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.295 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.295 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.295 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.295 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.296 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.296 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.296 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.296 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.296 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.296 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.296 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.296 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.297 INFO:teuthology.orchestra.run.smithi043.stdout: "max_completed_events": { 2024-04-24T23:07:57.297 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_completed_events", 2024-04-24T23:07:57.297 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.297 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.297 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.297 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "50", 2024-04-24T23:07:57.297 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.298 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.298 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.298 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "number of past completed events to remember", 2024-04-24T23:07:57.298 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.298 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.299 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.299 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.299 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-24T23:07:57.299 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-24T23:07:57.299 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.299 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.299 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.300 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-24T23:07:57.300 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.300 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.300 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.300 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long the module is going to sleep", 2024-04-24T23:07:57.300 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.300 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.301 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.301 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.301 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.301 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.301 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.301 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus", 2024-04-24T23:07:57.301 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.302 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.302 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.302 INFO:teuthology.orchestra.run.smithi043.stdout: "cache": { 2024-04-24T23:07:57.302 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cache", 2024-04-24T23:07:57.302 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.302 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.303 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.303 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.303 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.303 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.303 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.303 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.304 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.304 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.304 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.304 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.304 INFO:teuthology.orchestra.run.smithi043.stdout: "exclude_perf_counters": { 2024-04-24T23:07:57.304 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "exclude_perf_counters", 2024-04-24T23:07:57.304 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.305 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.305 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.305 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.305 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.305 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.305 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.305 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-24T23:07:57.306 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-24T23:07:57.306 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.306 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.306 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.306 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.306 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.307 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.307 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.307 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.307 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.307 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.307 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.308 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.308 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.308 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.308 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.308 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.308 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.308 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.308 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.308 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.308 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.309 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.309 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.309 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.309 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.309 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.309 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.309 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.309 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.309 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.309 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.310 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.310 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.310 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.310 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.310 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.310 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.310 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.310 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.311 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.311 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.311 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.311 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.311 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.311 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.311 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.312 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.312 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.312 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.312 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.312 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.312 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.312 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.312 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.312 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.312 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.312 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.312 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.312 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools": { 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools", 2024-04-24T23:07:57.313 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.314 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.314 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.314 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.314 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.314 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.314 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.314 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.314 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.314 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.314 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.314 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.314 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-24T23:07:57.314 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-24T23:07:57.314 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "300", 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_interval": { 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_interval", 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15.0", 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.316 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.317 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.317 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-24T23:07:57.317 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.317 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.317 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.317 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.317 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-24T23:07:57.317 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-24T23:07:57.317 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.317 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.317 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.317 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "9283", 2024-04-24T23:07:57.318 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.318 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.318 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.318 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-24T23:07:57.318 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.318 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.318 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.318 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.318 INFO:teuthology.orchestra.run.smithi043.stdout: "stale_cache_strategy": { 2024-04-24T23:07:57.318 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stale_cache_strategy", 2024-04-24T23:07:57.318 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.318 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.318 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.319 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "log", 2024-04-24T23:07:57.319 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.319 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.319 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.319 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.319 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.319 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.319 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.319 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.319 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-24T23:07:57.319 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-24T23:07:57.319 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.319 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.319 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.319 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "default", 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: "default", 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: "error" 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.320 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_support", 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.321 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.322 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.322 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.322 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.322 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.322 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.322 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.322 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.322 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.322 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.322 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.322 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.322 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.322 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.322 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.323 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.324 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.324 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.324 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.324 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.324 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.324 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.324 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.324 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.324 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.324 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.324 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.324 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.324 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.324 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.324 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.325 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.326 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.326 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.326 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.326 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.326 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.326 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.326 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.326 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.326 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_snap_create": { 2024-04-24T23:07:57.326 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_snap_create", 2024-04-24T23:07:57.326 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.326 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.326 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.326 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "mirror_snapshot_schedule": { 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirror_snapshot_schedule", 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.327 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "trash_purge_schedule": { 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "trash_purge_schedule", 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.328 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.329 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.329 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.329 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.329 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.329 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.329 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "restful", 2024-04-24T23:07:57.329 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.329 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.329 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.329 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_auth": { 2024-04-24T23:07:57.329 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_auth", 2024-04-24T23:07:57.330 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.330 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.330 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.330 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.330 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.330 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.331 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.331 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.331 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.331 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.331 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.331 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.332 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-24T23:07:57.332 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-24T23:07:57.332 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.332 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.332 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.333 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.333 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.333 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.333 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.333 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.333 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.333 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.334 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.334 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.334 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.334 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.334 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.334 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.335 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.335 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.335 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.335 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.335 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.335 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.335 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.336 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.336 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.336 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.336 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.336 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.336 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.336 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.337 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.337 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.337 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.337 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.337 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.337 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.338 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.338 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.338 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.338 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.338 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.338 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.339 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.339 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.339 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.339 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.339 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.339 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.339 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.339 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.339 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.340 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.340 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.340 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.340 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.340 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.340 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.341 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.341 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.341 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.341 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.341 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.341 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.341 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.341 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.341 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.341 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.341 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.341 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.341 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.342 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.342 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.342 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.342 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.342 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.342 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.342 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.342 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.342 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.342 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.342 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.342 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.342 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-24T23:07:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-24T23:07:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-24T23:07:57.343 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-24T23:07:57.344 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.344 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.344 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.344 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.344 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.344 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.344 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.344 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.344 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.344 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.344 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.344 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.344 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.344 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.345 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.345 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "selftest", 2024-04-24T23:07:57.345 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.345 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.345 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.345 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.345 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.345 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.345 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.345 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.345 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.345 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.345 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.346 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.346 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.346 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.346 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.346 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.346 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.346 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.346 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.346 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.346 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.346 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.347 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.347 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.347 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.347 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.347 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.347 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.347 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.347 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.347 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.347 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.347 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.347 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.347 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.347 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.347 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.348 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.348 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.348 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.348 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.348 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.348 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.348 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.348 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.348 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.348 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.348 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.348 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.349 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.349 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.349 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.349 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.349 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.349 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.349 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.349 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.349 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.349 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.349 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.349 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.349 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.349 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.350 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.350 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.350 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.350 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.350 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.350 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.350 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.350 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.350 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.350 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.350 INFO:teuthology.orchestra.run.smithi043.stdout: "roption1": { 2024-04-24T23:07:57.350 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption1", 2024-04-24T23:07:57.350 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.350 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.351 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.351 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.351 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.351 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.351 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.351 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.351 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.351 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.351 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.351 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.351 INFO:teuthology.orchestra.run.smithi043.stdout: "roption2": { 2024-04-24T23:07:57.351 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption2", 2024-04-24T23:07:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "xyz", 2024-04-24T23:07:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption1": { 2024-04-24T23:07:57.352 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption1", 2024-04-24T23:07:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption2": { 2024-04-24T23:07:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption2", 2024-04-24T23:07:57.353 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption3": { 2024-04-24T23:07:57.354 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption3", 2024-04-24T23:07:57.355 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-24T23:07:57.355 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.355 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.355 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.355 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.355 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.355 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.355 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.355 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.355 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.355 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.355 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.355 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption4": { 2024-04-24T23:07:57.355 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption4", 2024-04-24T23:07:57.355 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.356 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.356 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.356 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.356 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.356 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.356 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.356 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.356 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.356 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.356 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.356 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.356 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption5": { 2024-04-24T23:07:57.356 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption5", 2024-04-24T23:07:57.357 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.357 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.357 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.357 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.357 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.357 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.357 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.357 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.357 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.357 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.357 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.357 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.358 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption6": { 2024-04-24T23:07:57.358 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption6", 2024-04-24T23:07:57.358 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.358 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.358 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.358 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.358 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.358 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.358 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.358 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.358 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.358 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.358 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.359 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.359 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption7": { 2024-04-24T23:07:57.359 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption7", 2024-04-24T23:07:57.359 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.359 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.359 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.359 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.359 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-24T23:07:57.359 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "42", 2024-04-24T23:07:57.359 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.359 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.359 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.359 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.359 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.359 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.360 INFO:teuthology.orchestra.run.smithi043.stdout: "testkey": { 2024-04-24T23:07:57.360 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testkey", 2024-04-24T23:07:57.360 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.360 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.360 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.360 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.360 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.360 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.360 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.360 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.360 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.360 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.360 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.361 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.361 INFO:teuthology.orchestra.run.smithi043.stdout: "testlkey": { 2024-04-24T23:07:57.361 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testlkey", 2024-04-24T23:07:57.361 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.361 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.361 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.361 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.361 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.361 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.361 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.361 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.361 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.361 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.361 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.361 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.362 INFO:teuthology.orchestra.run.smithi043.stdout: "testnewline": { 2024-04-24T23:07:57.362 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testnewline", 2024-04-24T23:07:57.362 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.362 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.362 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.362 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.362 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.362 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.362 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.362 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.362 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.362 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.363 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.363 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.363 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.363 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.363 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.363 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-04-24T23:07:57.363 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.363 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.363 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.363 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_m_granularity": { 2024-04-24T23:07:57.363 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_m_granularity", 2024-04-24T23:07:57.363 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.363 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.363 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.364 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.364 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.364 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.364 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.364 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow minute scheduled snapshots", 2024-04-24T23:07:57.364 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.364 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.364 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.364 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.364 INFO:teuthology.orchestra.run.smithi043.stdout: "dump_on_update": { 2024-04-24T23:07:57.364 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dump_on_update", 2024-04-24T23:07:57.364 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.364 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.364 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.364 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.365 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.365 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.365 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.365 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "dump database to debug log on update", 2024-04-24T23:07:57.365 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.365 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.365 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.365 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.365 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.365 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.365 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.365 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.365 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.365 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.365 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.366 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.366 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.366 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.366 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.366 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.366 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.366 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.366 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.366 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.366 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.366 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.366 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.366 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.366 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.366 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.367 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.367 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.367 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.367 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.367 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.367 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.367 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.367 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.367 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.367 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.367 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.367 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.367 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.367 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.368 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.368 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.368 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.368 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.368 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.368 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.368 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.368 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.368 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.368 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.368 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.368 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.368 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.368 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.368 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.369 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.369 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.369 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.369 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.369 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.369 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.369 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.369 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.369 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.369 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.369 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.369 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.370 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.370 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.370 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.370 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.370 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.370 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.370 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.370 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.370 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.370 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.370 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stats", 2024-04-24T23:07:57.370 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.370 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.370 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.371 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.373 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.373 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.373 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.373 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.373 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.373 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.373 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.373 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.373 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.373 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.373 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.373 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.373 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.373 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.373 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.374 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.374 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.374 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.374 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.374 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.374 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.374 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.374 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.374 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.374 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.374 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.374 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.374 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.374 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "status", 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.375 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.376 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.378 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.378 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.378 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.378 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.378 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.378 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.378 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.378 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.378 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.378 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.378 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.378 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.378 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.379 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.379 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.379 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.379 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.379 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.379 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.379 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.379 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.379 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.379 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.379 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.379 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.379 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.379 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.380 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.380 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.380 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.380 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.380 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.380 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.380 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.380 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.380 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.380 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.380 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.380 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.380 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.380 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.380 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.381 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.381 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telegraf", 2024-04-24T23:07:57.381 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.381 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.381 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.381 INFO:teuthology.orchestra.run.smithi043.stdout: "address": { 2024-04-24T23:07:57.381 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "address", 2024-04-24T23:07:57.381 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.381 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.381 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.381 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-24T23:07:57.381 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.381 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.381 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.381 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.382 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.382 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.382 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.382 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.382 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-24T23:07:57.382 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-24T23:07:57.382 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.382 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.382 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.382 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15", 2024-04-24T23:07:57.382 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.382 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.382 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.383 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.383 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.383 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.383 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.383 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.383 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.383 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.383 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.383 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.383 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.383 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.383 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.383 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.383 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.384 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.384 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.384 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.384 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.384 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.384 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.384 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.384 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.384 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.384 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.384 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.384 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.384 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.384 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.384 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.385 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.385 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.385 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.385 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.385 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.385 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.385 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.385 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.385 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.385 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.385 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.386 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.386 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.386 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.386 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.386 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.386 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.386 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.386 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.386 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.386 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.386 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.386 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.386 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.387 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.387 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.387 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.387 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.387 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.387 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.387 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.387 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.387 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.387 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.387 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.387 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.387 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.387 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.387 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.388 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.388 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.388 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.388 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.388 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.388 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.388 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.388 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.388 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.388 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.388 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telemetry", 2024-04-24T23:07:57.388 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.388 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.388 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.388 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_basic": { 2024-04-24T23:07:57.389 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_basic", 2024-04-24T23:07:57.389 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.389 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.389 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.389 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.389 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.389 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.389 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.389 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-24T23:07:57.389 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.389 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.389 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.389 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.389 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_crash": { 2024-04-24T23:07:57.389 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_crash", 2024-04-24T23:07:57.390 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.390 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.390 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.390 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.390 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.390 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.390 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.390 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-24T23:07:57.390 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.390 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.390 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.390 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.390 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_device": { 2024-04-24T23:07:57.391 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_device", 2024-04-24T23:07:57.391 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.391 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.391 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.391 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.391 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.391 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.391 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.391 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-24T23:07:57.391 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.391 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.391 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.391 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.392 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_ident": { 2024-04-24T23:07:57.392 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_ident", 2024-04-24T23:07:57.392 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.392 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.392 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.392 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.392 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.392 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.392 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.392 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-24T23:07:57.392 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.392 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.392 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.392 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.392 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_perf": { 2024-04-24T23:07:57.393 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_perf", 2024-04-24T23:07:57.393 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.393 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.393 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.393 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.393 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.393 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.393 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.393 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-24T23:07:57.393 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.393 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.393 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.393 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.393 INFO:teuthology.orchestra.run.smithi043.stdout: "contact": { 2024-04-24T23:07:57.394 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "contact", 2024-04-24T23:07:57.394 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.394 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.394 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.394 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.394 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.394 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.394 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.394 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.394 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.394 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.394 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.394 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.395 INFO:teuthology.orchestra.run.smithi043.stdout: "description": { 2024-04-24T23:07:57.395 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "description", 2024-04-24T23:07:57.395 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.395 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.395 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.395 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.395 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.395 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.395 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.395 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.395 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.395 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.396 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.396 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.396 INFO:teuthology.orchestra.run.smithi043.stdout: "device_url": { 2024-04-24T23:07:57.396 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_url", 2024-04-24T23:07:57.396 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.396 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.396 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.396 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-24T23:07:57.396 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.396 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.396 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.396 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.396 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.396 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.396 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-24T23:07:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-24T23:07:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.397 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.398 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-24T23:07:57.398 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-24T23:07:57.398 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.398 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.398 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.398 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "24", 2024-04-24T23:07:57.398 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "8", 2024-04-24T23:07:57.398 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.398 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.398 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.398 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.398 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.398 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.399 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.399 INFO:teuthology.orchestra.run.smithi043.stdout: "last_opt_revision": { 2024-04-24T23:07:57.399 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "last_opt_revision", 2024-04-24T23:07:57.399 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.399 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.399 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.399 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1", 2024-04-24T23:07:57.399 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.399 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.399 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.399 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.399 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.399 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.399 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.400 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.400 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard": { 2024-04-24T23:07:57.400 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard", 2024-04-24T23:07:57.400 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.400 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.400 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.400 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.400 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.400 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.400 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.401 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.401 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.401 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.401 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.401 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.401 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard_description": { 2024-04-24T23:07:57.401 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard_description", 2024-04-24T23:07:57.401 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.401 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.401 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.401 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.401 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.401 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.401 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.402 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.402 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.402 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.402 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.402 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.402 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.402 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.402 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.402 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.402 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.402 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.402 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.402 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.402 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.403 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.403 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.403 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.403 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.403 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.403 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.403 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.403 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.403 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.403 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.403 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.403 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.403 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.403 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.403 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.404 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.404 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.404 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.404 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.404 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.404 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.404 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.404 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.404 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.404 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.404 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.404 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.405 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.405 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.405 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.405 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.405 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.405 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.405 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.405 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.405 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.405 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.405 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.406 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.406 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.406 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.406 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.406 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.406 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.406 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.406 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.406 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.406 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.406 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.406 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.406 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.407 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.407 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.407 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.407 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.407 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.407 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.407 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.407 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.407 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.407 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.407 INFO:teuthology.orchestra.run.smithi043.stdout: "organization": { 2024-04-24T23:07:57.407 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "organization", 2024-04-24T23:07:57.408 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.408 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.408 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.408 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.408 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.408 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.408 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.408 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.408 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.408 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.408 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.408 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.408 INFO:teuthology.orchestra.run.smithi043.stdout: "proxy": { 2024-04-24T23:07:57.408 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "proxy", 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: "url": { 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url", 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.409 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.410 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.410 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-24T23:07:57.410 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.410 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.410 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.410 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.410 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.410 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.410 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.410 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.410 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.410 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.410 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.410 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "test_orchestrator", 2024-04-24T23:07:57.410 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.411 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.411 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.411 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.411 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.411 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.411 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.411 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.411 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.412 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.412 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.412 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.412 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.412 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.412 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.412 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.412 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.412 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.412 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.412 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.413 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.414 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.414 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.414 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.414 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.414 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.414 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.414 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.414 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.414 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.414 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.414 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.414 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.414 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.415 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.415 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.415 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.415 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.415 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.415 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.415 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.415 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.415 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.415 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.415 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.415 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.415 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.415 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.415 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "volumes", 2024-04-24T23:07:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.416 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.417 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.417 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.417 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.417 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.417 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.417 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.417 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.417 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.417 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.417 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.417 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.417 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.417 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.417 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.417 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.418 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.418 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.418 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.418 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.418 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.418 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.418 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.418 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.418 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.419 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.419 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.419 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.419 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.419 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.419 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.419 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.419 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.419 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.419 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.419 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.419 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.419 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.419 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.420 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.420 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.420 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.420 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.420 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.420 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.420 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.420 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.420 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.420 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.420 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.420 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.420 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.421 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.421 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.421 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.421 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.421 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.421 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.421 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.421 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.421 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.421 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.421 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.421 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.421 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.421 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.422 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.422 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.422 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.422 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.422 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.422 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.422 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_clones": { 2024-04-24T23:07:57.422 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_clones", 2024-04-24T23:07:57.422 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.422 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.422 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.422 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4", 2024-04-24T23:07:57.423 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.423 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.423 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.423 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-24T23:07:57.423 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.423 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.423 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.423 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.423 INFO:teuthology.orchestra.run.smithi043.stdout: "periodic_async_work": { 2024-04-24T23:07:57.423 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "periodic_async_work", 2024-04-24T23:07:57.423 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.423 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.423 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.423 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.423 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.424 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.424 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.424 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Periodically check for async work", 2024-04-24T23:07:57.424 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.424 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.424 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.424 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.424 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_delay": { 2024-04-24T23:07:57.424 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_delay", 2024-04-24T23:07:57.424 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.424 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.424 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.424 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-24T23:07:57.424 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.424 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.425 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.425 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-24T23:07:57.425 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.425 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.425 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.425 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.425 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_no_wait": { 2024-04-24T23:07:57.425 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_no_wait", 2024-04-24T23:07:57.425 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.425 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.425 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.425 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.425 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.425 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.425 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.426 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-24T23:07:57.426 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.426 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.426 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.426 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.426 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.426 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.426 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.426 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix", 2024-04-24T23:07:57.426 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.426 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.426 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.426 INFO:teuthology.orchestra.run.smithi043.stdout: "discovery_interval": { 2024-04-24T23:07:57.426 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "discovery_interval", 2024-04-24T23:07:57.427 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-24T23:07:57.427 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.427 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.427 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "100", 2024-04-24T23:07:57.427 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.427 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.427 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.427 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.427 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.427 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.427 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.427 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.427 INFO:teuthology.orchestra.run.smithi043.stdout: "identifier": { 2024-04-24T23:07:57.427 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "identifier", 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.428 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.429 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.429 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-24T23:07:57.429 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.429 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.429 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.429 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.429 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.429 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.429 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.429 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.429 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.429 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.429 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.429 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.429 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.430 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.430 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.430 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.430 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.430 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.430 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.430 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.430 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.430 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.430 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.430 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.430 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.430 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.431 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.431 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.431 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.431 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.431 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.431 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.431 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.431 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.431 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.431 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.431 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.431 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.432 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.432 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.432 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.432 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.432 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.432 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.432 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.432 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.432 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.432 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.432 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.432 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.432 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.432 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.432 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.433 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.433 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.433 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.433 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.433 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.433 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.433 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.433 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.433 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.433 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.433 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.433 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.433 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.433 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.434 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.434 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.434 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.434 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.434 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.434 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.434 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.434 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.434 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.434 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.434 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.434 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_host": { 2024-04-24T23:07:57.434 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_host", 2024-04-24T23:07:57.434 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.435 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.435 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.435 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.435 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.435 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.435 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.435 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.435 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.435 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.435 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.435 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.435 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_port": { 2024-04-24T23:07:57.435 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_port", 2024-04-24T23:07:57.435 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.435 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.436 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.436 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10051", 2024-04-24T23:07:57.436 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.436 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.436 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.436 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.436 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.436 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.436 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.436 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.436 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_sender": { 2024-04-24T23:07:57.436 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_sender", 2024-04-24T23:07:57.437 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.437 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.437 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.437 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-24T23:07:57.437 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.438 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.438 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.438 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.438 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.438 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.438 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.439 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.439 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.439 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.439 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-24T23:07:57.439 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.439 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.440 INFO:teuthology.orchestra.run.smithi043.stdout: "modules": [ 2024-04-24T23:07:57.440 INFO:teuthology.orchestra.run.smithi043.stdout: "iostat", 2024-04-24T23:07:57.440 INFO:teuthology.orchestra.run.smithi043.stdout: "nfs", 2024-04-24T23:07:57.440 INFO:teuthology.orchestra.run.smithi043.stdout: "restful" 2024-04-24T23:07:57.440 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.440 INFO:teuthology.orchestra.run.smithi043.stdout: "available_modules": [ 2024-04-24T23:07:57.441 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.441 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "alerts", 2024-04-24T23:07:57.441 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.441 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.441 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.441 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-24T23:07:57.441 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-24T23:07:57.441 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.441 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.441 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.442 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-24T23:07:57.442 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.442 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.442 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.442 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How frequently to reexamine health status", 2024-04-24T23:07:57.442 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.443 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.443 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.443 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.443 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.443 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.443 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.444 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.444 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.444 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.444 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.444 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.444 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.444 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.445 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.445 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.445 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.445 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.445 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.445 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.446 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.446 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.446 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.446 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.446 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.447 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.447 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.447 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.447 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.447 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.447 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.448 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.448 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.448 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.448 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.448 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.448 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.448 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.449 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.449 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.449 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.449 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.449 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.450 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.450 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.450 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.450 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.450 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.450 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.451 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.451 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.451 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.451 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.451 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.451 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.451 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.452 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.452 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.452 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.452 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.452 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.452 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.453 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.453 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.453 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.453 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.453 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.453 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.454 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.454 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.454 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.454 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.454 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.454 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.455 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_destination": { 2024-04-24T23:07:57.455 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_destination", 2024-04-24T23:07:57.455 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.455 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.455 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.455 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.456 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.456 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.456 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.456 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email address to send alerts to", 2024-04-24T23:07:57.456 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.456 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.456 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.456 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.456 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_from_name": { 2024-04-24T23:07:57.457 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_from_name", 2024-04-24T23:07:57.457 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.457 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.457 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.457 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "Ceph", 2024-04-24T23:07:57.457 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.457 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.457 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.458 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email From: name", 2024-04-24T23:07:57.458 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.458 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.458 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.458 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.458 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_host": { 2024-04-24T23:07:57.458 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_host", 2024-04-24T23:07:57.458 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.459 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.459 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.459 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.459 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.459 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.459 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.459 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP server", 2024-04-24T23:07:57.460 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.460 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.460 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.460 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.460 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_password": { 2024-04-24T23:07:57.460 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_password", 2024-04-24T23:07:57.460 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.460 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.460 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Password to authenticate with", 2024-04-24T23:07:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_port": { 2024-04-24T23:07:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_port", 2024-04-24T23:07:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.461 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "465", 2024-04-24T23:07:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP port", 2024-04-24T23:07:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_sender": { 2024-04-24T23:07:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_sender", 2024-04-24T23:07:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.462 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.463 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.463 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.463 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.463 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.463 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP envelope sender", 2024-04-24T23:07:57.463 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.463 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.463 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.463 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.463 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_ssl": { 2024-04-24T23:07:57.463 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_ssl", 2024-04-24T23:07:57.463 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.463 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.464 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.464 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.464 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.464 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.464 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.464 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-24T23:07:57.464 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.464 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.464 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.464 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.464 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_user": { 2024-04-24T23:07:57.464 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_user", 2024-04-24T23:07:57.464 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.465 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.465 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.465 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.465 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.465 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.465 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.465 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "User to authenticate as", 2024-04-24T23:07:57.465 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.465 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.465 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.465 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.465 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.465 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.465 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.465 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "balancer", 2024-04-24T23:07:57.466 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.466 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.466 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.466 INFO:teuthology.orchestra.run.smithi043.stdout: "active": { 2024-04-24T23:07:57.466 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "active", 2024-04-24T23:07:57.466 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.466 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.466 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.466 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.466 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.466 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.466 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.466 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically balance PGs across cluster", 2024-04-24T23:07:57.466 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_time": { 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_time", 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0000", 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "beginning time of day to automatically balance", 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.467 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_weekday": { 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_weekday", 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_max_iterations": { 2024-04-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_max_iterations", 2024-04-24T23:07:57.469 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-24T23:07:57.469 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.469 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.469 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "25", 2024-04-24T23:07:57.469 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-24T23:07:57.469 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "250", 2024-04-24T23:07:57.469 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.469 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-24T23:07:57.469 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.469 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.469 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.469 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.469 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_metrics": { 2024-04-24T23:07:57.469 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_metrics", 2024-04-24T23:07:57.470 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.470 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.470 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.470 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "pgs,objects,bytes", 2024-04-24T23:07:57.470 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.470 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.470 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.470 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-24T23:07:57.470 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-24T23:07:57.470 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.470 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.470 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.470 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_step": { 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_step", 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.5", 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0.001", 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "0.999", 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "aggressiveness of optimization", 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: "end_time": { 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_time", 2024-04-24T23:07:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2359", 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ending time of day to automatically balance", 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "end_weekday": { 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_weekday", 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.473 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.474 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.474 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.474 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.474 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.474 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.474 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.474 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.474 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.474 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.474 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.474 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.474 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.474 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.474 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.474 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.475 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.476 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.477 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.477 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.477 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.477 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.477 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.477 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.477 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.477 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.477 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.477 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.477 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.477 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.477 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.477 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.477 INFO:teuthology.orchestra.run.smithi043.stdout: "min_score": { 2024-04-24T23:07:57.478 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_score", 2024-04-24T23:07:57.478 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-24T23:07:57.478 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.478 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.478 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-24T23:07:57.478 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.478 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.478 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.478 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-24T23:07:57.478 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.478 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.478 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.478 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.478 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-24T23:07:57.479 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-24T23:07:57.479 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.479 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.479 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.479 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "upmap", 2024-04-24T23:07:57.479 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.479 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.479 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.479 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-compat", 2024-04-24T23:07:57.479 INFO:teuthology.orchestra.run.smithi043.stdout: "none", 2024-04-24T23:07:57.479 INFO:teuthology.orchestra.run.smithi043.stdout: "read", 2024-04-24T23:07:57.479 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap", 2024-04-24T23:07:57.479 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap-read" 2024-04-24T23:07:57.479 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.479 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Balancer mode", 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_ids": { 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_ids", 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.480 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.481 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_deviation": { 2024-04-24T23:07:57.482 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_deviation", 2024-04-24T23:07:57.482 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.482 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.482 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.482 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-24T23:07:57.482 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-24T23:07:57.482 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.482 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.482 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-24T23:07:57.482 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-24T23:07:57.482 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.482 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.482 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.482 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_optimizations": { 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_optimizations", 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.483 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm", 2024-04-24T23:07:57.484 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.484 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.484 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.484 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_down_multiplier": { 2024-04-24T23:07:57.484 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_down_multiplier", 2024-04-24T23:07:57.484 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-24T23:07:57.484 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.484 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.484 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-24T23:07:57.484 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.484 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.484 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.484 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-24T23:07:57.485 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.485 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.485 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.485 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.485 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_refresh_rate": { 2024-04-24T23:07:57.485 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_refresh_rate", 2024-04-24T23:07:57.485 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.485 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.485 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.486 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "20", 2024-04-24T23:07:57.486 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.486 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.486 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.486 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-24T23:07:57.486 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.486 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.486 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.487 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.487 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_starting_port": { 2024-04-24T23:07:57.487 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_starting_port", 2024-04-24T23:07:57.487 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.487 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.487 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.487 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4721", 2024-04-24T23:07:57.487 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.487 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.488 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.488 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-24T23:07:57.488 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.488 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.488 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.488 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.488 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_ptrace": { 2024-04-24T23:07:57.488 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_ptrace", 2024-04-24T23:07:57.488 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.488 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.489 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.489 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.489 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.489 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.489 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.489 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-24T23:07:57.489 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-24T23:07:57.489 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.489 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.490 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.490 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_interval": { 2024-04-24T23:07:57.490 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_interval", 2024-04-24T23:07:57.490 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.490 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.490 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.490 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-24T23:07:57.490 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.491 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.491 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.491 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-24T23:07:57.491 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.491 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.491 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.491 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.491 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_memory_target_ratio": { 2024-04-24T23:07:57.491 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_memory_target_ratio", 2024-04-24T23:07:57.492 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-24T23:07:57.492 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.492 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.492 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.7", 2024-04-24T23:07:57.492 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.492 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.492 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.492 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-24T23:07:57.493 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.493 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.493 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.493 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.493 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm_log_destination": { 2024-04-24T23:07:57.493 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm_log_destination", 2024-04-24T23:07:57.493 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.493 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.493 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: "file", 2024-04-24T23:07:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: "file,syslog", 2024-04-24T23:07:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: "syslog" 2024-04-24T23:07:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.494 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-24T23:07:57.495 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.495 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.495 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.495 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.495 INFO:teuthology.orchestra.run.smithi043.stdout: "cgroups_split": { 2024-04-24T23:07:57.495 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cgroups_split", 2024-04-24T23:07:57.495 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.495 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.495 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-24T23:07:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.496 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: "config_checks_enabled": { 2024-04-24T23:07:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_checks_enabled", 2024-04-24T23:07:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-24T23:07:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: "config_dashboard": { 2024-04-24T23:07:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_dashboard", 2024-04-24T23:07:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.498 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-24T23:07:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_alertmanager": { 2024-04-24T23:07:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_alertmanager", 2024-04-24T23:07:57.499 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-24T23:07:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-24T23:07:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_base": { 2024-04-24T23:07:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_base", 2024-04-24T23:07:57.500 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-24T23:07:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Container image name, without the tag", 2024-04-24T23:07:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_elasticsearch": { 2024-04-24T23:07:57.501 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_elasticsearch", 2024-04-24T23:07:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-24T23:07:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "elasticsearch container image", 2024-04-24T23:07:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.502 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_grafana": { 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_grafana", 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_haproxy": { 2024-04-24T23:07:57.503 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_haproxy", 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "HAproxy container image", 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_agent": { 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_agent", 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.504 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger agent container image", 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_collector": { 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_collector", 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-24T23:07:57.505 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger collector container image", 2024-04-24T23:07:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_query": { 2024-04-24T23:07:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_query", 2024-04-24T23:07:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-24T23:07:57.506 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger query container image", 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_keepalived": { 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_keepalived", 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.507 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Keepalived container image", 2024-04-24T23:07:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_loki": { 2024-04-24T23:07:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_loki", 2024-04-24T23:07:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-24T23:07:57.508 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Loki container image", 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_node_exporter": { 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_node_exporter", 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.509 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-24T23:07:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_nvmeof": { 2024-04-24T23:07:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_nvmeof", 2024-04-24T23:07:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-24T23:07:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Nvme-of container image", 2024-04-24T23:07:57.510 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_prometheus": { 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_prometheus", 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.511 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_promtail": { 2024-04-24T23:07:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_promtail", 2024-04-24T23:07:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-24T23:07:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Promtail container image", 2024-04-24T23:07:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.512 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_samba": { 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_samba", 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Samba/SMB container image", 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.513 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_snmp_gateway": { 2024-04-24T23:07:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_snmp_gateway", 2024-04-24T23:07:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-24T23:07:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SNMP Gateway container image", 2024-04-24T23:07:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.514 INFO:teuthology.orchestra.run.smithi043.stdout: "container_init": { 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_init", 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Run podman/docker with `--init`", 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "daemon_cache_timeout": { 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "daemon_cache_timeout", 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.515 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "default_cephadm_command_timeout": { 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_cephadm_command_timeout", 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.516 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "900", 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "default_registry": { 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_registry", 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io", 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.517 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-24T23:07:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "device_cache_timeout": { 2024-04-24T23:07:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_cache_timeout", 2024-04-24T23:07:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1800", 2024-04-24T23:07:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.518 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache device inventory", 2024-04-24T23:07:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "device_enhanced_scan": { 2024-04-24T23:07:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_enhanced_scan", 2024-04-24T23:07:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.519 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "facts_cache_timeout": { 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "facts_cache_timeout", 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache host facts data", 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.520 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "grafana_dashboards_path": { 2024-04-24T23:07:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "grafana_dashboards_path", 2024-04-24T23:07:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-24T23:07:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-24T23:07:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.521 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "host_check_interval": { 2024-04-24T23:07:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "host_check_interval", 2024-04-24T23:07:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-24T23:07:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to perform a host check", 2024-04-24T23:07:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.522 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "hw_monitoring": { 2024-04-24T23:07:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hw_monitoring", 2024-04-24T23:07:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-24T23:07:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.523 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: "inventory_list_all": { 2024-04-24T23:07:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "inventory_list_all", 2024-04-24T23:07:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-24T23:07:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.524 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.525 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.525 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.525 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.525 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.525 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.525 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.525 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.525 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.525 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.525 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.525 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.525 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.525 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.525 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.525 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.526 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.526 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.526 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.526 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.526 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.526 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.526 INFO:teuthology.orchestra.run.smithi043.stdout: "log_refresh_metadata": { 2024-04-24T23:07:57.526 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_refresh_metadata", 2024-04-24T23:07:57.526 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.526 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.526 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.526 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.526 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.526 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-24T23:07:57.527 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.528 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.529 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.530 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.530 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.530 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.530 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.530 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.530 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.530 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-24T23:07:57.530 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-24T23:07:57.530 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.530 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.530 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.530 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.530 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.530 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.530 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.531 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-24T23:07:57.531 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.531 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.531 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.531 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.531 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-24T23:07:57.531 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-24T23:07:57.531 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.531 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.531 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.531 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "*", 2024-04-24T23:07:57.531 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.531 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.531 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.531 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-24T23:07:57.532 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.532 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.532 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.532 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.532 INFO:teuthology.orchestra.run.smithi043.stdout: "max_count_per_host": { 2024-04-24T23:07:57.532 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_count_per_host", 2024-04-24T23:07:57.532 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.532 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.532 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.532 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-24T23:07:57.532 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.532 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.532 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.532 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of daemons per service per host", 2024-04-24T23:07:57.533 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.533 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.533 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.533 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.533 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd_draining_count": { 2024-04-24T23:07:57.533 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_osd_draining_count", 2024-04-24T23:07:57.533 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.533 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.533 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.533 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-24T23:07:57.533 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.533 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.533 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.533 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-24T23:07:57.533 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.534 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.534 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.534 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.534 INFO:teuthology.orchestra.run.smithi043.stdout: "migration_current": { 2024-04-24T23:07:57.534 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "migration_current", 2024-04-24T23:07:57.534 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.534 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.534 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.534 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.534 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.534 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.534 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.534 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "internal - do not modify", 2024-04-24T23:07:57.534 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.534 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.535 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.535 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.535 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-24T23:07:57.535 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-24T23:07:57.535 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.535 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.535 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.535 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "root", 2024-04-24T23:07:57.535 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.535 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.535 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.535 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm-package", 2024-04-24T23:07:57.535 INFO:teuthology.orchestra.run.smithi043.stdout: "root" 2024-04-24T23:07:57.535 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "mode for remote execution of cephadm", 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "oob_default_addr": { 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "oob_default_addr", 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "169.254.1.1", 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.536 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.537 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.537 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.537 INFO:teuthology.orchestra.run.smithi043.stdout: "prometheus_alerts_path": { 2024-04-24T23:07:57.537 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus_alerts_path", 2024-04-24T23:07:57.537 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.537 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.537 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.537 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-24T23:07:57.537 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.537 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.537 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.537 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-24T23:07:57.537 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_insecure": { 2024-04-24T23:07:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_insecure", 2024-04-24T23:07:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-24T23:07:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.539 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.539 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.539 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_password": { 2024-04-24T23:07:57.539 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_password", 2024-04-24T23:07:57.539 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.539 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.539 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.539 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.539 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.539 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.539 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.539 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-24T23:07:57.539 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.539 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_url": { 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_url", 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.540 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_username": { 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_username", 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: "secure_monitoring_stack": { 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "secure_monitoring_stack", 2024-04-24T23:07:57.541 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.542 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.542 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.542 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.542 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.542 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.542 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.542 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-24T23:07:57.542 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.542 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.542 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.542 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.542 INFO:teuthology.orchestra.run.smithi043.stdout: "service_discovery_port": { 2024-04-24T23:07:57.542 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "service_discovery_port", 2024-04-24T23:07:57.542 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.543 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.543 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.543 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8765", 2024-04-24T23:07:57.543 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.543 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.543 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.543 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "cephadm service discovery port", 2024-04-24T23:07:57.543 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.543 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.543 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.543 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.543 INFO:teuthology.orchestra.run.smithi043.stdout: "ssh_config_file": { 2024-04-24T23:07:57.543 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssh_config_file", 2024-04-24T23:07:57.543 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.543 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-24T23:07:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: "use_agent": { 2024-04-24T23:07:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_agent", 2024-04-24T23:07:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.544 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.545 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.545 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.545 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.545 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.545 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-24T23:07:57.545 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.545 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.545 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.545 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.545 INFO:teuthology.orchestra.run.smithi043.stdout: "use_repo_digest": { 2024-04-24T23:07:57.545 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_repo_digest", 2024-04-24T23:07:57.545 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.545 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.545 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.546 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.546 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.546 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.546 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.546 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-24T23:07:57.546 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.546 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.546 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.546 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.546 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_failed_host_check": { 2024-04-24T23:07:57.546 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_failed_host_check", 2024-04-24T23:07:57.546 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.547 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.547 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.547 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.547 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.547 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.547 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.547 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if the host check fails", 2024-04-24T23:07:57.547 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.547 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.547 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.547 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.547 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_daemons": { 2024-04-24T23:07:57.548 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_daemons", 2024-04-24T23:07:57.548 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.548 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.548 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.548 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.548 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.548 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.548 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.548 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-24T23:07:57.548 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.548 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.548 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.548 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.548 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_hosts": { 2024-04-24T23:07:57.549 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_hosts", 2024-04-24T23:07:57.549 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.549 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.549 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.549 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.549 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.549 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.549 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.549 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-24T23:07:57.549 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.549 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.549 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.549 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.549 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.550 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.550 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.550 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crash", 2024-04-24T23:07:57.550 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.550 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.550 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.550 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.550 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.550 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.550 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.550 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.550 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.550 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.550 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.550 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.551 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.552 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.553 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.553 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.553 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.553 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.553 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.553 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.553 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.553 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.553 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.553 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.553 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.553 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.553 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.553 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.554 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.554 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.554 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.554 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.554 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.554 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.554 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.554 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.554 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.554 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.554 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.554 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.554 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.554 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.555 INFO:teuthology.orchestra.run.smithi043.stdout: "retain_interval": { 2024-04-24T23:07:57.555 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retain_interval", 2024-04-24T23:07:57.555 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.555 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.555 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.555 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "31536000", 2024-04-24T23:07:57.555 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.555 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.555 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.555 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-24T23:07:57.556 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.556 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.556 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.556 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.556 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_recent_interval": { 2024-04-24T23:07:57.556 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_recent_interval", 2024-04-24T23:07:57.556 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.556 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.557 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.557 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1209600", 2024-04-24T23:07:57.557 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.557 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.557 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.557 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-24T23:07:57.557 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.557 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.557 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.557 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.557 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.557 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.557 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.557 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dashboard", 2024-04-24T23:07:57.557 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.558 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.558 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.558 INFO:teuthology.orchestra.run.smithi043.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-24T23:07:57.558 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-24T23:07:57.558 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.558 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.558 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.558 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-24T23:07:57.558 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.558 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.558 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.558 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.558 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.558 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.559 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.559 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.559 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_HOST": { 2024-04-24T23:07:57.559 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-24T23:07:57.559 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.559 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.559 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.559 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.559 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.559 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.559 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.559 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.559 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.559 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.560 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.560 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.560 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-24T23:07:57.560 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-24T23:07:57.560 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.560 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.560 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.560 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.560 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.560 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.560 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.560 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.560 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.561 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.561 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.561 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.561 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_ENABLED": { 2024-04-24T23:07:57.561 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_ENABLED", 2024-04-24T23:07:57.561 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.561 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.561 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.561 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.561 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.561 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.561 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.561 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.561 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.562 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.562 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.562 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.562 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-24T23:07:57.562 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-24T23:07:57.562 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.562 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.562 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.562 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.562 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.562 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.562 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.562 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.562 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.563 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.563 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.563 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.563 INFO:teuthology.orchestra.run.smithi043.stdout: "ENABLE_BROWSABLE_API": { 2024-04-24T23:07:57.563 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-24T23:07:57.563 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.563 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.563 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.563 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.563 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.563 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.563 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.563 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.563 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.563 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.564 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.564 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.564 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-24T23:07:57.564 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-24T23:07:57.564 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.564 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.564 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.564 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.564 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.564 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.564 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.564 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.564 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.564 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.565 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-24T23:07:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-24T23:07:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.566 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-24T23:07:57.567 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-24T23:07:57.567 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.567 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.567 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.567 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.567 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.567 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.567 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.567 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.567 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.567 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.567 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.567 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.567 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-24T23:07:57.567 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-24T23:07:57.568 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.568 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.568 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.568 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.568 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.568 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.568 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.568 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.568 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.568 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.568 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.568 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.568 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-24T23:07:57.568 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-24T23:07:57.568 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.569 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.569 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.569 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.569 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.569 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.569 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.569 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.569 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.569 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.569 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.569 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.569 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-24T23:07:57.570 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-24T23:07:57.570 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.570 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.570 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.570 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.570 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.570 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.571 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.571 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.571 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.571 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.571 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.571 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.571 INFO:teuthology.orchestra.run.smithi043.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-24T23:07:57.571 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-24T23:07:57.571 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.572 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.572 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.572 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.572 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.572 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.572 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.572 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.572 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.572 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.573 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.573 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.573 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_PASSWORD": { 2024-04-24T23:07:57.573 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-24T23:07:57.573 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.573 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.573 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.573 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-24T23:07:57.574 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.574 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.574 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.574 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.574 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.574 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.575 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.575 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.575 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-24T23:07:57.575 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-24T23:07:57.575 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.575 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.575 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.576 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.576 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.576 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.576 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.576 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.576 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.576 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.576 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.577 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.577 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_URL": { 2024-04-24T23:07:57.577 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_URL", 2024-04-24T23:07:57.577 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.577 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.577 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.577 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.578 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.578 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.578 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.578 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.578 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.578 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.578 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.578 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.579 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_USERNAME": { 2024-04-24T23:07:57.579 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-24T23:07:57.579 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.579 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.579 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.579 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-24T23:07:57.579 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.580 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.580 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.580 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.580 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.580 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.580 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.580 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.581 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-24T23:07:57.581 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-24T23:07:57.581 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.581 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.581 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.581 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.581 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.582 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.582 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.582 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.582 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.582 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.582 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.582 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.582 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-24T23:07:57.582 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-24T23:07:57.582 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.582 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.582 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.582 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.583 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.583 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.583 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.583 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.583 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.583 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.583 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.583 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.583 INFO:teuthology.orchestra.run.smithi043.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-24T23:07:57.583 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-24T23:07:57.583 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.583 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.583 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.583 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.583 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.584 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_HOST": { 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.586 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.586 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.586 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.586 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-24T23:07:57.586 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-24T23:07:57.586 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.586 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.586 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.586 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.586 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.586 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.586 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.586 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.586 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.587 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.587 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.587 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.587 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-24T23:07:57.587 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-24T23:07:57.587 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.587 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.587 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.587 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.587 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.587 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.587 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.587 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.587 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.587 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.588 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-24T23:07:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.590 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.590 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.590 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.590 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.590 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.590 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.590 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.590 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.590 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.590 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.590 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.590 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-24T23:07:57.590 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-24T23:07:57.591 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.591 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.591 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.591 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.591 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.591 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.591 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.591 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.592 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.592 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.592 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.592 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.592 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-24T23:07:57.592 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-24T23:07:57.592 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.592 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.593 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.593 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.593 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.593 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.593 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.593 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.593 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.593 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.593 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.593 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.594 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-24T23:07:57.594 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-24T23:07:57.594 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.594 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.594 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.594 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.594 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.594 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.595 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.595 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.595 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.595 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.595 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.595 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.595 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_ENABLED": { 2024-04-24T23:07:57.595 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-24T23:07:57.596 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.596 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.596 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.596 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.596 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.596 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.596 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.596 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.596 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.597 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.597 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.597 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.597 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-24T23:07:57.597 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-24T23:07:57.597 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.597 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.597 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.597 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-24T23:07:57.598 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.598 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.598 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.598 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.598 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.598 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.598 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.598 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.599 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-24T23:07:57.599 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-24T23:07:57.599 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.599 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.599 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.599 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-24T23:07:57.599 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.599 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.599 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.600 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.600 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.600 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.600 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.600 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.600 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-24T23:07:57.600 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-24T23:07:57.600 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.600 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.601 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.601 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8", 2024-04-24T23:07:57.601 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.601 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.601 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.601 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.601 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.601 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.601 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.602 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.602 INFO:teuthology.orchestra.run.smithi043.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-24T23:07:57.602 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-24T23:07:57.602 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.602 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.602 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.602 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "45", 2024-04-24T23:07:57.602 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.602 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.603 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.603 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.603 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.603 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.603 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.603 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.603 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ACCESS_KEY": { 2024-04-24T23:07:57.603 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-24T23:07:57.603 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.604 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.604 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.604 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.604 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.604 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.604 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.604 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.604 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.604 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.605 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.605 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.605 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-24T23:07:57.605 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-24T23:07:57.605 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.605 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.605 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.605 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-24T23:07:57.605 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.606 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.606 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.606 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.606 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.606 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.606 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.606 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.606 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SECRET_KEY": { 2024-04-24T23:07:57.606 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-24T23:07:57.606 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.607 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.607 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.607 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.607 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.607 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.607 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.607 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.607 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.607 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.607 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.607 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.607 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SSL_VERIFY": { 2024-04-24T23:07:57.607 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-24T23:07:57.607 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.608 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.608 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.608 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.608 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.608 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.608 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.608 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.608 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.608 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.608 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.608 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.608 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-24T23:07:57.608 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-24T23:07:57.608 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.608 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.609 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.609 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-24T23:07:57.609 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.609 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.609 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.609 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.609 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.609 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.609 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.609 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.609 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-24T23:07:57.609 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-24T23:07:57.609 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.609 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.609 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.610 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-24T23:07:57.610 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.610 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.610 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.610 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.610 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.610 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.610 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.610 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.610 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-24T23:07:57.610 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-24T23:07:57.610 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.610 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.610 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.611 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-24T23:07:57.611 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.611 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.611 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.611 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.611 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.611 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.611 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.611 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.611 INFO:teuthology.orchestra.run.smithi043.stdout: "cross_origin_url": { 2024-04-24T23:07:57.611 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cross_origin_url", 2024-04-24T23:07:57.611 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.611 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.611 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.611 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.612 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.612 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.612 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.612 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.612 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.612 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.612 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.612 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.612 INFO:teuthology.orchestra.run.smithi043.stdout: "crt_file": { 2024-04-24T23:07:57.612 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crt_file", 2024-04-24T23:07:57.612 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.612 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.613 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.613 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.613 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.613 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.613 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.613 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.613 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.613 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.613 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.613 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.613 INFO:teuthology.orchestra.run.smithi043.stdout: "debug": { 2024-04-24T23:07:57.613 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "debug", 2024-04-24T23:07:57.613 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.614 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.614 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.614 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.614 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.614 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.614 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.614 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable/disable debug options", 2024-04-24T23:07:57.614 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.614 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.614 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.614 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.614 INFO:teuthology.orchestra.run.smithi043.stdout: "jwt_token_ttl": { 2024-04-24T23:07:57.614 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "jwt_token_ttl", 2024-04-24T23:07:57.614 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.614 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.615 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.615 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "28800", 2024-04-24T23:07:57.615 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.615 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.615 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.615 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.615 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.615 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.615 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.615 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.615 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-24T23:07:57.615 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-24T23:07:57.615 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.616 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.616 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.616 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.616 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.616 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.616 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.616 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.616 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.616 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.616 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.616 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.617 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.617 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.617 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.617 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.617 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.617 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.617 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.617 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.617 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.617 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.617 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.617 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.617 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.618 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.618 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.618 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.618 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.618 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.618 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.618 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.618 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.618 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.618 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.618 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.618 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.618 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.619 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.619 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.619 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.619 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.619 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.619 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.619 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.619 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.619 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.619 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.619 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.619 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.619 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.619 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.620 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.620 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.620 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.620 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.620 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.620 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.620 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.620 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.620 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.620 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.620 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.620 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.620 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.620 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.620 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.621 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.621 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.621 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.621 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.621 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.621 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.621 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.621 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.621 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.621 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.621 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.621 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.621 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.621 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.621 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.622 INFO:teuthology.orchestra.run.smithi043.stdout: "motd": { 2024-04-24T23:07:57.622 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "motd", 2024-04-24T23:07:57.622 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.622 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.622 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.622 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.622 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.622 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.622 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.622 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "The message of the day", 2024-04-24T23:07:57.622 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.622 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.623 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.623 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.623 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect_resolve_ip_addr": { 2024-04-24T23:07:57.623 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "redirect_resolve_ip_addr", 2024-04-24T23:07:57.623 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.623 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.623 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.623 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.623 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.623 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.623 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.623 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.623 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.623 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.624 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.624 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.624 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-24T23:07:57.624 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-24T23:07:57.624 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.624 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.624 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.624 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-24T23:07:57.624 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.624 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.624 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.624 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.624 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.624 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.624 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8080", 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.625 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-24T23:07:57.626 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-24T23:07:57.626 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.626 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.626 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.626 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.626 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.626 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.626 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.626 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.626 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.626 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.626 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.626 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.627 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl_server_port": { 2024-04-24T23:07:57.627 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl_server_port", 2024-04-24T23:07:57.627 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.627 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.627 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.627 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8443", 2024-04-24T23:07:57.627 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.627 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.627 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.627 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.627 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.627 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.628 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.628 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.628 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-24T23:07:57.628 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-24T23:07:57.628 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.628 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.628 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.628 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "redirect", 2024-04-24T23:07:57.628 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.628 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.628 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.628 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.628 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect" 2024-04-24T23:07:57.628 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.629 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.629 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.629 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.629 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.629 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.629 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-24T23:07:57.629 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-24T23:07:57.629 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.629 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.629 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.629 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-24T23:07:57.629 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-24T23:07:57.629 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-24T23:07:57.629 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.629 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.630 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.630 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.630 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.630 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.630 INFO:teuthology.orchestra.run.smithi043.stdout: "url_prefix": { 2024-04-24T23:07:57.630 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url_prefix", 2024-04-24T23:07:57.630 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.630 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.630 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.630 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.630 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.630 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.630 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.630 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.631 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.631 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.631 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.631 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.631 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.631 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.631 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.631 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "devicehealth", 2024-04-24T23:07:57.631 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.633 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.634 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.634 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_monitoring": { 2024-04-24T23:07:57.634 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_monitoring", 2024-04-24T23:07:57.634 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.634 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.634 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.634 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.634 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.634 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.634 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.634 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "monitor device health metrics", 2024-04-24T23:07:57.634 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.634 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.635 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.635 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.635 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.635 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.635 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.635 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.635 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.635 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.635 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.635 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.635 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.635 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.635 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.635 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.635 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.637 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.637 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.637 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.637 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.637 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.637 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.637 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.637 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.637 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.637 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.637 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.637 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.637 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.637 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.637 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.638 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.638 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.638 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.638 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.638 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.638 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.638 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.638 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.638 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.638 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.638 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.638 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.638 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.638 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: "mark_out_threshold": { 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mark_out_threshold", 2024-04-24T23:07:57.639 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.640 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.640 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.640 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2419200", 2024-04-24T23:07:57.640 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.640 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.640 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.640 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-24T23:07:57.640 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.640 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.640 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.640 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.640 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": { 2024-04-24T23:07:57.640 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_name", 2024-04-24T23:07:57.640 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.640 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.641 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.641 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "device_health_metrics", 2024-04-24T23:07:57.641 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.641 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.641 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.641 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-24T23:07:57.641 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.641 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.641 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.641 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.641 INFO:teuthology.orchestra.run.smithi043.stdout: "retention_period": { 2024-04-24T23:07:57.641 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retention_period", 2024-04-24T23:07:57.641 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.642 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.642 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.642 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15552000", 2024-04-24T23:07:57.642 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.642 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.642 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.642 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain device health metrics", 2024-04-24T23:07:57.642 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.642 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.642 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.642 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.643 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_frequency": { 2024-04-24T23:07:57.643 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_frequency", 2024-04-24T23:07:57.643 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.643 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.643 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.643 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-24T23:07:57.643 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.643 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.644 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.644 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-24T23:07:57.644 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.644 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.644 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.644 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.644 INFO:teuthology.orchestra.run.smithi043.stdout: "self_heal": { 2024-04-24T23:07:57.645 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "self_heal", 2024-04-24T23:07:57.645 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.645 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.645 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.645 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.645 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.645 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.646 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.646 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-24T23:07:57.646 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.646 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.646 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.646 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.647 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-24T23:07:57.647 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-24T23:07:57.647 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.647 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.647 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.647 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-24T23:07:57.647 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.648 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.648 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.648 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and check device health", 2024-04-24T23:07:57.648 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.648 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.648 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.648 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.648 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_threshold": { 2024-04-24T23:07:57.648 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_threshold", 2024-04-24T23:07:57.649 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.649 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.649 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.649 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7257600", 2024-04-24T23:07:57.649 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.649 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.649 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.650 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-24T23:07:57.650 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.650 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.650 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.650 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.650 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.650 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.651 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.651 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "diskprediction_local", 2024-04-24T23:07:57.651 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.651 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.651 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.651 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.652 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.652 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.652 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.652 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.652 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.652 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.652 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.652 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.652 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.653 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.653 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.653 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.653 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.653 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.653 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.653 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.653 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.653 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.653 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.653 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.653 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.653 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.653 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.654 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.654 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.654 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.654 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.654 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.654 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.654 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.654 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.654 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.654 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.654 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.654 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.654 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.654 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.655 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.655 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.655 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.655 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.655 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.655 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.655 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.655 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.655 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.655 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.655 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.655 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.655 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.655 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.656 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.656 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.656 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.656 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.656 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.656 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.656 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.656 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.656 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.656 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.656 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.656 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.656 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.656 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.656 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.657 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.657 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.657 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.657 INFO:teuthology.orchestra.run.smithi043.stdout: "predict_interval": { 2024-04-24T23:07:57.657 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predict_interval", 2024-04-24T23:07:57.657 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.657 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.657 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.657 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-24T23:07:57.657 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.657 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.657 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.657 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.657 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.658 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.658 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.658 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.658 INFO:teuthology.orchestra.run.smithi043.stdout: "predictor_model": { 2024-04-24T23:07:57.658 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predictor_model", 2024-04-24T23:07:57.658 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.658 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.658 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.658 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "prophetstor", 2024-04-24T23:07:57.658 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.658 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.658 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.658 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.658 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.659 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.659 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.659 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.659 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-24T23:07:57.659 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-24T23:07:57.659 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.659 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.659 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.659 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-24T23:07:57.659 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.659 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.659 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.659 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.659 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.660 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.660 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.660 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.660 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.660 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.660 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.660 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "influx", 2024-04-24T23:07:57.660 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": false, 2024-04-24T23:07:57.660 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "influxdb python module not found", 2024-04-24T23:07:57.660 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.660 INFO:teuthology.orchestra.run.smithi043.stdout: "batch_size": { 2024-04-24T23:07:57.660 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "batch_size", 2024-04-24T23:07:57.660 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.660 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.660 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.661 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5000", 2024-04-24T23:07:57.661 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.661 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.661 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.661 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-24T23:07:57.661 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.661 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.661 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.661 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.661 INFO:teuthology.orchestra.run.smithi043.stdout: "database": { 2024-04-24T23:07:57.661 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "database", 2024-04-24T23:07:57.661 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.661 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.662 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.662 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "ceph", 2024-04-24T23:07:57.662 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.662 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.662 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.662 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-24T23:07:57.662 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.662 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.663 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.663 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.663 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": { 2024-04-24T23:07:57.663 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hostname", 2024-04-24T23:07:57.663 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.663 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.663 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.663 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.664 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.664 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.664 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.664 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server hostname", 2024-04-24T23:07:57.664 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.664 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.664 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.664 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.664 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-24T23:07:57.664 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-24T23:07:57.665 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.665 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.665 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.665 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "30", 2024-04-24T23:07:57.665 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "5", 2024-04-24T23:07:57.665 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.665 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.665 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-24T23:07:57.665 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.666 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.666 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.666 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.666 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.666 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.666 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.666 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.666 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.667 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.667 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.667 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.667 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.667 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.667 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.667 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.667 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.668 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.668 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.668 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.668 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.668 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.668 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.668 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.668 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.668 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.669 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.669 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.669 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.669 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.669 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.669 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.669 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.669 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.670 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.670 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.670 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.670 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.670 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.670 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.670 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.670 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.670 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.671 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.671 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.671 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.671 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.671 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.671 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.671 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.671 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.671 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.672 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.672 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.672 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.672 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.672 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.672 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.672 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.672 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.673 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.673 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.673 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.673 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.673 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.673 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.673 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.673 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.673 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.674 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.674 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.674 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.674 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.674 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.674 INFO:teuthology.orchestra.run.smithi043.stdout: "password": { 2024-04-24T23:07:57.674 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "password", 2024-04-24T23:07:57.674 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.675 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.675 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.675 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.675 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.675 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.675 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.675 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "password of InfluxDB server user", 2024-04-24T23:07:57.675 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.675 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.676 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.676 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.676 INFO:teuthology.orchestra.run.smithi043.stdout: "port": { 2024-04-24T23:07:57.676 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "port", 2024-04-24T23:07:57.676 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.676 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.676 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.676 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8086", 2024-04-24T23:07:57.676 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.677 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.677 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.677 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server port", 2024-04-24T23:07:57.677 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.677 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.677 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.677 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.677 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-24T23:07:57.677 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-24T23:07:57.677 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.677 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.677 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "false", 2024-04-24T23:07:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-24T23:07:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: "threads": { 2024-04-24T23:07:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threads", 2024-04-24T23:07:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.679 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-24T23:07:57.679 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-24T23:07:57.679 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "32", 2024-04-24T23:07:57.679 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.679 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-24T23:07:57.679 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.679 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.679 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.679 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.679 INFO:teuthology.orchestra.run.smithi043.stdout: "username": { 2024-04-24T23:07:57.679 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "username", 2024-04-24T23:07:57.679 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.679 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.679 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.679 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.680 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.680 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.680 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.680 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "username of InfluxDB server user", 2024-04-24T23:07:57.680 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.680 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.680 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.680 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.680 INFO:teuthology.orchestra.run.smithi043.stdout: "verify_ssl": { 2024-04-24T23:07:57.680 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "verify_ssl", 2024-04-24T23:07:57.680 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.680 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.680 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.680 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "true", 2024-04-24T23:07:57.681 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.681 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.681 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.681 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-24T23:07:57.681 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.681 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.681 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.681 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.681 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.681 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.681 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.681 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "insights", 2024-04-24T23:07:57.681 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.681 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.682 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.682 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.682 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.682 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.682 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.682 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.682 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.682 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.682 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.682 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.682 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.682 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.682 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.682 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.683 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.683 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.683 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.683 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.683 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.683 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.683 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.683 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.683 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.683 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.683 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.683 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.683 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.683 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.684 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.684 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.684 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.684 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.684 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.684 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.684 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.684 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.684 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.684 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.684 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.684 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.684 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.684 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.684 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.685 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.685 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.685 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.685 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.685 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.685 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.685 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.685 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.685 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.685 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.685 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.685 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.685 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.685 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.686 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.686 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.686 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.686 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.686 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.686 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.686 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.686 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.686 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.686 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.686 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.686 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.686 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.686 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.686 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.687 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.687 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.687 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "iostat", 2024-04-24T23:07:57.687 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.687 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.687 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.687 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.687 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.687 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.687 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.687 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.687 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.687 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.687 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.688 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.688 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.688 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.688 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.688 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.688 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.688 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.688 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.688 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.688 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.688 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.688 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.688 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.688 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.688 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.689 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.689 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.689 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.689 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.689 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.689 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.689 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.689 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.689 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.689 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.689 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.689 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.689 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.689 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.689 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.690 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.690 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.690 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.690 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.690 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.690 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.690 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.690 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.690 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.690 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.691 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.691 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.691 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.691 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.691 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.691 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.691 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.691 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.691 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.691 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.692 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.692 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.692 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.692 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.692 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.692 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.692 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.692 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.693 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.693 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.693 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.693 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.693 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.693 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.693 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.693 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "localpool", 2024-04-24T23:07:57.694 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.694 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.694 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.694 INFO:teuthology.orchestra.run.smithi043.stdout: "failure_domain": { 2024-04-24T23:07:57.694 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "failure_domain", 2024-04-24T23:07:57.694 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.694 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.694 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.694 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "host", 2024-04-24T23:07:57.695 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.695 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.695 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.695 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "failure domain for any created local pool", 2024-04-24T23:07:57.695 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-24T23:07:57.695 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.695 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.695 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.696 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.696 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.696 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.696 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.696 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.696 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.696 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.696 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.696 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.697 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.697 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.697 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.697 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.697 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.697 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.697 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.697 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.697 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.698 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.698 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.698 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.698 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.698 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.698 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.698 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.698 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.698 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.699 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.699 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.699 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.699 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.699 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.699 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.699 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.699 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.699 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.700 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.700 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.700 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.700 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.700 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.700 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.700 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.700 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.700 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.700 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.701 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.701 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.701 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.701 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.701 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.701 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.701 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.701 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.701 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.701 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.702 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.702 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.702 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.702 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.702 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.702 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.702 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.702 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.702 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.703 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.703 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.703 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.703 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.703 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.703 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": { 2024-04-24T23:07:57.703 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_size", 2024-04-24T23:07:57.703 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.703 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.704 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.704 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.704 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.704 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.704 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.704 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default min_size for any created local pool", 2024-04-24T23:07:57.704 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-24T23:07:57.704 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.704 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.704 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.704 INFO:teuthology.orchestra.run.smithi043.stdout: "num_rep": { 2024-04-24T23:07:57.704 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "num_rep", 2024-04-24T23:07:57.704 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.704 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.705 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.705 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3", 2024-04-24T23:07:57.705 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.705 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.705 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.705 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default replica count for any created local pool", 2024-04-24T23:07:57.705 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.705 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.705 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.705 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.705 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": { 2024-04-24T23:07:57.705 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_num", 2024-04-24T23:07:57.705 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.705 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.705 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.706 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "128", 2024-04-24T23:07:57.706 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.706 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.706 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.706 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default pg_num for any created local pool", 2024-04-24T23:07:57.706 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.706 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.706 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.706 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.706 INFO:teuthology.orchestra.run.smithi043.stdout: "prefix": { 2024-04-24T23:07:57.706 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prefix", 2024-04-24T23:07:57.706 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.706 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.706 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name prefix for any created local pool", 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "subtree": { 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "subtree", 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "rack", 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.707 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirroring", 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.708 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.709 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.709 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.709 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.709 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.709 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.709 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.709 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.709 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.709 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.709 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.709 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.709 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.709 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.709 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.709 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.710 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.710 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.710 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.710 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.710 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.710 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.710 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.710 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.710 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.710 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.710 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.710 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.710 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.710 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.711 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.712 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.713 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.713 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.713 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.713 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.713 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.713 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.713 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.713 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "nfs", 2024-04-24T23:07:57.713 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.713 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.713 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.713 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.713 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.713 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.714 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.714 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.714 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.714 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.714 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.714 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.714 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.714 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.714 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.714 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.714 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.714 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.715 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.716 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.717 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.717 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.717 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.717 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.717 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.717 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.717 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.717 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.717 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.717 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.717 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.717 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.717 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.717 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.717 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.718 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.718 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.718 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.718 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.718 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.718 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.718 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.718 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.718 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.718 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.718 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.718 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-24T23:07:57.718 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.718 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.718 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.719 INFO:teuthology.orchestra.run.smithi043.stdout: "fail_fs": { 2024-04-24T23:07:57.719 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "fail_fs", 2024-04-24T23:07:57.719 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.719 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.719 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.719 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.719 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.719 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.719 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.719 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-24T23:07:57.719 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.719 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.719 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.719 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.720 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.720 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.720 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.720 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.720 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.720 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.720 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.720 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.720 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.720 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.720 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.720 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.720 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.720 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.720 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.721 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.721 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.721 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.721 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.721 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.721 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.721 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.721 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.721 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.721 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.721 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.721 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.721 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.721 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.721 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.722 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.722 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.722 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.722 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.722 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.722 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.722 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.722 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.722 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.722 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.722 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.722 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.722 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.723 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.723 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.723 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.723 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.723 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.723 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.723 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.723 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.723 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.723 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.723 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.723 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.724 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator": { 2024-04-24T23:07:57.725 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-24T23:07:57.725 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.725 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.725 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.725 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.725 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.725 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.725 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.725 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm", 2024-04-24T23:07:57.725 INFO:teuthology.orchestra.run.smithi043.stdout: "rook", 2024-04-24T23:07:57.725 INFO:teuthology.orchestra.run.smithi043.stdout: "test_orchestrator" 2024-04-24T23:07:57.725 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.725 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Orchestrator backend", 2024-04-24T23:07:57.725 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.725 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.726 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.726 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.726 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.726 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.726 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.726 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_perf_query", 2024-04-24T23:07:57.726 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.726 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.726 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.726 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.726 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.726 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.726 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.726 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.727 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.727 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.727 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.727 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.727 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.727 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.727 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.727 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.727 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.727 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.727 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.727 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.727 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.727 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.727 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.728 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.729 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.730 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.730 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.730 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.730 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.730 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.730 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.730 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.730 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.730 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.730 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.730 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.730 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.730 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.730 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_support", 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.731 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.732 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.733 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.734 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_autoscaler", 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.736 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.737 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.738 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.738 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.738 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.738 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.738 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.738 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.738 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.738 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.738 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.738 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.738 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.738 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.738 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.738 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.739 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.740 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.740 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.740 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.740 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.740 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.740 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.740 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.740 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.740 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.740 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.740 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.740 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.740 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.740 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.740 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: "threshold": { 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threshold", 2024-04-24T23:07:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-24T23:07:57.742 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.742 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.742 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-24T23:07:57.742 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1.0", 2024-04-24T23:07:57.742 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.742 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.742 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "scaling threshold", 2024-04-24T23:07:57.742 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-24T23:07:57.742 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.742 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.742 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.742 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.742 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.742 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "progress", 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_pg_recovery_event": { 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_pg_recovery_event", 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.743 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.744 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.746 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.746 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.746 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.746 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.746 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.746 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.746 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.746 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.746 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.746 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.746 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.746 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.746 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.746 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.746 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.747 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.747 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.747 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.747 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.747 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.747 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.747 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.747 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.747 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.747 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.747 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.747 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.747 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.747 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.747 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.748 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.748 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.748 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.748 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.748 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.748 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.748 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.748 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.748 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.748 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.748 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.748 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.748 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.748 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.748 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.749 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.749 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.749 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.749 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.749 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.749 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.749 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.749 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.749 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.749 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.749 INFO:teuthology.orchestra.run.smithi043.stdout: "max_completed_events": { 2024-04-24T23:07:57.749 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_completed_events", 2024-04-24T23:07:57.749 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.749 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.749 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.750 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "50", 2024-04-24T23:07:57.750 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.750 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.750 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.750 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "number of past completed events to remember", 2024-04-24T23:07:57.750 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.750 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.750 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.750 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.750 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-24T23:07:57.750 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-24T23:07:57.750 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.750 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.750 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.751 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-24T23:07:57.751 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.751 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.751 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.751 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long the module is going to sleep", 2024-04-24T23:07:57.751 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.751 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.751 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.751 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.751 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.751 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.751 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.751 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus", 2024-04-24T23:07:57.751 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.751 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: "cache": { 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cache", 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.752 INFO:teuthology.orchestra.run.smithi043.stdout: "exclude_perf_counters": { 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "exclude_perf_counters", 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.753 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.754 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.754 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.754 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.754 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.754 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.754 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.754 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.754 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.754 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.754 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.754 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.754 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.754 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.754 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.755 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.755 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.755 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.755 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.755 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.755 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.755 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.755 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.755 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.755 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.755 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.755 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.755 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.755 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.755 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.756 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.757 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.757 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.757 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.757 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.757 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.757 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.757 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.757 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.757 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.757 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.757 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.757 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.757 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.757 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.757 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.758 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.758 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.758 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.758 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.758 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.758 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.758 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.758 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools": { 2024-04-24T23:07:57.758 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools", 2024-04-24T23:07:57.758 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.758 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.758 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.758 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.758 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.759 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.759 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.759 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.759 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.759 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.759 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.759 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.759 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-24T23:07:57.759 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-24T23:07:57.759 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.759 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.759 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.759 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "300", 2024-04-24T23:07:57.759 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.759 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.760 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.760 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.760 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.760 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.760 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.760 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.760 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_interval": { 2024-04-24T23:07:57.760 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_interval", 2024-04-24T23:07:57.760 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-24T23:07:57.760 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.760 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.760 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15.0", 2024-04-24T23:07:57.760 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.760 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.761 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.761 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.761 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.761 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.761 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.761 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.761 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-24T23:07:57.761 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-24T23:07:57.761 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.761 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.761 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.761 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-24T23:07:57.761 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.762 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.762 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.762 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-24T23:07:57.762 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.762 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.762 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.762 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.762 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-24T23:07:57.762 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-24T23:07:57.762 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.762 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.762 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.762 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "9283", 2024-04-24T23:07:57.762 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.762 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: "stale_cache_strategy": { 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stale_cache_strategy", 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "log", 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.763 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "default", 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: "default", 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: "error" 2024-04-24T23:07:57.764 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.765 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.765 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.765 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.765 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.765 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.765 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-24T23:07:57.765 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-24T23:07:57.765 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.765 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.765 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.765 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-24T23:07:57.765 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-24T23:07:57.765 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-24T23:07:57.765 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.765 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.766 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.766 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.766 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.766 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.766 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.766 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.766 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.766 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_support", 2024-04-24T23:07:57.766 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.766 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.766 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.766 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.766 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.766 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.766 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.767 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.767 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.767 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.767 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.767 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.767 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.767 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.767 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.767 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.767 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.767 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.767 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.767 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.767 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.767 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.768 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.768 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.768 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.768 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.768 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.768 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.768 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.768 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.768 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.768 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.768 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.768 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.768 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.768 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.769 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.770 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.770 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.770 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.770 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.770 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.770 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.770 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.770 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.770 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.770 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.770 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.770 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.770 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.770 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_snap_create": { 2024-04-24T23:07:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_snap_create", 2024-04-24T23:07:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-24T23:07:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.772 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.772 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.772 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.772 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.772 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.772 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.772 INFO:teuthology.orchestra.run.smithi043.stdout: "mirror_snapshot_schedule": { 2024-04-24T23:07:57.772 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirror_snapshot_schedule", 2024-04-24T23:07:57.772 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.772 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.772 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.772 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.772 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.772 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.772 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.773 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.773 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.773 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.773 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.773 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.773 INFO:teuthology.orchestra.run.smithi043.stdout: "trash_purge_schedule": { 2024-04-24T23:07:57.773 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "trash_purge_schedule", 2024-04-24T23:07:57.773 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.773 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.773 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.773 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.773 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.773 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.773 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.773 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "restful", 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_auth": { 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_auth", 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.774 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.775 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.775 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.775 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.775 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.775 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.775 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.775 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.775 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.775 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.775 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-24T23:07:57.775 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-24T23:07:57.776 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.776 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.776 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.776 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.776 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.776 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.776 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.776 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.776 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.776 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.776 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.776 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.776 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.776 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.776 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.777 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.777 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.777 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.777 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.777 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.777 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.777 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.777 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.777 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.777 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.777 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.777 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.777 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.777 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.777 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.778 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.778 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.778 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.778 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.778 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.778 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.778 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.778 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.778 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.778 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.778 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.778 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.778 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.778 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.778 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.779 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.779 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.779 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.779 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.779 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.779 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.779 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.779 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.779 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.779 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.779 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.779 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.779 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.779 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.779 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.780 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.780 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.780 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.780 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.780 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.780 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.780 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.780 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.780 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.780 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.780 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.780 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.780 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.780 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.780 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.781 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.781 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.781 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.781 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.781 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.781 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.781 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.781 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-24T23:07:57.781 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-24T23:07:57.781 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.781 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.781 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.781 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.781 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.782 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.782 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.782 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.782 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.782 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.782 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.782 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.782 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-24T23:07:57.782 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-24T23:07:57.782 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.782 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.782 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.782 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.782 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.782 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.783 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.783 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.783 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.783 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.783 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.783 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.783 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.783 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.783 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.783 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "selftest", 2024-04-24T23:07:57.783 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.783 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.783 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.783 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.784 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.784 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.784 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.784 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.784 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.784 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.784 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.784 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.784 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.784 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.784 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.784 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.785 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.785 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.785 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.785 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.785 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.785 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.785 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.786 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.786 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.786 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.786 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.786 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.786 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.787 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.787 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.787 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.787 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.787 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.787 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.787 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.788 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.788 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.788 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.788 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.788 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.788 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.789 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.789 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.789 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.789 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.789 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.789 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.789 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.790 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.790 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.790 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.790 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.790 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.790 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.791 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.791 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.791 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.791 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.791 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.791 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.791 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.792 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.792 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.792 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.792 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.792 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.792 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.793 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.793 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.793 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.793 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.793 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.793 INFO:teuthology.orchestra.run.smithi043.stdout: "roption1": { 2024-04-24T23:07:57.794 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption1", 2024-04-24T23:07:57.794 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.794 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.794 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.794 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.794 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.794 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.794 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.795 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.795 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.795 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.795 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.795 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.795 INFO:teuthology.orchestra.run.smithi043.stdout: "roption2": { 2024-04-24T23:07:57.795 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption2", 2024-04-24T23:07:57.796 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.796 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.796 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.796 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "xyz", 2024-04-24T23:07:57.796 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.796 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.797 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.797 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.797 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.797 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.797 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.798 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.798 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption1": { 2024-04-24T23:07:57.798 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption1", 2024-04-24T23:07:57.798 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.798 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.798 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.799 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.799 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.799 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.799 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.799 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.799 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.800 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.800 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.800 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.800 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption2": { 2024-04-24T23:07:57.800 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption2", 2024-04-24T23:07:57.800 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.800 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.801 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.801 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.801 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.801 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.801 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.802 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.802 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.802 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.802 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.802 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.802 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption3": { 2024-04-24T23:07:57.803 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption3", 2024-04-24T23:07:57.803 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-24T23:07:57.803 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.803 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.803 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.803 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.804 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.804 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.804 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.804 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.804 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.804 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.804 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.805 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption4": { 2024-04-24T23:07:57.805 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption4", 2024-04-24T23:07:57.805 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.805 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.805 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.805 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.806 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.806 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.806 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.806 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.806 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.806 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.807 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.807 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.807 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption5": { 2024-04-24T23:07:57.807 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption5", 2024-04-24T23:07:57.807 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.807 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.808 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.808 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.808 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.808 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.808 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.808 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.809 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.809 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.809 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.809 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.809 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption6": { 2024-04-24T23:07:57.809 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption6", 2024-04-24T23:07:57.810 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.810 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.810 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.810 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.810 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.810 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.811 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.811 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.811 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.811 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.811 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.811 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.812 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption7": { 2024-04-24T23:07:57.812 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption7", 2024-04-24T23:07:57.812 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.812 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.812 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.812 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.813 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-24T23:07:57.813 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "42", 2024-04-24T23:07:57.813 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.813 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.813 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.813 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.814 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.814 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.814 INFO:teuthology.orchestra.run.smithi043.stdout: "testkey": { 2024-04-24T23:07:57.814 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testkey", 2024-04-24T23:07:57.814 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.814 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.815 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.815 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.815 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.815 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.815 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.815 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.815 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.815 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.816 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.816 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.816 INFO:teuthology.orchestra.run.smithi043.stdout: "testlkey": { 2024-04-24T23:07:57.816 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testlkey", 2024-04-24T23:07:57.816 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.816 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.816 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.816 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.816 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.817 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.817 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.817 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.817 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.817 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.817 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.817 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.817 INFO:teuthology.orchestra.run.smithi043.stdout: "testnewline": { 2024-04-24T23:07:57.817 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testnewline", 2024-04-24T23:07:57.818 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.818 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.818 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.818 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.818 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.818 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.818 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.818 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.819 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.819 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.819 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.819 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.819 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.819 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.820 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.820 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-04-24T23:07:57.820 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.820 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.820 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.820 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_m_granularity": { 2024-04-24T23:07:57.820 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_m_granularity", 2024-04-24T23:07:57.820 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.820 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.820 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.820 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.820 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.820 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.821 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.821 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow minute scheduled snapshots", 2024-04-24T23:07:57.821 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.821 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.821 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.821 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.821 INFO:teuthology.orchestra.run.smithi043.stdout: "dump_on_update": { 2024-04-24T23:07:57.821 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dump_on_update", 2024-04-24T23:07:57.821 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.821 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.821 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.821 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.821 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.822 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.822 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.822 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "dump database to debug log on update", 2024-04-24T23:07:57.822 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.822 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.822 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.822 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.822 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.822 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.822 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.822 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.822 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.822 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.822 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.823 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.823 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.823 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.823 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.823 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.823 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.823 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.823 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.823 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.823 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.823 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.823 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.823 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.824 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.824 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.824 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.824 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.824 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.824 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.824 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.824 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.824 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.824 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.824 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.824 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.824 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.824 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.824 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.826 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.826 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.826 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.826 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.826 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.826 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.826 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.826 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.826 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.826 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.826 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.826 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.826 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.826 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.827 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.827 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.827 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.827 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.827 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.827 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.827 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.827 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.827 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.827 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stats", 2024-04-24T23:07:57.827 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.827 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.827 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.827 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.827 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.828 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.828 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.828 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.828 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.828 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.828 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.828 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.828 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.828 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.828 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.828 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.828 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.828 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.829 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.829 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.829 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.829 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.829 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.829 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.829 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.829 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.829 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.829 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.829 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.829 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.829 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.829 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.830 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.830 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.830 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.830 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.830 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.830 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.830 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.830 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.830 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.830 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.830 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.830 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.830 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.830 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.831 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "status", 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.833 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.834 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.834 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.834 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.834 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.834 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.834 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.834 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.834 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.834 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.834 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.834 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.834 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.834 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.834 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.835 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.835 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.835 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.835 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.835 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.835 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.835 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.835 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.835 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.835 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.835 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.835 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.835 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.835 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.836 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.836 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.836 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.836 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.836 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.836 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.836 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.836 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.836 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.836 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.836 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.836 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.836 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.836 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.836 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.837 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.837 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.837 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.837 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.837 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.837 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.837 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.837 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.837 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.837 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.837 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.837 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.838 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.838 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.838 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.838 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.838 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.838 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telegraf", 2024-04-24T23:07:57.838 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.838 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.838 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.838 INFO:teuthology.orchestra.run.smithi043.stdout: "address": { 2024-04-24T23:07:57.839 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "address", 2024-04-24T23:07:57.839 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.839 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.839 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.839 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-24T23:07:57.839 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.840 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.840 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.840 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.840 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.840 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.841 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.842 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.842 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-24T23:07:57.842 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-24T23:07:57.842 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.842 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.842 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.843 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15", 2024-04-24T23:07:57.843 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.843 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.843 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.843 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.843 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.843 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.844 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.844 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.844 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.844 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.844 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.844 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.845 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.845 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.845 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.845 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.845 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.845 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.845 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.846 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.846 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.846 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.846 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.846 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.846 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.847 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.847 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.847 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.847 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.847 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.847 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.847 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.848 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.848 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.848 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.848 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.848 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.848 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.849 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.849 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.849 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.849 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.849 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.849 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.849 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.849 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.850 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.850 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.850 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.850 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.850 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.850 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.850 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.850 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.850 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.850 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.850 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.851 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.851 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.851 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.851 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.851 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.851 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.851 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.851 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.851 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.851 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.851 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.851 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.851 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.851 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.851 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telemetry", 2024-04-24T23:07:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_basic": { 2024-04-24T23:07:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_basic", 2024-04-24T23:07:57.853 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.853 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.853 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.853 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.853 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.853 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.853 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.853 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-24T23:07:57.853 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.853 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.853 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.853 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.853 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_crash": { 2024-04-24T23:07:57.853 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_crash", 2024-04-24T23:07:57.853 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.854 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.854 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.854 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.854 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.854 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.854 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.854 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-24T23:07:57.854 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.854 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.854 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.854 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.854 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_device": { 2024-04-24T23:07:57.854 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_device", 2024-04-24T23:07:57.854 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.855 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.855 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.855 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.855 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.855 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.855 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.855 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-24T23:07:57.855 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.855 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.855 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.855 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.855 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_ident": { 2024-04-24T23:07:57.855 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_ident", 2024-04-24T23:07:57.855 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.856 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.856 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.856 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.856 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.856 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.856 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.856 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-24T23:07:57.856 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.856 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.856 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.856 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.856 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_perf": { 2024-04-24T23:07:57.856 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_perf", 2024-04-24T23:07:57.856 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-24T23:07:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: "contact": { 2024-04-24T23:07:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "contact", 2024-04-24T23:07:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.858 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.858 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.858 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.858 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.858 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.858 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.858 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.858 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.858 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.858 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.858 INFO:teuthology.orchestra.run.smithi043.stdout: "description": { 2024-04-24T23:07:57.858 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "description", 2024-04-24T23:07:57.858 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.858 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.859 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.859 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.859 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.859 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.859 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.859 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.859 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.859 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.859 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.859 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.859 INFO:teuthology.orchestra.run.smithi043.stdout: "device_url": { 2024-04-24T23:07:57.859 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_url", 2024-04-24T23:07:57.859 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.859 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.859 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.860 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-24T23:07:57.860 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.860 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.860 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.860 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.860 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.860 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.860 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.860 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.860 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-24T23:07:57.860 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-24T23:07:57.860 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.860 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.860 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.861 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.861 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.861 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.861 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.861 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.861 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.861 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.861 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.861 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.861 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-24T23:07:57.861 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-24T23:07:57.861 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.861 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.862 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.862 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "24", 2024-04-24T23:07:57.862 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "8", 2024-04-24T23:07:57.862 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.862 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.862 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.862 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.862 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.862 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.862 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.862 INFO:teuthology.orchestra.run.smithi043.stdout: "last_opt_revision": { 2024-04-24T23:07:57.862 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "last_opt_revision", 2024-04-24T23:07:57.862 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.863 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.863 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.863 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1", 2024-04-24T23:07:57.863 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.863 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.863 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.863 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.863 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.863 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.863 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.863 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.863 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard": { 2024-04-24T23:07:57.863 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard", 2024-04-24T23:07:57.863 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.863 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.864 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.864 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.864 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.864 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.864 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.864 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.864 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.864 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.864 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.864 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.864 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard_description": { 2024-04-24T23:07:57.864 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard_description", 2024-04-24T23:07:57.864 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.864 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.865 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.865 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.865 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.865 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.865 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.865 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.865 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.865 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.865 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.865 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.866 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.866 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.866 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.866 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.866 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.866 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.866 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.866 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.866 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.866 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.868 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.868 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.868 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.868 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.868 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.868 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.868 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.868 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.868 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.868 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.868 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.868 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.868 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.868 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.869 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.869 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.869 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.869 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.869 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.869 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.869 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.869 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.869 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.869 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.869 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.869 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.869 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.869 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.869 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.870 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.870 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.870 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.870 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.870 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.870 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.870 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.870 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.870 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.870 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.870 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.870 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.870 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.870 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.870 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.871 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.871 INFO:teuthology.orchestra.run.smithi043.stdout: "organization": { 2024-04-24T23:07:57.871 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "organization", 2024-04-24T23:07:57.871 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.871 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.871 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.871 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.871 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.871 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.871 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.871 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.871 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.871 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.871 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.872 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.872 INFO:teuthology.orchestra.run.smithi043.stdout: "proxy": { 2024-04-24T23:07:57.872 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "proxy", 2024-04-24T23:07:57.872 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.872 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.872 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.872 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.872 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.872 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.872 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.872 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.872 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.872 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.872 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.872 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.873 INFO:teuthology.orchestra.run.smithi043.stdout: "url": { 2024-04-24T23:07:57.873 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url", 2024-04-24T23:07:57.873 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.873 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.873 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.873 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-24T23:07:57.873 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.873 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.873 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.873 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.873 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.873 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.873 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.873 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.874 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.874 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.874 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.874 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "test_orchestrator", 2024-04-24T23:07:57.874 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.874 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.874 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.874 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.874 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.874 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.874 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.874 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.874 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.874 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.875 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.875 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.875 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.875 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.875 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.875 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.875 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.875 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.875 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.875 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.875 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.875 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.875 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.875 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.875 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.876 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.876 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.876 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.876 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.876 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.876 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.876 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.876 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.876 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.876 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.876 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.876 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.876 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.876 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.877 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.878 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.878 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.878 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.878 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.878 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.878 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.878 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.878 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.878 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.878 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.878 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.878 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.878 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.878 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.879 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.879 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.879 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.879 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.879 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.879 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.879 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.879 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.879 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "volumes", 2024-04-24T23:07:57.879 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.879 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.879 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.879 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.879 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.879 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.880 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.880 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.880 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.880 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.880 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.880 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.880 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.880 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.880 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.880 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.880 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.880 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.880 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.880 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.880 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.881 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.881 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.881 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.881 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.881 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.881 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.881 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.881 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.881 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.881 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.881 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.881 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.881 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.881 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.882 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.882 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.882 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.882 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.882 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.882 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.882 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.882 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.882 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.882 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.882 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.882 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.882 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.882 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.883 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.883 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.883 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.883 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.883 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.883 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.883 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.883 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.883 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.883 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.883 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.883 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.883 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.883 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.883 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_clones": { 2024-04-24T23:07:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_clones", 2024-04-24T23:07:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.884 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4", 2024-04-24T23:07:57.885 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.885 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.885 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.885 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-24T23:07:57.885 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.885 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.885 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.885 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.885 INFO:teuthology.orchestra.run.smithi043.stdout: "periodic_async_work": { 2024-04-24T23:07:57.885 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "periodic_async_work", 2024-04-24T23:07:57.885 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.885 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.885 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.885 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.886 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.886 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.886 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.886 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Periodically check for async work", 2024-04-24T23:07:57.886 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.886 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.886 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.886 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.886 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_delay": { 2024-04-24T23:07:57.886 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_delay", 2024-04-24T23:07:57.886 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.886 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.886 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.886 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-24T23:07:57.887 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.887 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.887 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.887 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-24T23:07:57.887 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.887 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.887 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.887 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.887 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_no_wait": { 2024-04-24T23:07:57.887 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_no_wait", 2024-04-24T23:07:57.887 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.887 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.887 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.887 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-24T23:07:57.887 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.888 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.888 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.888 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-24T23:07:57.888 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.888 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.888 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.888 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.888 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.888 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.888 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.888 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix", 2024-04-24T23:07:57.888 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-24T23:07:57.888 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-24T23:07:57.888 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-24T23:07:57.888 INFO:teuthology.orchestra.run.smithi043.stdout: "discovery_interval": { 2024-04-24T23:07:57.889 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "discovery_interval", 2024-04-24T23:07:57.889 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-24T23:07:57.889 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.889 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.889 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "100", 2024-04-24T23:07:57.889 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.889 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.889 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.889 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.889 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.889 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.889 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.889 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.889 INFO:teuthology.orchestra.run.smithi043.stdout: "identifier": { 2024-04-24T23:07:57.889 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "identifier", 2024-04-24T23:07:57.890 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.890 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.890 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.890 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.890 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.890 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.890 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.890 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.890 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.890 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.890 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.890 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.890 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-24T23:07:57.890 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.891 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.892 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.892 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.892 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.892 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.892 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.892 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.892 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.892 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.892 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.892 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.892 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.892 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.892 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.892 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.893 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.893 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.893 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.893 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-24T23:07:57.893 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-24T23:07:57.893 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.893 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.893 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.893 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.893 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.893 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.893 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.893 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.893 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.894 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.894 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.894 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.894 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-24T23:07:57.894 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-24T23:07:57.894 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.894 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.894 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.894 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-24T23:07:57.894 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.894 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.894 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-24T23:07:57.894 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-24T23:07:57.894 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-24T23:07:57.894 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-24T23:07:57.895 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-24T23:07:57.895 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-24T23:07:57.895 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-24T23:07:57.895 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.895 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.895 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.895 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.895 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.895 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.895 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-24T23:07:57.895 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-24T23:07:57.895 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-24T23:07:57.895 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.895 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-24T23:07:57.895 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_host": { 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_host", 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.896 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.897 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.897 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.897 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.897 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.897 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.897 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.897 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_port": { 2024-04-24T23:07:57.897 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_port", 2024-04-24T23:07:57.897 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-24T23:07:57.897 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.897 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.897 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10051", 2024-04-24T23:07:57.897 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.897 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.898 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.898 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.898 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.898 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.898 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.898 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.898 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_sender": { 2024-04-24T23:07:57.898 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_sender", 2024-04-24T23:07:57.898 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-24T23:07:57.898 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-24T23:07:57.898 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-24T23:07:57.898 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-24T23:07:57.898 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-24T23:07:57.898 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-24T23:07:57.898 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-24T23:07:57.899 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-24T23:07:57.899 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-24T23:07:57.899 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-24T23:07:57.899 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-24T23:07:57.899 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.899 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.899 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.899 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.899 INFO:teuthology.orchestra.run.smithi043.stdout: "services": {}, 2024-04-24T23:07:57.899 INFO:teuthology.orchestra.run.smithi043.stdout: "always_on_modules": { 2024-04-24T23:07:57.899 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus": [ 2024-04-24T23:07:57.899 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-04-24T23:07:57.899 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-04-24T23:07:57.899 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-04-24T23:07:57.899 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-04-24T23:07:57.900 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-04-24T23:07:57.900 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-04-24T23:07:57.900 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-04-24T23:07:57.900 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-04-24T23:07:57.900 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-04-24T23:07:57.900 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-04-24T23:07:57.900 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.900 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific": [ 2024-04-24T23:07:57.900 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-04-24T23:07:57.900 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-04-24T23:07:57.900 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-04-24T23:07:57.900 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-04-24T23:07:57.900 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-04-24T23:07:57.900 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-04-24T23:07:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-04-24T23:07:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-04-24T23:07:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-04-24T23:07:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-04-24T23:07:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy": [ 2024-04-24T23:07:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-04-24T23:07:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-04-24T23:07:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-04-24T23:07:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-04-24T23:07:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-04-24T23:07:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-04-24T23:07:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-04-24T23:07:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-04-24T23:07:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-04-24T23:07:57.902 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-04-24T23:07:57.902 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.902 INFO:teuthology.orchestra.run.smithi043.stdout: "reef": [ 2024-04-24T23:07:57.902 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-04-24T23:07:57.902 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-04-24T23:07:57.902 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-04-24T23:07:57.902 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-04-24T23:07:57.902 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-04-24T23:07:57.902 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-04-24T23:07:57.902 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-04-24T23:07:57.902 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-04-24T23:07:57.902 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-04-24T23:07:57.902 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-04-24T23:07:57.902 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-24T23:07:57.902 INFO:teuthology.orchestra.run.smithi043.stdout: "squid": [ 2024-04-24T23:07:57.903 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-04-24T23:07:57.903 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-04-24T23:07:57.903 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-04-24T23:07:57.903 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-04-24T23:07:57.903 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-04-24T23:07:57.903 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-04-24T23:07:57.903 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-04-24T23:07:57.903 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-04-24T23:07:57.903 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-04-24T23:07:57.903 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-04-24T23:07:57.903 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-24T23:07:57.903 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.903 INFO:teuthology.orchestra.run.smithi043.stdout: "last_failure_osd_epoch": 0, 2024-04-24T23:07:57.903 INFO:teuthology.orchestra.run.smithi043.stdout: "active_clients": [ 2024-04-24T23:07:57.903 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "devicehealth", 2024-04-24T23:07:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-24T23:07:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-24T23:07:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-24T23:07:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2082962622 2024-04-24T23:07:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-24T23:07:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "libcephsqlite", 2024-04-24T23:07:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-24T23:07:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-24T23:07:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-24T23:07:57.905 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2492614087 2024-04-24T23:07:57.905 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.905 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-24T23:07:57.905 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.905 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.905 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_support", 2024-04-24T23:07:57.905 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-24T23:07:57.905 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.905 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-24T23:07:57.905 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-24T23:07:57.905 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2920685225 2024-04-24T23:07:57.905 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.905 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-24T23:07:57.905 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:57.906 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.906 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "volumes", 2024-04-24T23:07:57.906 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-24T23:07:57.906 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-24T23:07:57.906 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-24T23:07:57.906 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-24T23:07:57.906 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3244071997 2024-04-24T23:07:57.906 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.906 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-24T23:07:57.906 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:57.906 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-24T23:07:57.906 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-24T23:07:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.974+0000 7fcf61414640 1 -- 172.21.15.43:0/512062569 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcf480678c0 msgr2=0x7fcf48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.974+0000 7fcf61414640 1 --2- 172.21.15.43:0/512062569 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcf480678c0 0x7fcf48069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf50001210 tx=0x7fcf50009040 comp rx=0 tx=0).stop 2024-04-24T23:07:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.974+0000 7fcf61414640 1 -- 172.21.15.43:0/512062569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf440051d0 msgr2=0x7fcf5c1dfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.974+0000 7fcf61414640 1 --2- 172.21.15.43:0/512062569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf440051d0 0x7fcf5c1dfd40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c011c40 tx=0x7fcf4c00f5a0 comp rx=0 tx=0).stop 2024-04-24T23:07:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.974+0000 7fcf61414640 1 -- 172.21.15.43:0/512062569 shutdown_connections 2024-04-24T23:07:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.974+0000 7fcf61414640 1 --2- 172.21.15.43:0/512062569 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcf480678c0 0x7fcf48069d80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.974+0000 7fcf61414640 1 --2- 172.21.15.43:0/512062569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf5c0b0b40 0x7fcf5c0b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.974+0000 7fcf61414640 1 --2- 172.21.15.43:0/512062569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf5c0b4040 0x7fcf5c0728b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.974+0000 7fcf61414640 1 --2- 172.21.15.43:0/512062569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf440051d0 0x7fcf5c1dfd40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:57.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.974+0000 7fcf61414640 1 -- 172.21.15.43:0/512062569 >> 172.21.15.43:0/512062569 conn(0x7fcf5c06b9f0 msgr2=0x7fcf5c143a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:57.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.974+0000 7fcf61414640 1 -- 172.21.15.43:0/512062569 shutdown_connections 2024-04-24T23:07:57.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:56.974+0000 7fcf61414640 1 -- 172.21.15.43:0/512062569 wait complete. 2024-04-24T23:07:57.912 DEBUG:tasks.check_counter:Getting stats from a 2024-04-24T23:07:57.913 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2024-04-24T23:07:58.031 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-24T23:07:58.031 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-04-24T23:07:58.031 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 1053810, 2024-04-24T23:07:58.031 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 322449, 2024-04-24T23:07:58.031 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 363730743, 2024-04-24T23:07:58.031 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 162632922, 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 12, 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 4, 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 47.138885361, 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 24.101684079, 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 36.850292894, 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 1.115483299, 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 322448, 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 32.123600814, 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000099624 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 1289737, 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.170604803, 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000132 2024-04-24T23:07:58.032 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.033 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-04-24T23:07:58.033 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 448 2024-04-24T23:07:58.033 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.033 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-04-24T23:07:58.033 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 19315, 2024-04-24T23:07:58.033 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 19310, 2024-04-24T23:07:58.033 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 5270848, 2024-04-24T23:07:58.033 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 231143519, 2024-04-24T23:07:58.033 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 5, 2024-04-24T23:07:58.033 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 4, 2024-04-24T23:07:58.033 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 2.400047342, 2024-04-24T23:07:58.033 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.740999017, 2024-04-24T23:07:58.033 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.316457237, 2024-04-24T23:07:58.033 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 1.224475529, 2024-04-24T23:07:58.034 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-24T23:07:58.034 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 19309, 2024-04-24T23:07:58.034 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 10.505810306, 2024-04-24T23:07:58.034 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000544088 2024-04-24T23:07:58.034 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.034 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-24T23:07:58.034 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.034 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.034 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.034 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.034 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 147664, 2024-04-24T23:07:58.034 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 83696 2024-04-24T23:07:58.034 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.034 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-04-24T23:07:58.035 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 21426, 2024-04-24T23:07:58.035 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 21522, 2024-04-24T23:07:58.035 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 5904027, 2024-04-24T23:07:58.035 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 165079330, 2024-04-24T23:07:58.035 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 6, 2024-04-24T23:07:58.035 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 4, 2024-04-24T23:07:58.035 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 1.864506473, 2024-04-24T23:07:58.035 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.612330871, 2024-04-24T23:07:58.035 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.290437267, 2024-04-24T23:07:58.035 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.872353957, 2024-04-24T23:07:58.035 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-24T23:07:58.035 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 21521, 2024-04-24T23:07:58.035 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 14.200017078, 2024-04-24T23:07:58.035 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000659821 2024-04-24T23:07:58.035 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.036 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-24T23:07:58.036 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.036 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.036 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.036 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.036 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-24T23:07:58.036 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 254000 2024-04-24T23:07:58.036 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.036 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-04-24T23:07:58.036 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 1, 2024-04-24T23:07:58.036 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-04-24T23:07:58.036 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.036 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-MDSRank": { 2024-04-24T23:07:58.036 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 21391, 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 51.369143749, 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.002401437 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-PurgeQueue": { 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 16606, 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 4.534366077, 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000273055 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2024-04-24T23:07:58.037 INFO:teuthology.orchestra.run.smithi043.stdout: "request": 219676, 2024-04-24T23:07:58.038 INFO:teuthology.orchestra.run.smithi043.stdout: "reply": 219676, 2024-04-24T23:07:58.038 INFO:teuthology.orchestra.run.smithi043.stdout: "reply_latency": { 2024-04-24T23:07:58.038 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 219676, 2024-04-24T23:07:58.038 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 402.001303532, 2024-04-24T23:07:58.038 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.001829973 2024-04-24T23:07:58.038 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.038 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_reply": 0, 2024-04-24T23:07:58.038 INFO:teuthology.orchestra.run.smithi043.stdout: "forward": 0, 2024-04-24T23:07:58.038 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_complete": 0, 2024-04-24T23:07:58.041 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_keys": 0, 2024-04-24T23:07:58.042 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_commit": 957, 2024-04-24T23:07:58.042 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_split": 51, 2024-04-24T23:07:58.042 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_merge": 0, 2024-04-24T23:07:58.042 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes": 573, 2024-04-24T23:07:58.042 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_top": 0, 2024-04-24T23:07:58.042 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_bottom": 573, 2024-04-24T23:07:58.042 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pin_tail": 0, 2024-04-24T23:07:58.042 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pinned": 573, 2024-04-24T23:07:58.042 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_expired": 0, 2024-04-24T23:07:58.042 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_with_caps": 197, 2024-04-24T23:07:58.042 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": 197, 2024-04-24T23:07:58.042 INFO:teuthology.orchestra.run.smithi043.stdout: "subtrees": 2, 2024-04-24T23:07:58.042 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse": 415063, 2024-04-24T23:07:58.042 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_hit": 95435, 2024-04-24T23:07:58.043 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_forward": 0, 2024-04-24T23:07:58.043 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_discover": 0, 2024-04-24T23:07:58.043 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_dir_fetch": 0, 2024-04-24T23:07:58.043 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_remote_ino": 0, 2024-04-24T23:07:58.043 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_lock": 4825, 2024-04-24T23:07:58.043 INFO:teuthology.orchestra.run.smithi043.stdout: "load_cent": 0, 2024-04-24T23:07:58.043 INFO:teuthology.orchestra.run.smithi043.stdout: "q": 0, 2024-04-24T23:07:58.043 INFO:teuthology.orchestra.run.smithi043.stdout: "exported": 0, 2024-04-24T23:07:58.043 INFO:teuthology.orchestra.run.smithi043.stdout: "exported_inodes": 0, 2024-04-24T23:07:58.043 INFO:teuthology.orchestra.run.smithi043.stdout: "imported": 0, 2024-04-24T23:07:58.043 INFO:teuthology.orchestra.run.smithi043.stdout: "imported_inodes": 0, 2024-04-24T23:07:58.043 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_dir_fetch": 0, 2024-04-24T23:07:58.043 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_backtrace_fetch": 0, 2024-04-24T23:07:58.043 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_peer_discover": 0, 2024-04-24T23:07:58.043 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rfiles": 0, 2024-04-24T23:07:58.044 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rbytes": 0, 2024-04-24T23:07:58.044 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rsnaps": 0, 2024-04-24T23:07:58.044 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_fetch": 0, 2024-04-24T23:07:58.044 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_set_tag": 0, 2024-04-24T23:07:58.044 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_repaired": 0, 2024-04-24T23:07:58.044 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_inotable_repaired": 0, 2024-04-24T23:07:58.044 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_inodes": 0, 2024-04-24T23:07:58.044 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_base_inodes": 0, 2024-04-24T23:07:58.044 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dirfrag_rstats": 0, 2024-04-24T23:07:58.044 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_file_inodes": 0, 2024-04-24T23:07:58.044 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_inode_file_caps": 0, 2024-04-24T23:07:58.044 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_revoke": 13773, 2024-04-24T23:07:58.044 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_grant": 29535, 2024-04-24T23:07:58.044 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_trunc": 5, 2024-04-24T23:07:58.044 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps": 820083, 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps_dirty": 12421, 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_cap_release": 344, 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: "process_request_cap_release": 69719 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache": { 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update": 0, 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update_receipt": 0, 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_try_discover": 0, 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_send_discover": 0, 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_handle_discover": 0, 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays": 0, 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_delayed": 0, 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_enqueuing": 0, 2024-04-24T23:07:58.045 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_created": 12312, 2024-04-24T23:07:58.046 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_enqueued": 12312, 2024-04-24T23:07:58.046 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_reintegrated": 0, 2024-04-24T23:07:58.046 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_migrated": 0, 2024-04-24T23:07:58.046 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_processing": 0, 2024-04-24T23:07:58.046 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_enqueued": 0, 2024-04-24T23:07:58.046 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_prioritized": 0, 2024-04-24T23:07:58.046 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_started": 0, 2024-04-24T23:07:58.046 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_completed": 0, 2024-04-24T23:07:58.046 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_path": 0, 2024-04-24T23:07:58.046 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_inode": 0, 2024-04-24T23:07:58.046 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_enqueue_scrub": 0, 2024-04-24T23:07:58.046 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_exportdir": 0, 2024-04-24T23:07:58.046 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_flush": 0, 2024-04-24T23:07:58.046 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragmentdir": 51, 2024-04-24T23:07:58.047 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragstats": 0, 2024-04-24T23:07:58.047 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_inodestats": 0 2024-04-24T23:07:58.047 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.047 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log": { 2024-04-24T23:07:58.047 INFO:teuthology.orchestra.run.smithi043.stdout: "evlrg": 0, 2024-04-24T23:07:58.047 INFO:teuthology.orchestra.run.smithi043.stdout: "evadd": 342053, 2024-04-24T23:07:58.047 INFO:teuthology.orchestra.run.smithi043.stdout: "evex": 231687, 2024-04-24T23:07:58.047 INFO:teuthology.orchestra.run.smithi043.stdout: "evtrm": 221221, 2024-04-24T23:07:58.047 INFO:teuthology.orchestra.run.smithi043.stdout: "ev": 120832, 2024-04-24T23:07:58.047 INFO:teuthology.orchestra.run.smithi043.stdout: "evexg": 0, 2024-04-24T23:07:58.047 INFO:teuthology.orchestra.run.smithi043.stdout: "evexd": 10466, 2024-04-24T23:07:58.047 INFO:teuthology.orchestra.run.smithi043.stdout: "segadd": 402, 2024-04-24T23:07:58.047 INFO:teuthology.orchestra.run.smithi043.stdout: "segex": 274, 2024-04-24T23:07:58.047 INFO:teuthology.orchestra.run.smithi043.stdout: "segtrm": 263, 2024-04-24T23:07:58.047 INFO:teuthology.orchestra.run.smithi043.stdout: "seg": 139, 2024-04-24T23:07:58.048 INFO:teuthology.orchestra.run.smithi043.stdout: "segmjr": 10, 2024-04-24T23:07:58.048 INFO:teuthology.orchestra.run.smithi043.stdout: "segexg": 0, 2024-04-24T23:07:58.048 INFO:teuthology.orchestra.run.smithi043.stdout: "segexd": 11, 2024-04-24T23:07:58.048 INFO:teuthology.orchestra.run.smithi043.stdout: "expos": 288340706, 2024-04-24T23:07:58.048 INFO:teuthology.orchestra.run.smithi043.stdout: "wrpos": 440022024, 2024-04-24T23:07:58.048 INFO:teuthology.orchestra.run.smithi043.stdout: "rdpos": 0, 2024-04-24T23:07:58.048 INFO:teuthology.orchestra.run.smithi043.stdout: "jlat": { 2024-04-24T23:07:58.048 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 10242, 2024-04-24T23:07:58.048 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 52.227831958, 2024-04-24T23:07:58.048 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.005099378 2024-04-24T23:07:58.048 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.048 INFO:teuthology.orchestra.run.smithi043.stdout: "replayed": 0 2024-04-24T23:07:58.048 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.048 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_mem": { 2024-04-24T23:07:58.048 INFO:teuthology.orchestra.run.smithi043.stdout: "ino": 209, 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: "ino+": 12325, 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: "ino-": 12116, 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: "dir": 12, 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: "dir+": 490, 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: "dir-": 478, 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: "dn": 207, 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: "dn+": 32023, 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: "dn-": 31816, 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: "cap": 1, 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: "cap+": 12314, 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: "cap-": 12313, 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: "rss": 104936, 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: "heap": 231732 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_server": { 2024-04-24T23:07:58.049 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_client_request": 226206, 2024-04-24T23:07:58.050 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_server_request": 0, 2024-04-24T23:07:58.050 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_request": 219676, 2024-04-24T23:07:58.050 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_session": 28, 2024-04-24T23:07:58.050 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_peer_request": 0, 2024-04-24T23:07:58.050 INFO:teuthology.orchestra.run.smithi043.stdout: "req_create_latency": { 2024-04-24T23:07:58.050 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 12239, 2024-04-24T23:07:58.050 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 26.569293223, 2024-04-24T23:07:58.050 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.002170871 2024-04-24T23:07:58.050 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.050 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getattr_latency": { 2024-04-24T23:07:58.050 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 708, 2024-04-24T23:07:58.050 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.399374749, 2024-04-24T23:07:58.050 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000564088 2024-04-24T23:07:58.050 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.050 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getfilelock_latency": { 2024-04-24T23:07:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: "req_link_latency": { 2024-04-24T23:07:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookup_latency": { 2024-04-24T23:07:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 177766, 2024-04-24T23:07:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 287.883455886, 2024-04-24T23:07:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.001619451 2024-04-24T23:07:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookuphash_latency": { 2024-04-24T23:07:58.052 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.052 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.052 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.052 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.052 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupino_latency": { 2024-04-24T23:07:58.052 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.052 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.052 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.052 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.052 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupname_latency": { 2024-04-24T23:07:58.052 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.052 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.052 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.052 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.053 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupparent_latency": { 2024-04-24T23:07:58.053 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.053 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.053 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.053 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.053 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupsnap_latency": { 2024-04-24T23:07:58.053 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.053 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.053 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.053 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.053 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lssnap_latency": { 2024-04-24T23:07:58.053 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.053 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.053 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.054 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.054 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mkdir_latency": { 2024-04-24T23:07:58.054 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 70, 2024-04-24T23:07:58.054 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.154378466, 2024-04-24T23:07:58.054 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.002205406 2024-04-24T23:07:58.054 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.054 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mknod_latency": { 2024-04-24T23:07:58.054 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.054 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.054 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.054 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.054 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mksnap_latency": { 2024-04-24T23:07:58.054 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.054 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.055 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.055 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.055 INFO:teuthology.orchestra.run.smithi043.stdout: "req_open_latency": { 2024-04-24T23:07:58.055 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 6741, 2024-04-24T23:07:58.055 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 11.851760707, 2024-04-24T23:07:58.055 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.001758160 2024-04-24T23:07:58.055 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.055 INFO:teuthology.orchestra.run.smithi043.stdout: "req_readdir_latency": { 2024-04-24T23:07:58.055 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 777, 2024-04-24T23:07:58.055 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 1.067793264, 2024-04-24T23:07:58.055 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.001374251 2024-04-24T23:07:58.055 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.055 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rename_latency": { 2024-04-24T23:07:58.055 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 11862, 2024-04-24T23:07:58.055 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 53.262764131, 2024-04-24T23:07:58.056 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.004490200 2024-04-24T23:07:58.056 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.056 INFO:teuthology.orchestra.run.smithi043.stdout: "req_renamesnap_latency": { 2024-04-24T23:07:58.056 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.056 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.056 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.056 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.056 INFO:teuthology.orchestra.run.smithi043.stdout: "req_snapdiff_latency": { 2024-04-24T23:07:58.056 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.056 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.056 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.056 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.056 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmdir_latency": { 2024-04-24T23:07:58.056 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 70, 2024-04-24T23:07:58.056 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 6.344140675, 2024-04-24T23:07:58.057 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.090630581 2024-04-24T23:07:58.057 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.057 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmsnap_latency": { 2024-04-24T23:07:58.057 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.057 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.057 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.057 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.057 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmxattr_latency": { 2024-04-24T23:07:58.057 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.057 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.057 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.057 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.057 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setattr_latency": { 2024-04-24T23:07:58.057 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 1, 2024-04-24T23:07:58.057 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000347705, 2024-04-24T23:07:58.058 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000347705 2024-04-24T23:07:58.058 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.058 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setdirlayout_latency": { 2024-04-24T23:07:58.058 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.058 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.058 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.058 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.058 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setfilelock_latency": { 2024-04-24T23:07:58.058 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.058 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.058 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.058 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.058 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setlayout_latency": { 2024-04-24T23:07:58.058 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.059 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.059 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.059 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.059 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setxattr_latency": { 2024-04-24T23:07:58.059 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 1, 2024-04-24T23:07:58.059 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.003487452, 2024-04-24T23:07:58.059 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.003487452 2024-04-24T23:07:58.059 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.059 INFO:teuthology.orchestra.run.smithi043.stdout: "req_symlink_latency": { 2024-04-24T23:07:58.059 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 3, 2024-04-24T23:07:58.059 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.001777633, 2024-04-24T23:07:58.059 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000592544 2024-04-24T23:07:58.059 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.059 INFO:teuthology.orchestra.run.smithi043.stdout: "req_unlink_latency": { 2024-04-24T23:07:58.059 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 9438, 2024-04-24T23:07:58.060 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 14.462729641, 2024-04-24T23:07:58.060 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.001532393 2024-04-24T23:07:58.060 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.060 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_revoke_eviction": 0, 2024-04-24T23:07:58.060 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_acquisition_throttle": 0, 2024-04-24T23:07:58.060 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getvxattr_latency": { 2024-04-24T23:07:58.060 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.060 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.060 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.060 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:58.060 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.060 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_sessions": { 2024-04-24T23:07:58.060 INFO:teuthology.orchestra.run.smithi043.stdout: "session_count": 1, 2024-04-24T23:07:58.060 INFO:teuthology.orchestra.run.smithi043.stdout: "session_add": 2, 2024-04-24T23:07:58.060 INFO:teuthology.orchestra.run.smithi043.stdout: "session_remove": 1, 2024-04-24T23:07:58.061 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_open": 1, 2024-04-24T23:07:58.061 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_stale": 0, 2024-04-24T23:07:58.061 INFO:teuthology.orchestra.run.smithi043.stdout: "total_load": 48114, 2024-04-24T23:07:58.061 INFO:teuthology.orchestra.run.smithi043.stdout: "average_load": 48114, 2024-04-24T23:07:58.061 INFO:teuthology.orchestra.run.smithi043.stdout: "avg_session_uptime": 429, 2024-04-24T23:07:58.061 INFO:teuthology.orchestra.run.smithi043.stdout: "mdthresh_evicted": 0 2024-04-24T23:07:58.061 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.061 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-04-24T23:07:58.061 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-04-24T23:07:58.061 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-04-24T23:07:58.061 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-04-24T23:07:58.061 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-04-24T23:07:58.061 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-04-24T23:07:58.061 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-04-24T23:07:58.061 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-24T23:07:58.062 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-04-24T23:07:58.062 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-24T23:07:58.062 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-04-24T23:07:58.062 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-04-24T23:07:58.062 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-04-24T23:07:58.062 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-24T23:07:58.062 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-04-24T23:07:58.062 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-04-24T23:07:58.062 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-04-24T23:07:58.062 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-04-24T23:07:58.062 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-04-24T23:07:58.062 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-24T23:07:58.062 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-04-24T23:07:58.062 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-24T23:07:58.063 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-04-24T23:07:58.063 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-04-24T23:07:58.063 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-04-24T23:07:58.063 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-04-24T23:07:58.063 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-04-24T23:07:58.063 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-24T23:07:58.063 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-04-24T23:07:58.063 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-04-24T23:07:58.063 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-04-24T23:07:58.063 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-04-24T23:07:58.063 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-04-24T23:07:58.063 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-04-24T23:07:58.063 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-04-24T23:07:58.063 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-04-24T23:07:58.063 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-04-24T23:07:58.064 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 243601, 2024-04-24T23:07:58.064 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 91, 2024-04-24T23:07:58.064 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-04-24T23:07:58.064 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-04-24T23:07:58.064 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-04-24T23:07:58.064 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-04-24T23:07:58.064 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-04-24T23:07:58.064 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-04-24T23:07:58.064 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-04-24T23:07:58.064 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-04-24T23:07:58.064 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 6768, 2024-04-24T23:07:58.064 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 89, 2024-04-24T23:07:58.064 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-04-24T23:07:58.064 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-04-24T23:07:58.064 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-04-24T23:07:58.065 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-04-24T23:07:58.065 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 653661, 2024-04-24T23:07:58.065 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 16263, 2024-04-24T23:07:58.065 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-04-24T23:07:58.065 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-04-24T23:07:58.065 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-04-24T23:07:58.065 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-04-24T23:07:58.065 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.065 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter": { 2024-04-24T23:07:58.065 INFO:teuthology.orchestra.run.smithi043.stdout: "op_active": 0, 2024-04-24T23:07:58.065 INFO:teuthology.orchestra.run.smithi043.stdout: "op_laggy": 0, 2024-04-24T23:07:58.065 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send": 53885, 2024-04-24T23:07:58.065 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send_bytes": 453332611, 2024-04-24T23:07:58.065 INFO:teuthology.orchestra.run.smithi043.stdout: "op_resend": 28, 2024-04-24T23:07:58.066 INFO:teuthology.orchestra.run.smithi043.stdout: "op_reply": 53885, 2024-04-24T23:07:58.066 INFO:teuthology.orchestra.run.smithi043.stdout: "op_latency": { 2024-04-24T23:07:58.066 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 53885, 2024-04-24T23:07:58.066 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 1280.014175723, 2024-04-24T23:07:58.066 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.023754554 2024-04-24T23:07:58.066 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.066 INFO:teuthology.orchestra.run.smithi043.stdout: "op_inflight": 0, 2024-04-24T23:07:58.066 INFO:teuthology.orchestra.run.smithi043.stdout: "oplen_avg": { 2024-04-24T23:07:58.066 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 53885, 2024-04-24T23:07:58.066 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 79640 2024-04-24T23:07:58.066 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.066 INFO:teuthology.orchestra.run.smithi043.stdout: "op": 53885, 2024-04-24T23:07:58.066 INFO:teuthology.orchestra.run.smithi043.stdout: "op_r": 669, 2024-04-24T23:07:58.066 INFO:teuthology.orchestra.run.smithi043.stdout: "op_w": 53216, 2024-04-24T23:07:58.066 INFO:teuthology.orchestra.run.smithi043.stdout: "op_rmw": 0, 2024-04-24T23:07:58.067 INFO:teuthology.orchestra.run.smithi043.stdout: "op_pg": 0, 2024-04-24T23:07:58.067 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_stat": 473, 2024-04-24T23:07:58.067 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_create": 15399, 2024-04-24T23:07:58.067 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_read": 669, 2024-04-24T23:07:58.067 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_write": 10911, 2024-04-24T23:07:58.067 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writefull": 374, 2024-04-24T23:07:58.067 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writesame": 0, 2024-04-24T23:07:58.067 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_append": 0, 2024-04-24T23:07:58.067 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_zero": 0, 2024-04-24T23:07:58.067 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_truncate": 51, 2024-04-24T23:07:58.067 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_delete": 25141, 2024-04-24T23:07:58.067 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_mapext": 0, 2024-04-24T23:07:58.067 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_sparse_read": 0, 2024-04-24T23:07:58.067 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_clonerange": 0, 2024-04-24T23:07:58.067 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_getxattr": 0, 2024-04-24T23:07:58.068 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_setxattr": 23139, 2024-04-24T23:07:58.068 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_cmpxattr": 0, 2024-04-24T23:07:58.068 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_rmxattr": 0, 2024-04-24T23:07:58.068 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_resetxattrs": 0, 2024-04-24T23:07:58.068 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_call": 0, 2024-04-24T23:07:58.068 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_watch": 0, 2024-04-24T23:07:58.068 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_notify": 0, 2024-04-24T23:07:58.068 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_src_cmpxattr": 0, 2024-04-24T23:07:58.068 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls": 0, 2024-04-24T23:07:58.068 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls_filter": 0, 2024-04-24T23:07:58.068 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_other": 5, 2024-04-24T23:07:58.068 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_active": 0, 2024-04-24T23:07:58.068 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_send": 0, 2024-04-24T23:07:58.068 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_resend": 0, 2024-04-24T23:07:58.069 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_ping": 0, 2024-04-24T23:07:58.069 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_active": 0, 2024-04-24T23:07:58.069 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_send": 0, 2024-04-24T23:07:58.069 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_resend": 0, 2024-04-24T23:07:58.069 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_active": 0, 2024-04-24T23:07:58.069 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_send": 0, 2024-04-24T23:07:58.069 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_resend": 0, 2024-04-24T23:07:58.069 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_active": 0, 2024-04-24T23:07:58.069 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_send": 0, 2024-04-24T23:07:58.069 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_resend": 0, 2024-04-24T23:07:58.069 INFO:teuthology.orchestra.run.smithi043.stdout: "command_active": 0, 2024-04-24T23:07:58.069 INFO:teuthology.orchestra.run.smithi043.stdout: "command_send": 0, 2024-04-24T23:07:58.069 INFO:teuthology.orchestra.run.smithi043.stdout: "command_resend": 0, 2024-04-24T23:07:58.069 INFO:teuthology.orchestra.run.smithi043.stdout: "map_epoch": 27, 2024-04-24T23:07:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: "map_full": 0, 2024-04-24T23:07:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: "map_inc": 7, 2024-04-24T23:07:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_sessions": 8, 2024-04-24T23:07:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_open": 8, 2024-04-24T23:07:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_close": 0, 2024-04-24T23:07:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_laggy": 0, 2024-04-24T23:07:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_wr": 2626, 2024-04-24T23:07:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_rd": 0, 2024-04-24T23:07:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_del": 852 2024-04-24T23:07:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: "oft": { 2024-04-24T23:07:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_objs": 1, 2024-04-24T23:07:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_kv_pairs": 0, 2024-04-24T23:07:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_updates": 0, 2024-04-24T23:07:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_removes": 0 2024-04-24T23:07:58.071 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.071 INFO:teuthology.orchestra.run.smithi043.stdout: "osd-slow-ops": { 2024-04-24T23:07:58.071 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_ops_count": 0 2024-04-24T23:07:58.071 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.071 INFO:teuthology.orchestra.run.smithi043.stdout: "purge_queue": { 2024-04-24T23:07:58.071 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops": 0, 2024-04-24T23:07:58.071 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops_high_water": 56, 2024-04-24T23:07:58.071 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing": 0, 2024-04-24T23:07:58.071 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_high_water": 26, 2024-04-24T23:07:58.071 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed_ops": 24959, 2024-04-24T23:07:58.071 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed": 12312, 2024-04-24T23:07:58.071 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_item_in_journal": 0 2024-04-24T23:07:58.071 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.071 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-24T23:07:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-24T23:07:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-04-24T23:07:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-24T23:07:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 1094547, 2024-04-24T23:07:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 276386395, 2024-04-24T23:07:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-24T23:07:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 1094547, 2024-04-24T23:07:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-04-24T23:07:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-04-24T23:07:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 1094547, 2024-04-24T23:07:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 276386395, 2024-04-24T23:07:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-24T23:07:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.073 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:58.073 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.073 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_bytes": { 2024-04-24T23:07:58.073 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-24T23:07:58.073 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-04-24T23:07:58.073 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-24T23:07:58.073 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-04-24T23:07:58.073 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-04-24T23:07:58.073 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-24T23:07:58.073 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-04-24T23:07:58.073 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 53885, 2024-04-24T23:07:58.073 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 454674443, 2024-04-24T23:07:58.073 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 53885, 2024-04-24T23:07:58.073 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 454674443, 2024-04-24T23:07:58.074 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-24T23:07:58.074 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.074 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.074 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.074 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:58.074 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.074 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_ops": { 2024-04-24T23:07:58.074 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-24T23:07:58.074 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 1024, 2024-04-24T23:07:58.074 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-24T23:07:58.074 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-04-24T23:07:58.074 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-04-24T23:07:58.074 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-24T23:07:58.074 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-04-24T23:07:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 53885, 2024-04-24T23:07:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 53885, 2024-04-24T23:07:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 53885, 2024-04-24T23:07:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 53885, 2024-04-24T23:07:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-24T23:07:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle": { 2024-04-24T23:07:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-24T23:07:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-04-24T23:07:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-24T23:07:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 12312, 2024-04-24T23:07:58.076 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 1341832, 2024-04-24T23:07:58.076 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-24T23:07:58.076 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 12312, 2024-04-24T23:07:58.076 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-04-24T23:07:58.076 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-04-24T23:07:58.076 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 669, 2024-04-24T23:07:58.076 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 1341832, 2024-04-24T23:07:58.076 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-24T23:07:58.076 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.076 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.076 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.076 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:58.076 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-24T23:07:58.076 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle-0x5604e1786780": { 2024-04-24T23:07:58.077 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 117404, 2024-04-24T23:07:58.077 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-04-24T23:07:58.077 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-24T23:07:58.077 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 342053, 2024-04-24T23:07:58.077 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 435827720, 2024-04-24T23:07:58.077 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-24T23:07:58.077 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 342053, 2024-04-24T23:07:58.077 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-04-24T23:07:58.077 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-04-24T23:07:58.077 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 10242, 2024-04-24T23:07:58.077 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 435710316, 2024-04-24T23:07:58.077 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-24T23:07:58.077 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-24T23:07:58.077 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.077 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.078 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:58.078 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-24T23:07:58.078 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-24T23:07:58.079 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=51 2024-04-24T23:07:58.079 DEBUG:tasks.check_counter:Getting stats from b 2024-04-24T23:07:58.079 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2024-04-24T23:07:58.214 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-04-24T23:07:58.215 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-04-24T23:07:58.215 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 4, 2024-04-24T23:07:58.215 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 4, 2024-04-24T23:07:58.215 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 1568, 2024-04-24T23:07:58.215 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 448, 2024-04-24T23:07:58.215 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-04-24T23:07:58.215 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 0, 2024-04-24T23:07:58.215 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.003717633, 2024-04-24T23:07:58.215 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000062502, 2024-04-24T23:07:58.215 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.002878540, 2024-04-24T23:07:58.215 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-24T23:07:58.216 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-04-24T23:07:58.216 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 3, 2024-04-24T23:07:58.216 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.004794982, 2024-04-24T23:07:58.216 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001598327 2024-04-24T23:07:58.216 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-04-24T23:07:58.216 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-04-24T23:07:58.216 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-04-24T23:07:58.216 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.216 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.216 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-04-24T23:07:58.216 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-04-24T23:07:58.216 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 448 2024-04-24T23:07:58.216 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-04-24T23:07:58.216 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-04-24T23:07:58.217 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 129, 2024-04-24T23:07:58.217 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 126, 2024-04-24T23:07:58.217 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 124843, 2024-04-24T23:07:58.217 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 77763, 2024-04-24T23:07:58.217 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 2, 2024-04-24T23:07:58.217 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-04-24T23:07:58.217 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.030730945, 2024-04-24T23:07:58.217 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.011894217, 2024-04-24T23:07:58.217 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.011828369, 2024-04-24T23:07:58.217 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.005682643, 2024-04-24T23:07:58.217 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-04-24T23:07:58.217 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 126, 2024-04-24T23:07:58.217 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.010647969, 2024-04-24T23:07:58.217 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000084507 2024-04-24T23:07:58.217 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-04-24T23:07:58.218 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-04-24T23:07:58.218 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-04-24T23:07:58.218 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.218 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.218 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-04-24T23:07:58.218 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 124736, 2024-04-24T23:07:58.218 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 77632 2024-04-24T23:07:58.218 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-04-24T23:07:58.218 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-04-24T23:07:58.218 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1, 2024-04-24T23:07:58.218 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 97, 2024-04-24T23:07:58.218 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 160, 2024-04-24T23:07:58.218 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 94560, 2024-04-24T23:07:58.218 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 3, 2024-04-24T23:07:58.219 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-04-24T23:07:58.219 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.010012302, 2024-04-24T23:07:58.219 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.007147350, 2024-04-24T23:07:58.219 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.001549356, 2024-04-24T23:07:58.219 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-24T23:07:58.219 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-04-24T23:07:58.219 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 95, 2024-04-24T23:07:58.219 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.007158632, 2024-04-24T23:07:58.219 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000075354 2024-04-24T23:07:58.219 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-04-24T23:07:58.219 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-04-24T23:07:58.219 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-04-24T23:07:58.219 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.219 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.220 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-04-24T23:07:58.220 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-24T23:07:58.220 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 94560 2024-04-24T23:07:58.220 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-04-24T23:07:58.220 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-04-24T23:07:58.220 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 0, 2024-04-24T23:07:58.220 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-04-24T23:07:58.220 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-04-24T23:07:58.220 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-04-24T23:07:58.220 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-04-24T23:07:58.220 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-04-24T23:07:58.220 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-04-24T23:07:58.220 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-04-24T23:07:58.220 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-04-24T23:07:58.220 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-04-24T23:07:58.221 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-24T23:07:58.221 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-04-24T23:07:58.221 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-24T23:07:58.221 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-04-24T23:07:58.221 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-04-24T23:07:58.221 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-04-24T23:07:58.221 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-24T23:07:58.221 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-04-24T23:07:58.221 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-04-24T23:07:58.221 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-04-24T23:07:58.221 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-04-24T23:07:58.221 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-04-24T23:07:58.221 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-24T23:07:58.222 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-04-24T23:07:58.222 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-24T23:07:58.222 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-04-24T23:07:58.222 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-04-24T23:07:58.222 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-04-24T23:07:58.222 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-04-24T23:07:58.222 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-04-24T23:07:58.222 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-24T23:07:58.222 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-04-24T23:07:58.222 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-04-24T23:07:58.222 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-04-24T23:07:58.222 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-04-24T23:07:58.222 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-04-24T23:07:58.222 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-04-24T23:07:58.223 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-04-24T23:07:58.223 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-04-24T23:07:58.223 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-04-24T23:07:58.223 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 149854, 2024-04-24T23:07:58.223 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 28, 2024-04-24T23:07:58.223 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-04-24T23:07:58.223 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-04-24T23:07:58.223 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-04-24T23:07:58.223 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-04-24T23:07:58.223 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-04-24T23:07:58.223 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-04-24T23:07:58.223 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-04-24T23:07:58.223 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-04-24T23:07:58.223 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 0, 2024-04-24T23:07:58.224 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 0, 2024-04-24T23:07:58.224 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-04-24T23:07:58.224 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-04-24T23:07:58.224 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-04-24T23:07:58.224 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-04-24T23:07:58.224 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 928, 2024-04-24T23:07:58.224 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2, 2024-04-24T23:07:58.224 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-04-24T23:07:58.224 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-04-24T23:07:58.224 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-04-24T23:07:58.224 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-04-24T23:07:58.224 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-04-24T23:07:58.224 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-24T23:07:58.224 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-04-24T23:07:58.225 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-04-24T23:07:58.225 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-04-24T23:07:58.225 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 129, 2024-04-24T23:07:58.225 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 106666, 2024-04-24T23:07:58.225 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-04-24T23:07:58.225 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 129, 2024-04-24T23:07:58.225 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-04-24T23:07:58.225 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-04-24T23:07:58.225 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 129, 2024-04-24T23:07:58.225 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 106666, 2024-04-24T23:07:58.225 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-04-24T23:07:58.225 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-04-24T23:07:58.225 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-04-24T23:07:58.225 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-04-24T23:07:58.226 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-04-24T23:07:58.226 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-04-24T23:07:58.226 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-04-24T23:07:58.230 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.b 2024-04-24T23:07:58.230 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-24T23:07:58.243 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-24T23:07:58.243 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T23:07:58.243 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:07:58.257 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T23:07:58.257 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:07:58.303 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:07:58.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.466+0000 7fecb925d640 1 Processor -- start 2024-04-24T23:07:58.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.466+0000 7fecb925d640 1 -- start start 2024-04-24T23:07:58.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.466+0000 7fecb925d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fecb4070b20 0x7fecb40b6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:58.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.466+0000 7fecb925d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fecb4061c30 0x7fecb40620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:58.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.466+0000 7fecb925d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecb406c980 con 0x7fecb40b5e40 2024-04-24T23:07:58.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.466+0000 7fecb925d640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fecb41460d0 con 0x7fecb4061c30 2024-04-24T23:07:58.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.466+0000 7fecb925d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fecb4145a80 con 0x7fecb4070b20 2024-04-24T23:07:58.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.466+0000 7fecb359e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fecb4061c30 0x7fecb40620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:58.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.466+0000 7fecb359e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fecb4061c30 0x7fecb40620c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50652/0 (socket says 172.21.15.43:50652) 2024-04-24T23:07:58.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.466+0000 7fecb359e640 1 -- 172.21.15.43:0/1463600647 learned_addr learned my addr 172.21.15.43:0/1463600647 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:58.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.466+0000 7fecb259c640 1 --2- 172.21.15.43:0/1463600647 >> v2:172.21.15.162:3300/0 conn(0x7fecb4070b20 0x7fecb40b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:58.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.466+0000 7fecb359e640 1 -- 172.21.15.43:0/1463600647 >> v2:172.21.15.162:3300/0 conn(0x7fecb4070b20 msgr2=0x7fecb40b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:58.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.466+0000 7fecb359e640 1 --2- 172.21.15.43:0/1463600647 >> v2:172.21.15.162:3300/0 conn(0x7fecb4070b20 0x7fecb40b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.466+0000 7fecb359e640 1 -- 172.21.15.43:0/1463600647 >> v1:172.21.15.162:6789/0 conn(0x7fecb40b5e40 legacy=0x7fecb413f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:58.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.466+0000 7fecb359e640 1 -- 172.21.15.43:0/1463600647 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb4062600 con 0x7fecb4061c30 2024-04-24T23:07:58.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb359e640 1 --2- 172.21.15.43:0/1463600647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb4061c30 0x7fecb40620c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fecb40b4450 tx=0x7feca401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3744b4ffa27bcc58 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:58.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb1d9b640 1 -- 172.21.15.43:0/1463600647 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca40a5690 con 0x7fecb4061c30 2024-04-24T23:07:58.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb1d9b640 1 -- 172.21.15.43:0/1463600647 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca40a5830 con 0x7fecb4061c30 2024-04-24T23:07:58.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb1d9b640 1 -- 172.21.15.43:0/1463600647 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca40a5c00 con 0x7fecb4061c30 2024-04-24T23:07:58.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 -- 172.21.15.43:0/1463600647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb4061c30 msgr2=0x7fecb40620c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:58.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 --2- 172.21.15.43:0/1463600647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb4061c30 0x7fecb40620c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fecb40b4450 tx=0x7feca401c920 comp rx=0 tx=0).stop 2024-04-24T23:07:58.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 -- 172.21.15.43:0/1463600647 shutdown_connections 2024-04-24T23:07:58.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 --2- 172.21.15.43:0/1463600647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb4061c30 0x7fecb40620c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 --2- 172.21.15.43:0/1463600647 >> v2:172.21.15.162:3300/0 conn(0x7fecb4070b20 0x7fecb40b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 -- 172.21.15.43:0/1463600647 >> 172.21.15.43:0/1463600647 conn(0x7fecb406e7e0 msgr2=0x7fecb406b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:58.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 -- 172.21.15.43:0/1463600647 shutdown_connections 2024-04-24T23:07:58.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 -- 172.21.15.43:0/1463600647 wait complete. 2024-04-24T23:07:58.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 Processor -- start 2024-04-24T23:07:58.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 -- start start 2024-04-24T23:07:58.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb4061c30 0x7fecb40b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:58.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecb4070b20 0x7fecb409f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:58.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecb40b5e40 0x7fecb41dfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:58.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fecb41526a0 con 0x7fecb4061c30 2024-04-24T23:07:58.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fecb4152520 con 0x7fecb4070b20 2024-04-24T23:07:58.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb925d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fecb4152820 con 0x7fecb40b5e40 2024-04-24T23:07:58.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb2d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb4061c30 0x7fecb40b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:58.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb2d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb4061c30 0x7fecb40b0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50668/0 (socket says 172.21.15.43:50668) 2024-04-24T23:07:58.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb2d9d640 1 -- 172.21.15.43:0/2474023230 learned_addr learned my addr 172.21.15.43:0/2474023230 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:58.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb259c640 1 --2- 172.21.15.43:0/2474023230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecb4070b20 0x7fecb409f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:58.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb2d9d640 1 -- 172.21.15.43:0/2474023230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecb40b5e40 msgr2=0x7fecb41dfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:58.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb359e640 1 --2- 172.21.15.43:0/2474023230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecb40b5e40 0x7fecb41dfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:58.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.470+0000 7fecb2d9d640 1 --2- 172.21.15.43:0/2474023230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecb40b5e40 0x7fecb41dfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.474+0000 7fecb2d9d640 1 -- 172.21.15.43:0/2474023230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecb4070b20 msgr2=0x7fecb409f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.474+0000 7fecb2d9d640 1 --2- 172.21.15.43:0/2474023230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecb4070b20 0x7fecb409f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.474+0000 7fecb2d9d640 1 -- 172.21.15.43:0/2474023230 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb41486a0 con 0x7fecb4061c30 2024-04-24T23:07:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.474+0000 7fecb2d9d640 1 --2- 172.21.15.43:0/2474023230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb4061c30 0x7fecb40b0960 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fecac00c480 tx=0x7fecac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.474+0000 7fec9b7fe640 1 -- 172.21.15.43:0/2474023230 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac012830 con 0x7fecb4061c30 2024-04-24T23:07:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.474+0000 7fec9b7fe640 1 -- 172.21.15.43:0/2474023230 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecac017070 con 0x7fecb4061c30 2024-04-24T23:07:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.474+0000 7fecb925d640 1 -- 172.21.15.43:0/2474023230 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb4148ed0 con 0x7fecb4061c30 2024-04-24T23:07:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.474+0000 7fec9b7fe640 1 -- 172.21.15.43:0/2474023230 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac012c30 con 0x7fecb4061c30 2024-04-24T23:07:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.474+0000 7fecb925d640 1 -- 172.21.15.43:0/2474023230 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb41429b0 con 0x7fecb4061c30 2024-04-24T23:07:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.474+0000 7fecb925d640 1 -- 172.21.15.43:0/2474023230 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecb4071c00 con 0x7fecb4061c30 2024-04-24T23:07:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.474+0000 7fec9b7fe640 1 -- 172.21.15.43:0/2474023230 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fecac01c460 con 0x7fecb4061c30 2024-04-24T23:07:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.474+0000 7fec9b7fe640 1 --2- 172.21.15.43:0/2474023230 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7feca00678c0 0x7feca0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.474+0000 7fec9b7fe640 1 -- 172.21.15.43:0/2474023230 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fecac085e60 con 0x7fecb4061c30 2024-04-24T23:07:58.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.474+0000 7fecb259c640 1 --2- 172.21.15.43:0/2474023230 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7feca00678c0 0x7feca0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:58.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.474+0000 7fecb259c640 1 --2- 172.21.15.43:0/2474023230 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7feca00678c0 0x7feca0069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fecb41427e0 tx=0x7feca8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:58.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.478+0000 7fec9b7fe640 1 -- 172.21.15.43:0/2474023230 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fecac056660 con 0x7fecb4061c30 2024-04-24T23:07:58.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.642+0000 7fecb925d640 1 -- 172.21.15.43:0/2474023230 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecb4149580 con 0x7fecb4061c30 2024-04-24T23:07:58.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.642+0000 7fec9b7fe640 1 -- 172.21.15.43:0/2474023230 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18754 (secure 0 0 0) 0x7fecac055f60 con 0x7fecb4061c30 2024-04-24T23:07:58.645 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:07:58.645 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:57.637496+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":5}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.1a","mappings":[{"from":7,"to":4}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:07:58.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.646+0000 7fecb925d640 1 -- 172.21.15.43:0/2474023230 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7feca00678c0 msgr2=0x7feca0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:58.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.646+0000 7fecb925d640 1 --2- 172.21.15.43:0/2474023230 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7feca00678c0 0x7feca0069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fecb41427e0 tx=0x7feca8008040 comp rx=0 tx=0).stop 2024-04-24T23:07:58.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.646+0000 7fecb925d640 1 -- 172.21.15.43:0/2474023230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb4061c30 msgr2=0x7fecb40b0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:58.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.646+0000 7fecb925d640 1 --2- 172.21.15.43:0/2474023230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb4061c30 0x7fecb40b0960 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fecac00c480 tx=0x7fecac00c940 comp rx=0 tx=0).stop 2024-04-24T23:07:58.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.646+0000 7fecb925d640 1 -- 172.21.15.43:0/2474023230 shutdown_connections 2024-04-24T23:07:58.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.646+0000 7fecb925d640 1 --2- 172.21.15.43:0/2474023230 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7feca00678c0 0x7feca0069d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.646+0000 7fecb925d640 1 --2- 172.21.15.43:0/2474023230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecb40b5e40 0x7fecb41dfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.646+0000 7fecb925d640 1 --2- 172.21.15.43:0/2474023230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecb4070b20 0x7fecb409f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.646+0000 7fecb925d640 1 --2- 172.21.15.43:0/2474023230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb4061c30 0x7fecb40b0960 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.646+0000 7fecb925d640 1 -- 172.21.15.43:0/2474023230 >> 172.21.15.43:0/2474023230 conn(0x7fecb406e7e0 msgr2=0x7fecb40b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:58.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.646+0000 7fecb925d640 1 -- 172.21.15.43:0/2474023230 shutdown_connections 2024-04-24T23:07:58.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.646+0000 7fecb925d640 1 -- 172.21.15.43:0/2474023230 wait complete. 2024-04-24T23:07:58.663 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:00:02.322280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:00:14.136303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:00:14.764010+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T23:00:18.504756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:07:58.663 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:07:58.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.778+0000 7f06a7f17640 1 Processor -- start 2024-04-24T23:07:58.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.778+0000 7f06a7f17640 1 -- start start 2024-04-24T23:07:58.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a7f17640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f06a01488f0 0x7f06a0150c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:58.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a7f17640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a00b4e60 con 0x7f06a00b5e00 2024-04-24T23:07:58.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a7f17640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a00732a0 con 0x7f06a0072ec0 2024-04-24T23:07:58.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a7f17640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f06a00b5100 con 0x7f06a01488f0 2024-04-24T23:07:58.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a54b2640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f06a00b5e00 0x7f06a00b3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33092/0 (socket says 172.21.15.43:33092) 2024-04-24T23:07:58.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a64b4640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f06a01488f0 0x7f06a0150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:58.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a54b2640 1 -- 172.21.15.43:0/2918379513 learned_addr learned my addr 172.21.15.43:0/2918379513 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:07:58.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a64b4640 1 -- 172.21.15.43:0/2918379513 >> v1:172.21.15.162:6789/0 conn(0x7f06a0072ec0 legacy=0x7f06a00b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:58.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a64b4640 1 -- 172.21.15.43:0/2918379513 >> v1:172.21.15.43:6789/0 conn(0x7f06a00b5e00 legacy=0x7f06a00b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:58.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a64b4640 1 -- 172.21.15.43:0/2918379513 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a0148d30 con 0x7f06a01488f0 2024-04-24T23:07:58.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a4cb1640 1 -- 172.21.15.43:0/2918379513 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2106483087 0 0) 0x7f06a00b4e60 con 0x7f06a00b5e00 2024-04-24T23:07:58.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a64b4640 1 --2- 172.21.15.43:0/2918379513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a01488f0 0x7f06a0150c70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0698009d90 tx=0x7f069801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88399c6f5bb65c5c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:58.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a4cb1640 1 -- 172.21.15.43:0/2918379513 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06980b2070 con 0x7f06a01488f0 2024-04-24T23:07:58.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a4cb1640 1 -- 172.21.15.43:0/2918379513 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06980a5800 con 0x7f06a01488f0 2024-04-24T23:07:58.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a4cb1640 1 -- 172.21.15.43:0/2918379513 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06980a5bd0 con 0x7f06a01488f0 2024-04-24T23:07:58.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a7f17640 1 -- 172.21.15.43:0/2918379513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a01488f0 msgr2=0x7f06a0150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:58.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a7f17640 1 --2- 172.21.15.43:0/2918379513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a01488f0 0x7f06a0150c70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0698009d90 tx=0x7f069801c850 comp rx=0 tx=0).stop 2024-04-24T23:07:58.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a7f17640 1 -- 172.21.15.43:0/2918379513 shutdown_connections 2024-04-24T23:07:58.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a7f17640 1 --2- 172.21.15.43:0/2918379513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a01488f0 0x7f06a0150c70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a7f17640 1 -- 172.21.15.43:0/2918379513 >> 172.21.15.43:0/2918379513 conn(0x7f06a006c300 msgr2=0x7f06a006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:58.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a7f17640 1 -- 172.21.15.43:0/2918379513 shutdown_connections 2024-04-24T23:07:58.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.782+0000 7f06a7f17640 1 -- 172.21.15.43:0/2918379513 wait complete. 2024-04-24T23:07:58.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a7f17640 1 Processor -- start 2024-04-24T23:07:58.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a7f17640 1 -- start start 2024-04-24T23:07:58.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a7f17640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06a0072ec0 0x7f06a013e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a7f17640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a00b5e00 0x7f06a01dd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a7f17640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06a01488f0 0x7f06a01ddef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a7f17640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f06a00b0e10 con 0x7f06a00b5e00 2024-04-24T23:07:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a7f17640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f06a00b0c90 con 0x7f06a01488f0 2024-04-24T23:07:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a7f17640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f06a01539d0 con 0x7f06a0072ec0 2024-04-24T23:07:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a54b2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a00b5e00 0x7f06a01dd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a54b2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a00b5e00 0x7f06a01dd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50688/0 (socket says 172.21.15.43:50688) 2024-04-24T23:07:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a54b2640 1 -- 172.21.15.43:0/1399506377 learned_addr learned my addr 172.21.15.43:0/1399506377 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a64b4640 1 --2- 172.21.15.43:0/1399506377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06a01488f0 0x7f06a01ddef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a54b2640 1 -- 172.21.15.43:0/1399506377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06a0072ec0 msgr2=0x7f06a013e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a5cb3640 1 --2- 172.21.15.43:0/1399506377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06a0072ec0 0x7f06a013e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a54b2640 1 --2- 172.21.15.43:0/1399506377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06a0072ec0 0x7f06a013e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a54b2640 1 -- 172.21.15.43:0/1399506377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06a01488f0 msgr2=0x7f06a01ddef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a54b2640 1 --2- 172.21.15.43:0/1399506377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06a01488f0 0x7f06a01ddef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a54b2640 1 -- 172.21.15.43:0/1399506377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a0142fa0 con 0x7f06a00b5e00 2024-04-24T23:07:58.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a54b2640 1 --2- 172.21.15.43:0/1399506377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a00b5e00 0x7f06a01dd9b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f069000c4d0 tx=0x7f069000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:58.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06967fc640 1 -- 172.21.15.43:0/1399506377 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690018070 con 0x7f06a00b5e00 2024-04-24T23:07:58.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06967fc640 1 -- 172.21.15.43:0/1399506377 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06900074e0 con 0x7f06a00b5e00 2024-04-24T23:07:58.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06967fc640 1 -- 172.21.15.43:0/1399506377 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690004a30 con 0x7f06a00b5e00 2024-04-24T23:07:58.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a7f17640 1 -- 172.21.15.43:0/1399506377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a00aa5b0 con 0x7f06a00b5e00 2024-04-24T23:07:58.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a7f17640 1 -- 172.21.15.43:0/1399506377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a00a94d0 con 0x7f06a00b5e00 2024-04-24T23:07:58.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.786+0000 7f06a7f17640 1 -- 172.21.15.43:0/1399506377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a004f580 con 0x7f06a00b5e00 2024-04-24T23:07:58.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.790+0000 7f06967fc640 1 -- 172.21.15.43:0/1399506377 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0690004bd0 con 0x7f06a00b5e00 2024-04-24T23:07:58.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.790+0000 7f06967fc640 1 --2- 172.21.15.43:0/1399506377 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f06840678c0 0x7f0684069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:58.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.790+0000 7f06967fc640 1 -- 172.21.15.43:0/1399506377 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f0690085420 con 0x7f06a00b5e00 2024-04-24T23:07:58.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.790+0000 7f06a5cb3640 1 --2- 172.21.15.43:0/1399506377 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f06840678c0 0x7f0684069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:58.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.790+0000 7f06a5cb3640 1 --2- 172.21.15.43:0/1399506377 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f06840678c0 0x7f0684069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f069c000f70 tx=0x7f069c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:58.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.794+0000 7f06967fc640 1 -- 172.21.15.43:0/1399506377 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f0690055b80 con 0x7f06a00b5e00 2024-04-24T23:07:58.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.954+0000 7f06a7f17640 1 -- 172.21.15.43:0/1399506377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f06a00b16f0 con 0x7f06a00b5e00 2024-04-24T23:07:58.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.954+0000 7f06967fc640 1 -- 172.21.15.43:0/1399506377 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f0690055480 con 0x7f06a00b5e00 2024-04-24T23:07:58.957 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-24T23:07:58.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.958+0000 7f06a7f17640 1 -- 172.21.15.43:0/1399506377 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f06840678c0 msgr2=0x7f0684069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:58.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.958+0000 7f06a7f17640 1 --2- 172.21.15.43:0/1399506377 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f06840678c0 0x7f0684069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f069c000f70 tx=0x7f069c009040 comp rx=0 tx=0).stop 2024-04-24T23:07:58.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.958+0000 7f06a7f17640 1 -- 172.21.15.43:0/1399506377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a00b5e00 msgr2=0x7f06a01dd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:58.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.958+0000 7f06a7f17640 1 --2- 172.21.15.43:0/1399506377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a00b5e00 0x7f06a01dd9b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f069000c4d0 tx=0x7f069000c990 comp rx=0 tx=0).stop 2024-04-24T23:07:58.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.958+0000 7f06a7f17640 1 -- 172.21.15.43:0/1399506377 shutdown_connections 2024-04-24T23:07:58.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.958+0000 7f06a7f17640 1 --2- 172.21.15.43:0/1399506377 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f06840678c0 0x7f0684069d80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.958+0000 7f06a7f17640 1 --2- 172.21.15.43:0/1399506377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06a01488f0 0x7f06a01ddef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.958+0000 7f06a7f17640 1 --2- 172.21.15.43:0/1399506377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a00b5e00 0x7f06a01dd9b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.958+0000 7f06a7f17640 1 --2- 172.21.15.43:0/1399506377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06a0072ec0 0x7f06a013e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:58.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.958+0000 7f06a7f17640 1 -- 172.21.15.43:0/1399506377 >> 172.21.15.43:0/1399506377 conn(0x7f06a006c300 msgr2=0x7f06a00b9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:58.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.958+0000 7f06a7f17640 1 -- 172.21.15.43:0/1399506377 shutdown_connections 2024-04-24T23:07:58.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:58.958+0000 7f06a7f17640 1 -- 172.21.15.43:0/1399506377 wait complete. 2024-04-24T23:07:58.975 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:07:59.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f2358c640 1 Processor -- start 2024-04-24T23:07:59.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f2358c640 1 -- start start 2024-04-24T23:07:59.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f2358c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8f1c0b5560 0x7f8f1c148870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f2358c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c0b3370 0x7f8f1c148db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f2358c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f1c0b3890 con 0x7f8f1c061c30 2024-04-24T23:07:59.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f2358c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1c070730 con 0x7f8f1c0b5560 2024-04-24T23:07:59.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f2358c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1c0703c0 con 0x7f8f1c0b3370 2024-04-24T23:07:59.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f21b29640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c0b3370 0x7f8f1c148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:59.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f20b27640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8f1c0b5560 0x7f8f1c148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:59.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f21b29640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c0b3370 0x7f8f1c148db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.43:55542/0 (socket says 172.21.15.43:55542) 2024-04-24T23:07:59.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f21b29640 1 -- 172.21.15.43:0/1388188083 learned_addr learned my addr 172.21.15.43:0/1388188083 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:59.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f21b29640 1 -- 172.21.15.43:0/1388188083 >> v2:172.21.15.162:3300/0 conn(0x7f8f1c0b5560 msgr2=0x7f8f1c148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:59.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f21b29640 1 --2- 172.21.15.43:0/1388188083 >> v2:172.21.15.162:3300/0 conn(0x7f8f1c0b5560 0x7f8f1c148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f21b29640 1 -- 172.21.15.43:0/1388188083 >> v1:172.21.15.162:6789/0 conn(0x7f8f1c061c30 legacy=0x7f8f1c13f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f21b29640 1 -- 172.21.15.43:0/1388188083 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c0b5be0 con 0x7f8f1c0b3370 2024-04-24T23:07:59.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.094+0000 7f8f20b27640 1 --2- 172.21.15.43:0/1388188083 >> v2:172.21.15.162:3300/0 conn(0x7f8f1c0b5560 0x7f8f1c148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:07:59.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f21b29640 1 --2- 172.21.15.43:0/1388188083 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c0b3370 0x7f8f1c148db0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009e50 tx=0x7f8f1401c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3d4dd6588d64934 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:59.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f13fff640 1 -- 172.21.15.43:0/1388188083 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f140a5880 con 0x7f8f1c0b3370 2024-04-24T23:07:59.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f13fff640 1 -- 172.21.15.43:0/1388188083 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f140a5a20 con 0x7f8f1c0b3370 2024-04-24T23:07:59.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f13fff640 1 -- 172.21.15.43:0/1388188083 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f140a5df0 con 0x7f8f1c0b3370 2024-04-24T23:07:59.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 -- 172.21.15.43:0/1388188083 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c0b3370 msgr2=0x7f8f1c148db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 --2- 172.21.15.43:0/1388188083 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c0b3370 0x7f8f1c148db0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009e50 tx=0x7f8f1401c9a0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 -- 172.21.15.43:0/1388188083 shutdown_connections 2024-04-24T23:07:59.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 --2- 172.21.15.43:0/1388188083 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c0b3370 0x7f8f1c148db0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 --2- 172.21.15.43:0/1388188083 >> v2:172.21.15.162:3300/0 conn(0x7f8f1c0b5560 0x7f8f1c148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 -- 172.21.15.43:0/1388188083 >> 172.21.15.43:0/1388188083 conn(0x7f8f1c0b93e0 msgr2=0x7f8f1c0b97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:59.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 -- 172.21.15.43:0/1388188083 shutdown_connections 2024-04-24T23:07:59.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 -- 172.21.15.43:0/1388188083 wait complete. 2024-04-24T23:07:59.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 Processor -- start 2024-04-24T23:07:59.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 -- start start 2024-04-24T23:07:59.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c061c30 0x7f8f1c147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f1c0b3370 0x7f8f1c1310c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c0b5560 0x7f8f1c1e3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c152740 con 0x7f8f1c0b3370 2024-04-24T23:07:59.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c1525c0 con 0x7f8f1c061c30 2024-04-24T23:07:59.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.098+0000 7f8f2358c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1c1528c0 con 0x7f8f1c0b5560 2024-04-24T23:07:59.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f20b27640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f1c0b3370 0x7f8f1c1310c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:59.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f20b27640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f1c0b3370 0x7f8f1c1310c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50694/0 (socket says 172.21.15.43:50694) 2024-04-24T23:07:59.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f20b27640 1 -- 172.21.15.43:0/1137444237 learned_addr learned my addr 172.21.15.43:0/1137444237 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:59.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f21328640 1 --2- 172.21.15.43:0/1137444237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c061c30 0x7f8f1c147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:59.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f21b29640 1 --2- 172.21.15.43:0/1137444237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c0b5560 0x7f8f1c1e3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:59.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f20b27640 1 -- 172.21.15.43:0/1137444237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c0b5560 msgr2=0x7f8f1c1e3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f20b27640 1 --2- 172.21.15.43:0/1137444237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c0b5560 0x7f8f1c1e3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f20b27640 1 -- 172.21.15.43:0/1137444237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c061c30 msgr2=0x7f8f1c147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f20b27640 1 --2- 172.21.15.43:0/1137444237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c061c30 0x7f8f1c147620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f20b27640 1 -- 172.21.15.43:0/1137444237 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c146ad0 con 0x7f8f1c0b3370 2024-04-24T23:07:59.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f20b27640 1 --2- 172.21.15.43:0/1137444237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f1c0b3370 0x7f8f1c1310c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00ebe0 tx=0x7f8f0c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:59.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f11ffb640 1 -- 172.21.15.43:0/1137444237 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c017070 con 0x7f8f1c0b3370 2024-04-24T23:07:59.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f11ffb640 1 -- 172.21.15.43:0/1137444237 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f0c00cc30 con 0x7f8f1c0b3370 2024-04-24T23:07:59.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f2358c640 1 -- 172.21.15.43:0/1137444237 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1c0b0f60 con 0x7f8f1c0b3370 2024-04-24T23:07:59.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f11ffb640 1 -- 172.21.15.43:0/1137444237 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c013470 con 0x7f8f1c0b3370 2024-04-24T23:07:59.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f2358c640 1 -- 172.21.15.43:0/1137444237 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f1c131e80 con 0x7f8f1c0b3370 2024-04-24T23:07:59.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f2358c640 1 -- 172.21.15.43:0/1137444237 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f1c06c200 con 0x7f8f1c0b3370 2024-04-24T23:07:59.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f11ffb640 1 -- 172.21.15.43:0/1137444237 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f0c01a070 con 0x7f8f1c0b3370 2024-04-24T23:07:59.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f11ffb640 1 --2- 172.21.15.43:0/1137444237 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8f000678c0 0x7f8f00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f11ffb640 1 -- 172.21.15.43:0/1137444237 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f8f0c085f90 con 0x7f8f1c0b3370 2024-04-24T23:07:59.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f21328640 1 --2- 172.21.15.43:0/1137444237 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8f000678c0 0x7f8f00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:59.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.102+0000 7f8f21328640 1 --2- 172.21.15.43:0/1137444237 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8f000678c0 0x7f8f00069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f18000f70 tx=0x7f8f18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:59.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.110+0000 7f8f11ffb640 1 -- 172.21.15.43:0/1137444237 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8f0c056790 con 0x7f8f1c0b3370 2024-04-24T23:07:59.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.270+0000 7f8f2358c640 1 -- 172.21.15.43:0/1137444237 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8f1c142c80 con 0x7f8f1c0b3370 2024-04-24T23:07:59.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.270+0000 7f8f11ffb640 1 -- 172.21.15.43:0/1137444237 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f8f0c056090 con 0x7f8f1c0b3370 2024-04-24T23:07:59.273 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-24T23:07:59.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.270+0000 7f8f2358c640 1 -- 172.21.15.43:0/1137444237 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8f000678c0 msgr2=0x7f8f00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.270+0000 7f8f2358c640 1 --2- 172.21.15.43:0/1137444237 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8f000678c0 0x7f8f00069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f18000f70 tx=0x7f8f18009040 comp rx=0 tx=0).stop 2024-04-24T23:07:59.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.274+0000 7f8f2358c640 1 -- 172.21.15.43:0/1137444237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f1c0b3370 msgr2=0x7f8f1c1310c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.274+0000 7f8f2358c640 1 --2- 172.21.15.43:0/1137444237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f1c0b3370 0x7f8f1c1310c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00ebe0 tx=0x7f8f0c00c520 comp rx=0 tx=0).stop 2024-04-24T23:07:59.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.274+0000 7f8f2358c640 1 -- 172.21.15.43:0/1137444237 shutdown_connections 2024-04-24T23:07:59.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.274+0000 7f8f2358c640 1 --2- 172.21.15.43:0/1137444237 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8f000678c0 0x7f8f00069d80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.274+0000 7f8f2358c640 1 --2- 172.21.15.43:0/1137444237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1c0b5560 0x7f8f1c1e3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.274+0000 7f8f2358c640 1 --2- 172.21.15.43:0/1137444237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f1c0b3370 0x7f8f1c1310c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.274+0000 7f8f2358c640 1 --2- 172.21.15.43:0/1137444237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c061c30 0x7f8f1c147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.274+0000 7f8f2358c640 1 -- 172.21.15.43:0/1137444237 >> 172.21.15.43:0/1137444237 conn(0x7f8f1c0b93e0 msgr2=0x7f8f1c1374c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:59.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.274+0000 7f8f2358c640 1 -- 172.21.15.43:0/1137444237 shutdown_connections 2024-04-24T23:07:59.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.274+0000 7f8f2358c640 1 -- 172.21.15.43:0/1137444237 wait complete. 2024-04-24T23:07:59.291 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:07:59.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.406+0000 7f32b6333640 1 Processor -- start 2024-04-24T23:07:59.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.406+0000 7f32b6333640 1 -- start start 2024-04-24T23:07:59.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.406+0000 7f32b6333640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f32b0148ba0 0x7f32b0149050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.406+0000 7f32b6333640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b014f190 0x7f32b014f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.406+0000 7f32b6333640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b014fb20 con 0x7f32b0070c40 2024-04-24T23:07:59.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.406+0000 7f32b6333640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f32b0071020 con 0x7f32b0148ba0 2024-04-24T23:07:59.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.406+0000 7f32b6333640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f32b00b55b0 con 0x7f32b014f190 2024-04-24T23:07:59.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.406+0000 7f32af7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f32b0148ba0 0x7f32b0149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:59.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.406+0000 7f32af7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f32b0148ba0 0x7f32b0149050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50706/0 (socket says 172.21.15.43:50706) 2024-04-24T23:07:59.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.406+0000 7f32af7fe640 1 -- 172.21.15.43:0/2284043183 learned_addr learned my addr 172.21.15.43:0/2284043183 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:59.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.406+0000 7f32af7fe640 1 -- 172.21.15.43:0/2284043183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b014f190 msgr2=0x7f32b014f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:59.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.406+0000 7f32af7fe640 1 --2- 172.21.15.43:0/2284043183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b014f190 0x7f32b014f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.406+0000 7f32af7fe640 1 -- 172.21.15.43:0/2284043183 >> v1:172.21.15.162:6789/0 conn(0x7f32b0070c40 legacy=0x7f32b00b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:59.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.406+0000 7f32af7fe640 1 -- 172.21.15.43:0/2284043183 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b00b68b0 con 0x7f32b0148ba0 2024-04-24T23:07:59.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32af7fe640 1 --2- 172.21.15.43:0/2284043183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b0148ba0 0x7f32b0149050 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009870 tx=0x7f32a401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78d65a529e67fef server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:59.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32aeffd640 1 -- 172.21.15.43:0/2284043183 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a40b0070 con 0x7f32b0148ba0 2024-04-24T23:07:59.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32aeffd640 1 -- 172.21.15.43:0/2284043183 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a40ab600 con 0x7f32b0148ba0 2024-04-24T23:07:59.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32aeffd640 1 -- 172.21.15.43:0/2284043183 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a40ab9d0 con 0x7f32b0148ba0 2024-04-24T23:07:59.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 -- 172.21.15.43:0/2284043183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b0148ba0 msgr2=0x7f32b0149050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 --2- 172.21.15.43:0/2284043183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b0148ba0 0x7f32b0149050 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009870 tx=0x7f32a401c490 comp rx=0 tx=0).stop 2024-04-24T23:07:59.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 -- 172.21.15.43:0/2284043183 shutdown_connections 2024-04-24T23:07:59.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 --2- 172.21.15.43:0/2284043183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b014f190 0x7f32b014f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 --2- 172.21.15.43:0/2284043183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b0148ba0 0x7f32b0149050 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 -- 172.21.15.43:0/2284043183 >> 172.21.15.43:0/2284043183 conn(0x7f32b006c300 msgr2=0x7f32b006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:59.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 -- 172.21.15.43:0/2284043183 shutdown_connections 2024-04-24T23:07:59.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 -- 172.21.15.43:0/2284043183 wait complete. 2024-04-24T23:07:59.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 Processor -- start 2024-04-24T23:07:59.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 -- start start 2024-04-24T23:07:59.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b0070c40 0x7f32b01e4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b0148ba0 0x7f32b0140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b014f190 0x7f32b01370f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f32b0158be0 con 0x7f32b0148ba0 2024-04-24T23:07:59.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f32b0158a60 con 0x7f32b0070c40 2024-04-24T23:07:59.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f32b0158d60 con 0x7f32b014f190 2024-04-24T23:07:59.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32af7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b0148ba0 0x7f32b0140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:59.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32af7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b0148ba0 0x7f32b0140530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50722/0 (socket says 172.21.15.43:50722) 2024-04-24T23:07:59.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32af7fe640 1 -- 172.21.15.43:0/1160509294 learned_addr learned my addr 172.21.15.43:0/1160509294 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:59.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32af7fe640 1 -- 172.21.15.43:0/1160509294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b014f190 msgr2=0x7f32b01370f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32af7fe640 1 --2- 172.21.15.43:0/1160509294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b014f190 0x7f32b01370f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32af7fe640 1 -- 172.21.15.43:0/1160509294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b0070c40 msgr2=0x7f32b01e4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32af7fe640 1 --2- 172.21.15.43:0/1160509294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b0070c40 0x7f32b01e4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32af7fe640 1 -- 172.21.15.43:0/1160509294 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b01e4450 con 0x7f32b0148ba0 2024-04-24T23:07:59.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32af7fe640 1 --2- 172.21.15.43:0/1160509294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b0148ba0 0x7f32b0140530 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f32a40ae040 tx=0x7f32a401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:59.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32acff9640 1 -- 172.21.15.43:0/1160509294 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a40ba020 con 0x7f32b0148ba0 2024-04-24T23:07:59.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32acff9640 1 -- 172.21.15.43:0/1160509294 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a40b6640 con 0x7f32b0148ba0 2024-04-24T23:07:59.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 -- 172.21.15.43:0/1160509294 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b0141080 con 0x7f32b0148ba0 2024-04-24T23:07:59.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32acff9640 1 -- 172.21.15.43:0/1160509294 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a40b0040 con 0x7f32b0148ba0 2024-04-24T23:07:59.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.410+0000 7f32b6333640 1 -- 172.21.15.43:0/1160509294 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b014cae0 con 0x7f32b0148ba0 2024-04-24T23:07:59.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.414+0000 7f32b6333640 1 -- 172.21.15.43:0/1160509294 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b01e4240 con 0x7f32b0148ba0 2024-04-24T23:07:59.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.414+0000 7f32acff9640 1 -- 172.21.15.43:0/1160509294 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32a40bd020 con 0x7f32b0148ba0 2024-04-24T23:07:59.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.414+0000 7f32acff9640 1 --2- 172.21.15.43:0/1160509294 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f329c0678c0 0x7f329c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.414+0000 7f32acff9640 1 -- 172.21.15.43:0/1160509294 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f32a4120330 con 0x7f32b0148ba0 2024-04-24T23:07:59.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.414+0000 7f32affff640 1 --2- 172.21.15.43:0/1160509294 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f329c0678c0 0x7f329c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:59.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.414+0000 7f32affff640 1 --2- 172.21.15.43:0/1160509294 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f329c0678c0 0x7f329c069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f32a0007fd0 tx=0x7f32a00079a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:59.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.422+0000 7f32acff9640 1 -- 172.21.15.43:0/1160509294 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f32a40c4030 con 0x7f32b0148ba0 2024-04-24T23:07:59.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.578+0000 7f32b6333640 1 -- 172.21.15.43:0/1160509294 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f32b004f580 con 0x7f32b0148ba0 2024-04-24T23:07:59.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.578+0000 7f32acff9640 1 -- 172.21.15.43:0/1160509294 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f32a4016110 con 0x7f32b0148ba0 2024-04-24T23:07:59.580 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-24T23:07:59.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.582+0000 7f32b6333640 1 -- 172.21.15.43:0/1160509294 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f329c0678c0 msgr2=0x7f329c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.582+0000 7f32b6333640 1 --2- 172.21.15.43:0/1160509294 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f329c0678c0 0x7f329c069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f32a0007fd0 tx=0x7f32a00079a0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.582+0000 7f32b6333640 1 -- 172.21.15.43:0/1160509294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b0148ba0 msgr2=0x7f32b0140530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.582+0000 7f32b6333640 1 --2- 172.21.15.43:0/1160509294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b0148ba0 0x7f32b0140530 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f32a40ae040 tx=0x7f32a401acd0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.582+0000 7f32b6333640 1 -- 172.21.15.43:0/1160509294 shutdown_connections 2024-04-24T23:07:59.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.582+0000 7f32b6333640 1 --2- 172.21.15.43:0/1160509294 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f329c0678c0 0x7f329c069d80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.582+0000 7f32b6333640 1 --2- 172.21.15.43:0/1160509294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32b014f190 0x7f32b01370f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.582+0000 7f32b6333640 1 --2- 172.21.15.43:0/1160509294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b0148ba0 0x7f32b0140530 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.582+0000 7f32b6333640 1 --2- 172.21.15.43:0/1160509294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32b0070c40 0x7f32b01e4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.582+0000 7f32b6333640 1 -- 172.21.15.43:0/1160509294 >> 172.21.15.43:0/1160509294 conn(0x7f32b006c300 msgr2=0x7f32b0072b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:59.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.582+0000 7f32b6333640 1 -- 172.21.15.43:0/1160509294 shutdown_connections 2024-04-24T23:07:59.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.582+0000 7f32b6333640 1 -- 172.21.15.43:0/1160509294 wait complete. 2024-04-24T23:07:59.598 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:07:59.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.710+0000 7fe1c08eb640 1 Processor -- start 2024-04-24T23:07:59.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.710+0000 7fe1c08eb640 1 -- start start 2024-04-24T23:07:59.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.714+0000 7fe1c08eb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1bc070ea0 0x7fe1bc13e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.714+0000 7fe1c08eb640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe1bc13e7b0 0x7fe1bc14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.714+0000 7fe1c08eb640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1bc0b6de0 con 0x7fe1bc0b6a00 2024-04-24T23:07:59.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.714+0000 7fe1c08eb640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe1bc0721c0 con 0x7fe1bc13e7b0 2024-04-24T23:07:59.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.714+0000 7fe1c08eb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1bc0716e0 con 0x7fe1bc070ea0 2024-04-24T23:07:59.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.714+0000 7fe1bad9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe1bc13e7b0 0x7fe1bc14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:59.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.714+0000 7fe1b9d9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1bc070ea0 0x7fe1bc13e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:59.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.714+0000 7fe1ba59c640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe1bc0b6a00 0x7fe1bc147940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.43:34766/0 (socket says 172.21.15.43:34766) 2024-04-24T23:07:59.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.714+0000 7fe1ba59c640 1 -- 172.21.15.43:0/2269557634 learned_addr learned my addr 172.21.15.43:0/2269557634 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:07:59.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.714+0000 7fe1bad9d640 1 -- 172.21.15.43:0/2269557634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1bc070ea0 msgr2=0x7fe1bc13e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:07:59.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.714+0000 7fe1bad9d640 1 --2- 172.21.15.43:0/2269557634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1bc070ea0 0x7fe1bc13e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.714+0000 7fe1bad9d640 1 -- 172.21.15.43:0/2269557634 >> v1:172.21.15.162:6789/0 conn(0x7fe1bc0b6a00 legacy=0x7fe1bc147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.714+0000 7fe1bad9d640 1 -- 172.21.15.43:0/2269557634 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1bc0719c0 con 0x7fe1bc13e7b0 2024-04-24T23:07:59.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.714+0000 7fe1b9d9b640 1 --2- 172.21.15.43:0/2269557634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1bc070ea0 0x7fe1bc13e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:07:59.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1bad9d640 1 --2- 172.21.15.43:0/2269557634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1bc13e7b0 0x7fe1bc14ec70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009d90 tx=0x7fe1b401c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37d8278a40b80a1e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:59.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1b959a640 1 -- 172.21.15.43:0/2269557634 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b40b2070 con 0x7fe1bc13e7b0 2024-04-24T23:07:59.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1b959a640 1 -- 172.21.15.43:0/2269557634 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b40a5900 con 0x7fe1bc13e7b0 2024-04-24T23:07:59.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1b959a640 1 -- 172.21.15.43:0/2269557634 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b40a5cd0 con 0x7fe1bc13e7b0 2024-04-24T23:07:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 -- 172.21.15.43:0/2269557634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1bc13e7b0 msgr2=0x7fe1bc14ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 --2- 172.21.15.43:0/2269557634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1bc13e7b0 0x7fe1bc14ec70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009d90 tx=0x7fe1b401c820 comp rx=0 tx=0).stop 2024-04-24T23:07:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 -- 172.21.15.43:0/2269557634 shutdown_connections 2024-04-24T23:07:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 --2- 172.21.15.43:0/2269557634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1bc070ea0 0x7fe1bc13e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 --2- 172.21.15.43:0/2269557634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1bc13e7b0 0x7fe1bc14ec70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 -- 172.21.15.43:0/2269557634 >> 172.21.15.43:0/2269557634 conn(0x7fe1bc06c300 msgr2=0x7fe1bc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:59.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 -- 172.21.15.43:0/2269557634 shutdown_connections 2024-04-24T23:07:59.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 -- 172.21.15.43:0/2269557634 wait complete. 2024-04-24T23:07:59.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 Processor -- start 2024-04-24T23:07:59.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 -- start start 2024-04-24T23:07:59.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1bc070ea0 0x7fe1bc146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1bc0b6a00 0x7fe1bc1e34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1bc13e7b0 0x7fe1bc1e39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc0b0da0 con 0x7fe1bc070ea0 2024-04-24T23:07:59.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc0b0c20 con 0x7fe1bc13e7b0 2024-04-24T23:07:59.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1c08eb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1bc1519d0 con 0x7fe1bc0b6a00 2024-04-24T23:07:59.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1ba59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1bc070ea0 0x7fe1bc146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:59.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1ba59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1bc070ea0 0x7fe1bc146590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50734/0 (socket says 172.21.15.43:50734) 2024-04-24T23:07:59.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.718+0000 7fe1ba59c640 1 -- 172.21.15.43:0/3651350971 learned_addr learned my addr 172.21.15.43:0/3651350971 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:07:59.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1b9d9b640 1 --2- 172.21.15.43:0/3651350971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1bc0b6a00 0x7fe1bc1e34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:59.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1bad9d640 1 --2- 172.21.15.43:0/3651350971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1bc13e7b0 0x7fe1bc1e39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:59.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1ba59c640 1 -- 172.21.15.43:0/3651350971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1bc0b6a00 msgr2=0x7fe1bc1e34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1ba59c640 1 --2- 172.21.15.43:0/3651350971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1bc0b6a00 0x7fe1bc1e34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1ba59c640 1 -- 172.21.15.43:0/3651350971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1bc13e7b0 msgr2=0x7fe1bc1e39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1ba59c640 1 --2- 172.21.15.43:0/3651350971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1bc13e7b0 0x7fe1bc1e39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1ba59c640 1 -- 172.21.15.43:0/3651350971 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1bc146ad0 con 0x7fe1bc070ea0 2024-04-24T23:07:59.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1b9d9b640 1 --2- 172.21.15.43:0/3651350971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1bc0b6a00 0x7fe1bc1e34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:07:59.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1ba59c640 1 --2- 172.21.15.43:0/3651350971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1bc070ea0 0x7fe1bc146590 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400c400 tx=0x7fe1a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:59.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1b2ffd640 1 -- 172.21.15.43:0/3651350971 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4017070 con 0x7fe1bc070ea0 2024-04-24T23:07:59.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1b2ffd640 1 -- 172.21.15.43:0/3651350971 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a4005cf0 con 0x7fe1bc070ea0 2024-04-24T23:07:59.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1c08eb640 1 -- 172.21.15.43:0/3651350971 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1bc145fe0 con 0x7fe1bc070ea0 2024-04-24T23:07:59.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1b2ffd640 1 -- 172.21.15.43:0/3651350971 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40072d0 con 0x7fe1bc070ea0 2024-04-24T23:07:59.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1c08eb640 1 -- 172.21.15.43:0/3651350971 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1bc146d50 con 0x7fe1bc070ea0 2024-04-24T23:07:59.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1c08eb640 1 -- 172.21.15.43:0/3651350971 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1bc04f580 con 0x7fe1bc070ea0 2024-04-24T23:07:59.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1b2ffd640 1 -- 172.21.15.43:0/3651350971 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe1a401a070 con 0x7fe1bc070ea0 2024-04-24T23:07:59.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1b2ffd640 1 --2- 172.21.15.43:0/3651350971 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe19c0678c0 0x7fe19c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:07:59.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1b2ffd640 1 -- 172.21.15.43:0/3651350971 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fe1a4085220 con 0x7fe1bc070ea0 2024-04-24T23:07:59.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1b9d9b640 1 --2- 172.21.15.43:0/3651350971 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe19c0678c0 0x7fe19c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:07:59.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.722+0000 7fe1b9d9b640 1 --2- 172.21.15.43:0/3651350971 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe19c0678c0 0x7fe19c069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc13b440 tx=0x7fe1ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:07:59.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.730+0000 7fe1b2ffd640 1 -- 172.21.15.43:0/3651350971 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe1bc146ad0 con 0x7fe1bc070ea0 2024-04-24T23:07:59.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.886+0000 7fe1c08eb640 1 -- 172.21.15.43:0/3651350971 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe1bc0b87d0 con 0x7fe1bc070ea0 2024-04-24T23:07:59.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.886+0000 7fe1b2ffd640 1 -- 172.21.15.43:0/3651350971 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fe1a40553d0 con 0x7fe1bc070ea0 2024-04-24T23:07:59.890 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-24T23:07:59.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.886+0000 7fe1c08eb640 1 -- 172.21.15.43:0/3651350971 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe19c0678c0 msgr2=0x7fe19c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.886+0000 7fe1c08eb640 1 --2- 172.21.15.43:0/3651350971 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe19c0678c0 0x7fe19c069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc13b440 tx=0x7fe1ac008040 comp rx=0 tx=0).stop 2024-04-24T23:07:59.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.886+0000 7fe1c08eb640 1 -- 172.21.15.43:0/3651350971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1bc070ea0 msgr2=0x7fe1bc146590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:07:59.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.886+0000 7fe1c08eb640 1 --2- 172.21.15.43:0/3651350971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1bc070ea0 0x7fe1bc146590 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400c400 tx=0x7fe1a400c8c0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.890+0000 7fe1c08eb640 1 -- 172.21.15.43:0/3651350971 shutdown_connections 2024-04-24T23:07:59.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.890+0000 7fe1c08eb640 1 --2- 172.21.15.43:0/3651350971 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe19c0678c0 0x7fe19c069d80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.890+0000 7fe1c08eb640 1 --2- 172.21.15.43:0/3651350971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1bc13e7b0 0x7fe1bc1e39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.890+0000 7fe1c08eb640 1 --2- 172.21.15.43:0/3651350971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1bc0b6a00 0x7fe1bc1e34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.890+0000 7fe1c08eb640 1 --2- 172.21.15.43:0/3651350971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1bc070ea0 0x7fe1bc146590 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:07:59.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.890+0000 7fe1c08eb640 1 -- 172.21.15.43:0/3651350971 >> 172.21.15.43:0/3651350971 conn(0x7fe1bc06c300 msgr2=0x7fe1bc0ba360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:07:59.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.890+0000 7fe1c08eb640 1 -- 172.21.15.43:0/3651350971 shutdown_connections 2024-04-24T23:07:59.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:07:59.890+0000 7fe1c08eb640 1 -- 172.21.15.43:0/3651350971 wait complete. 2024-04-24T23:07:59.906 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:08:00.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.014+0000 7fc3c333e640 1 Processor -- start 2024-04-24T23:08:00.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.014+0000 7fc3c333e640 1 -- start start 2024-04-24T23:08:00.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.014+0000 7fc3c333e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc3bc09ee70 0x7fc3bc09f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.014+0000 7fc3c333e640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3bc0731e0 con 0x7fc3bc072e00 2024-04-24T23:08:00.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.014+0000 7fc3c333e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3bc147850 con 0x7fc3bc09fc50 2024-04-24T23:08:00.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.014+0000 7fc3c333e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc3bc14bb00 con 0x7fc3bc09ee70 2024-04-24T23:08:00.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.014+0000 7fc3c10da640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc3bc072e00 0x7fc3bc148050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33098/0 (socket says 172.21.15.43:33098) 2024-04-24T23:08:00.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.014+0000 7fc3c10da640 1 -- 172.21.15.43:0/654542051 learned_addr learned my addr 172.21.15.43:0/654542051 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:00.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3c08d9640 1 --2- 172.21.15.43:0/654542051 >> v2:172.21.15.162:3300/0 conn(0x7fc3bc09ee70 0x7fc3bc09f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3b3fff640 1 -- 172.21.15.43:0/654542051 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3608451333 0 0) 0x7fc3bc0731e0 con 0x7fc3bc072e00 2024-04-24T23:08:00.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3b3fff640 1 -- 172.21.15.43:0/654542051 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3a8003530 con 0x7fc3bc072e00 2024-04-24T23:08:00.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3b3fff640 1 -- 172.21.15.43:0/654542051 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3542616041 0 0) 0x7fc3a8003530 con 0x7fc3bc072e00 2024-04-24T23:08:00.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3b3fff640 1 -- 172.21.15.43:0/654542051 >> v2:172.21.15.162:3300/0 conn(0x7fc3bc09ee70 msgr2=0x7fc3bc09f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:00.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3b3fff640 1 --2- 172.21.15.43:0/654542051 >> v2:172.21.15.162:3300/0 conn(0x7fc3bc09ee70 0x7fc3bc09f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3b3fff640 1 -- 172.21.15.43:0/654542051 >> v1:172.21.15.162:6789/0 conn(0x7fc3bc09fc50 legacy=0x7fc3bc14b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3b3fff640 1 -- 172.21.15.43:0/654542051 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc147b30 con 0x7fc3bc072e00 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3b3fff640 1 -- 172.21.15.43:0/654542051 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7fc3b8001680 con 0x7fc3bc072e00 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3b3fff640 1 -- 172.21.15.43:0/654542051 >> v1:172.21.15.43:6789/0 conn(0x7fc3bc072e00 legacy=0x7fc3bc148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3b3fff640 1 --2- 172.21.15.43:0/654542051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3a8003a10 0x7fc3a8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3b3fff640 1 --2- 172.21.15.43:0/654542051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a8004810 0x7fc3a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3b3fff640 1 --2- 172.21.15.43:0/654542051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3a8005220 0x7fc3a800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3b3fff640 1 -- 172.21.15.43:0/654542051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc14bb00 con 0x7fc3a8004810 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3b3fff640 1 -- 172.21.15.43:0/654542051 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a800c170 con 0x7fc3a8003a10 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3b3fff640 1 -- 172.21.15.43:0/654542051 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc3a800c370 con 0x7fc3a8005220 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3c08d9640 1 --2- 172.21.15.43:0/654542051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a8004810 0x7fc3a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3c10da640 1 --2- 172.21.15.43:0/654542051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3a8003a10 0x7fc3a8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3c18db640 1 --2- 172.21.15.43:0/654542051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3a8005220 0x7fc3a800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3c08d9640 1 -- 172.21.15.43:0/654542051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3a8005220 msgr2=0x7fc3a800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3c08d9640 1 --2- 172.21.15.43:0/654542051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3a8005220 0x7fc3a800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3c08d9640 1 -- 172.21.15.43:0/654542051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3a8003a10 msgr2=0x7fc3a8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:00.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3c08d9640 1 --2- 172.21.15.43:0/654542051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3a8003a10 0x7fc3a8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3c08d9640 1 -- 172.21.15.43:0/654542051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a8003530 con 0x7fc3a8004810 2024-04-24T23:08:00.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3c18db640 1 --2- 172.21.15.43:0/654542051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3a8005220 0x7fc3a800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:00.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.018+0000 7fc3c18db640 1 -- 172.21.15.43:0/654542051 reap_dead start 2024-04-24T23:08:00.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.026+0000 7fc3c08d9640 1 --2- 172.21.15.43:0/654542051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a8004810 0x7fc3a8004c90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc09f290 tx=0x7fc3ac01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35dd9819f718d3b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:00.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.026+0000 7fc3b3fff640 1 -- 172.21.15.43:0/654542051 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0096b0 con 0x7fc3a8004810 2024-04-24T23:08:00.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.026+0000 7fc3b3fff640 1 -- 172.21.15.43:0/654542051 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ac0a8450 con 0x7fc3a8004810 2024-04-24T23:08:00.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.026+0000 7fc3b3fff640 1 -- 172.21.15.43:0/654542051 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0a8840 con 0x7fc3a8004810 2024-04-24T23:08:00.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.026+0000 7fc3c333e640 1 -- 172.21.15.43:0/654542051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a8004810 msgr2=0x7fc3a8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.026+0000 7fc3c333e640 1 --2- 172.21.15.43:0/654542051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a8004810 0x7fc3a8004c90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc09f290 tx=0x7fc3ac01ca10 comp rx=0 tx=0).stop 2024-04-24T23:08:00.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.026+0000 7fc3c333e640 1 -- 172.21.15.43:0/654542051 shutdown_connections 2024-04-24T23:08:00.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.026+0000 7fc3c333e640 1 --2- 172.21.15.43:0/654542051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a8004810 0x7fc3a8004c90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.026+0000 7fc3c333e640 1 -- 172.21.15.43:0/654542051 >> 172.21.15.43:0/654542051 conn(0x7fc3bc0b7880 msgr2=0x7fc3bc0b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:00.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.026+0000 7fc3c333e640 1 -- 172.21.15.43:0/654542051 shutdown_connections 2024-04-24T23:08:00.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.026+0000 7fc3c333e640 1 -- 172.21.15.43:0/654542051 wait complete. 2024-04-24T23:08:00.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c333e640 1 Processor -- start 2024-04-24T23:08:00.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c333e640 1 -- start start 2024-04-24T23:08:00.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c333e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3bc1433d0 0x7fc3bc1e0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c333e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3bc143ef0 0x7fc3bc144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c333e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3bc0b44a0 0x7fc3bc0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c333e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc06f940 con 0x7fc3bc1433d0 2024-04-24T23:08:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c333e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc06f7c0 con 0x7fc3bc143ef0 2024-04-24T23:08:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c333e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc3bc06fac0 con 0x7fc3bc0b44a0 2024-04-24T23:08:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c10da640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3bc1433d0 0x7fc3bc1e0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c10da640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3bc1433d0 0x7fc3bc1e0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50764/0 (socket says 172.21.15.43:50764) 2024-04-24T23:08:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c10da640 1 -- 172.21.15.43:0/3822520140 learned_addr learned my addr 172.21.15.43:0/3822520140 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c18db640 1 --2- 172.21.15.43:0/3822520140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3bc0b44a0 0x7fc3bc0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c08d9640 1 --2- 172.21.15.43:0/3822520140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3bc143ef0 0x7fc3bc144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c10da640 1 -- 172.21.15.43:0/3822520140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3bc0b44a0 msgr2=0x7fc3bc0b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c10da640 1 --2- 172.21.15.43:0/3822520140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3bc0b44a0 0x7fc3bc0b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c10da640 1 -- 172.21.15.43:0/3822520140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3bc143ef0 msgr2=0x7fc3bc144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c10da640 1 --2- 172.21.15.43:0/3822520140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3bc143ef0 0x7fc3bc144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c10da640 1 -- 172.21.15.43:0/3822520140 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc144890 con 0x7fc3bc1433d0 2024-04-24T23:08:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c08d9640 1 --2- 172.21.15.43:0/3822520140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3bc143ef0 0x7fc3bc144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c10da640 1 --2- 172.21.15.43:0/3822520140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3bc1433d0 0x7fc3bc1e0ad0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800e740 tx=0x7fc3b800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3b1ffb640 1 -- 172.21.15.43:0/3822520140 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800ee50 con 0x7fc3bc1433d0 2024-04-24T23:08:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c333e640 1 -- 172.21.15.43:0/3822520140 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3bc1e1160 con 0x7fc3bc1433d0 2024-04-24T23:08:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3c333e640 1 -- 172.21.15.43:0/3822520140 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3bc142550 con 0x7fc3bc1433d0 2024-04-24T23:08:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3b1ffb640 1 -- 172.21.15.43:0/3822520140 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b8018070 con 0x7fc3bc1433d0 2024-04-24T23:08:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.030+0000 7fc3b1ffb640 1 -- 172.21.15.43:0/3822520140 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800cad0 con 0x7fc3bc1433d0 2024-04-24T23:08:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.034+0000 7fc3c333e640 1 -- 172.21.15.43:0/3822520140 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3bc04f580 con 0x7fc3bc1433d0 2024-04-24T23:08:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.034+0000 7fc3b1ffb640 1 -- 172.21.15.43:0/3822520140 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc3b800cc70 con 0x7fc3bc1433d0 2024-04-24T23:08:00.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.034+0000 7fc3b1ffb640 1 --2- 172.21.15.43:0/3822520140 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc3a00678f0 0x7fc3a0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.034+0000 7fc3b1ffb640 1 -- 172.21.15.43:0/3822520140 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fc3b8085cc0 con 0x7fc3bc1433d0 2024-04-24T23:08:00.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.034+0000 7fc3c08d9640 1 --2- 172.21.15.43:0/3822520140 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc3a00678f0 0x7fc3a0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.034+0000 7fc3c08d9640 1 --2- 172.21.15.43:0/3822520140 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc3a00678f0 0x7fc3a0069db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0af000 tx=0x7fc3ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:00.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.058+0000 7fc3b1ffb640 1 -- 172.21.15.43:0/3822520140 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc3b8022020 con 0x7fc3bc1433d0 2024-04-24T23:08:00.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.230+0000 7fc3c333e640 1 -- 172.21.15.43:0/3822520140 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc3bc0b5320 con 0x7fc3bc1433d0 2024-04-24T23:08:00.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.230+0000 7fc3b1ffb640 1 -- 172.21.15.43:0/3822520140 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fc3b8056420 con 0x7fc3bc1433d0 2024-04-24T23:08:00.232 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2024-04-24T23:08:00.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.230+0000 7fc3c333e640 1 -- 172.21.15.43:0/3822520140 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc3a00678f0 msgr2=0x7fc3a0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.230+0000 7fc3c333e640 1 --2- 172.21.15.43:0/3822520140 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc3a00678f0 0x7fc3a0069db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0af000 tx=0x7fc3ac008040 comp rx=0 tx=0).stop 2024-04-24T23:08:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.230+0000 7fc3c333e640 1 -- 172.21.15.43:0/3822520140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3bc1433d0 msgr2=0x7fc3bc1e0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.230+0000 7fc3c333e640 1 --2- 172.21.15.43:0/3822520140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3bc1433d0 0x7fc3bc1e0ad0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800e740 tx=0x7fc3b800ec00 comp rx=0 tx=0).stop 2024-04-24T23:08:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.230+0000 7fc3c333e640 1 -- 172.21.15.43:0/3822520140 shutdown_connections 2024-04-24T23:08:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.230+0000 7fc3c333e640 1 --2- 172.21.15.43:0/3822520140 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc3a00678f0 0x7fc3a0069db0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.230+0000 7fc3c333e640 1 --2- 172.21.15.43:0/3822520140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3bc0b44a0 0x7fc3bc0b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.230+0000 7fc3c333e640 1 --2- 172.21.15.43:0/3822520140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3bc143ef0 0x7fc3bc144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.230+0000 7fc3c333e640 1 --2- 172.21.15.43:0/3822520140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3bc1433d0 0x7fc3bc1e0ad0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.230+0000 7fc3c333e640 1 -- 172.21.15.43:0/3822520140 >> 172.21.15.43:0/3822520140 conn(0x7fc3bc0b7880 msgr2=0x7fc3bc0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.230+0000 7fc3c333e640 1 -- 172.21.15.43:0/3822520140 shutdown_connections 2024-04-24T23:08:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.230+0000 7fc3c333e640 1 -- 172.21.15.43:0/3822520140 wait complete. 2024-04-24T23:08:00.250 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-24T23:08:00.250 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-24T23:08:00.256 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:08:00.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7c1ad2640 1 Processor -- start 2024-04-24T23:08:00.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7c1ad2640 1 -- start start 2024-04-24T23:08:00.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7c1ad2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7bc061e90 0x7fe7bc149010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7c1ad2640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe7bc0b5b10 0x7fe7bc145e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7c1ad2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe7bc0b80e0 0x7fe7bc0b8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7c1ad2640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fe7bc0b7c50 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7c1ad2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe7bc1455e0 con 0x7fe7bc0b80e0 2024-04-24T23:08:00.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7c1ad2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe7bc149850 con 0x7fe7bc061e90 2024-04-24T23:08:00.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7baffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe7bc0b5b10 0x7fe7bc145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7baffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe7bc0b5b10 0x7fe7bc145e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54588/0 (socket says 172.21.15.43:54588) 2024-04-24T23:08:00.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7baffd640 1 -- 172.21.15.43:0/2809848059 learned_addr learned my addr 172.21.15.43:0/2809848059 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:00.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7baffd640 1 -- 172.21.15.43:0/2809848059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7bc061e90 msgr2=0x7fe7bc149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:00.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7bb7fe640 1 --2- 172.21.15.43:0/2809848059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7bc061e90 0x7fe7bc149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7bbfff640 1 --2- 172.21.15.43:0/2809848059 >> v2:172.21.15.162:3300/0 conn(0x7fe7bc0b80e0 0x7fe7bc0b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7baffd640 1 --2- 172.21.15.43:0/2809848059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7bc061e90 0x7fe7bc149010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7baffd640 1 -- 172.21.15.43:0/2809848059 >> v2:172.21.15.162:3300/0 conn(0x7fe7bc0b80e0 msgr2=0x7fe7bc0b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:00.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7baffd640 1 --2- 172.21.15.43:0/2809848059 >> v2:172.21.15.162:3300/0 conn(0x7fe7bc0b80e0 0x7fe7bc0b8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7baffd640 1 -- 172.21.15.43:0/2809848059 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7bc062270 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.410+0000 7fe7baffd640 1 --2- 172.21.15.43:0/2809848059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7bc0b5b10 0x7fe7bc145e40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc143210 tx=0x7fe7ac01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e029ac2020ccc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:00.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7ba7fc640 1 -- 172.21.15.43:0/2809848059 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0b0070 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7ba7fc640 1 -- 172.21.15.43:0/2809848059 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ac0a4e50 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7ba7fc640 1 -- 172.21.15.43:0/2809848059 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0ab820 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 -- 172.21.15.43:0/2809848059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7bc0b5b10 msgr2=0x7fe7bc145e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 --2- 172.21.15.43:0/2809848059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7bc0b5b10 0x7fe7bc145e40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc143210 tx=0x7fe7ac01c400 comp rx=0 tx=0).stop 2024-04-24T23:08:00.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 -- 172.21.15.43:0/2809848059 shutdown_connections 2024-04-24T23:08:00.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 --2- 172.21.15.43:0/2809848059 >> v2:172.21.15.162:3300/0 conn(0x7fe7bc0b80e0 0x7fe7bc0b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 --2- 172.21.15.43:0/2809848059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7bc0b5b10 0x7fe7bc145e40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 --2- 172.21.15.43:0/2809848059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7bc061e90 0x7fe7bc149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 -- 172.21.15.43:0/2809848059 >> 172.21.15.43:0/2809848059 conn(0x7fe7bc09b250 msgr2=0x7fe7bc09b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:00.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 -- 172.21.15.43:0/2809848059 shutdown_connections 2024-04-24T23:08:00.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 -- 172.21.15.43:0/2809848059 wait complete. 2024-04-24T23:08:00.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 Processor -- start 2024-04-24T23:08:00.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 -- start start 2024-04-24T23:08:00.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7bc061e90 0x7fe7bc1e0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7bc0b5b10 0x7fe7bc0aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7bc0b80e0 0x7fe7bc0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe7bc0b5530 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe7bc0b53b0 con 0x7fe7bc061e90 2024-04-24T23:08:00.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe7bc0b56b0 con 0x7fe7bc0b80e0 2024-04-24T23:08:00.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7baffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7bc0b5b10 0x7fe7bc0aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7baffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7bc0b5b10 0x7fe7bc0aed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54596/0 (socket says 172.21.15.43:54596) 2024-04-24T23:08:00.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7baffd640 1 -- 172.21.15.43:0/1880855070 learned_addr learned my addr 172.21.15.43:0/1880855070 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:00.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7bbfff640 1 --2- 172.21.15.43:0/1880855070 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7bc0b80e0 0x7fe7bc0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7bb7fe640 1 --2- 172.21.15.43:0/1880855070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7bc061e90 0x7fe7bc1e0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7baffd640 1 -- 172.21.15.43:0/1880855070 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7bc0b80e0 msgr2=0x7fe7bc0ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7baffd640 1 --2- 172.21.15.43:0/1880855070 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7bc0b80e0 0x7fe7bc0ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7baffd640 1 -- 172.21.15.43:0/1880855070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7bc061e90 msgr2=0x7fe7bc1e0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7baffd640 1 --2- 172.21.15.43:0/1880855070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7bc061e90 0x7fe7bc1e0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7baffd640 1 -- 172.21.15.43:0/1880855070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7bc1dfdb0 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7bbfff640 1 --2- 172.21.15.43:0/1880855070 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7bc0b80e0 0x7fe7bc0ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:00.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7baffd640 1 --2- 172.21.15.43:0/1880855070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7bc0b5b10 0x7fe7bc0aed40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac01cca0 tx=0x7fe7ac0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:00.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7b3fff640 1 -- 172.21.15.43:0/1880855070 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0b0040 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7b3fff640 1 -- 172.21.15.43:0/1880855070 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ac005ba0 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 -- 172.21.15.43:0/1880855070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7bc1e0090 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7b3fff640 1 -- 172.21.15.43:0/1880855070 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0037c0 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.414+0000 7fe7c1ad2640 1 -- 172.21.15.43:0/1880855070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7bc070e30 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.418+0000 7fe7c1ad2640 1 -- 172.21.15.43:0/1880855070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7bc071160 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.418+0000 7fe7b3fff640 1 -- 172.21.15.43:0/1880855070 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe7ac0bb060 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.418+0000 7fe7b3fff640 1 --2- 172.21.15.43:0/1880855070 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe79c0678c0 0x7fe79c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.418+0000 7fe7bb7fe640 1 --2- 172.21.15.43:0/1880855070 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe79c0678c0 0x7fe79c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.418+0000 7fe7b3fff640 1 -- 172.21.15.43:0/1880855070 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fe7ac11f0c0 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.418+0000 7fe7bb7fe640 1 --2- 172.21.15.43:0/1880855070 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe79c0678c0 0x7fe79c069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400b740 tx=0x7fe7a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:00.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.422+0000 7fe7b3fff640 1 -- 172.21.15.43:0/1880855070 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe7ac016110 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.582+0000 7fe7c1ad2640 1 -- 172.21.15.43:0/1880855070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7bc04f580 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.586+0000 7fe7b3fff640 1 -- 172.21.15.43:0/1880855070 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18754 (secure 0 0 0) 0x7fe7ac0ef8c0 con 0x7fe7bc0b5b10 2024-04-24T23:08:00.588 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:08:00.588 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:57.637496+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":5}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.1a","mappings":[{"from":7,"to":4}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:08:00.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.586+0000 7fe7c1ad2640 1 -- 172.21.15.43:0/1880855070 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe79c0678c0 msgr2=0x7fe79c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.586+0000 7fe7c1ad2640 1 --2- 172.21.15.43:0/1880855070 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe79c0678c0 0x7fe79c069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400b740 tx=0x7fe7a4008040 comp rx=0 tx=0).stop 2024-04-24T23:08:00.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.586+0000 7fe7c1ad2640 1 -- 172.21.15.43:0/1880855070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7bc0b5b10 msgr2=0x7fe7bc0aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.586+0000 7fe7c1ad2640 1 --2- 172.21.15.43:0/1880855070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7bc0b5b10 0x7fe7bc0aed40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac01cca0 tx=0x7fe7ac0191a0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.586+0000 7fe7c1ad2640 1 -- 172.21.15.43:0/1880855070 shutdown_connections 2024-04-24T23:08:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.586+0000 7fe7c1ad2640 1 --2- 172.21.15.43:0/1880855070 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe79c0678c0 0x7fe79c069d80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.586+0000 7fe7c1ad2640 1 --2- 172.21.15.43:0/1880855070 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7bc0b80e0 0x7fe7bc0ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.586+0000 7fe7c1ad2640 1 --2- 172.21.15.43:0/1880855070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7bc0b5b10 0x7fe7bc0aed40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.586+0000 7fe7c1ad2640 1 --2- 172.21.15.43:0/1880855070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7bc061e90 0x7fe7bc1e0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.586+0000 7fe7c1ad2640 1 -- 172.21.15.43:0/1880855070 >> 172.21.15.43:0/1880855070 conn(0x7fe7bc09b250 msgr2=0x7fe7bc146590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.586+0000 7fe7c1ad2640 1 -- 172.21.15.43:0/1880855070 shutdown_connections 2024-04-24T23:08:00.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.586+0000 7fe7c1ad2640 1 -- 172.21.15.43:0/1880855070 wait complete. 2024-04-24T23:08:00.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T23:00:02.322280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-24T23:00:14.136303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-24T23:00:14.764010+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-24T23:00:18.504756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-24T23:08:00.606 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-24T23:08:00.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.718+0000 7f8a8582b640 1 Processor -- start 2024-04-24T23:08:00.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.718+0000 7f8a8582b640 1 -- start start 2024-04-24T23:08:00.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a8582b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8a8006cb30 0x7f8a800b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a8582b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8a80157940 0x7f8a80157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a8582b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a801582e0 0x7f8a801568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a8582b640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f8a800b3080 con 0x7f8a80157940 2024-04-24T23:08:00.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a8582b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8a800b3a30 con 0x7f8a8006cb30 2024-04-24T23:08:00.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a8582b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a800b25a0 con 0x7f8a801582e0 2024-04-24T23:08:00.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a7e7fc640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8a80157940 0x7f8a80157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a7e7fc640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8a80157940 0x7f8a80157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54610/0 (socket says 172.21.15.43:54610) 2024-04-24T23:08:00.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a7effd640 1 --2- 172.21.15.43:0/487339741 >> v2:172.21.15.162:3300/0 conn(0x7f8a8006cb30 0x7f8a800b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a7f7fe640 1 --2- 172.21.15.43:0/487339741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a801582e0 0x7f8a801568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a7e7fc640 1 -- 172.21.15.43:0/487339741 learned_addr learned my addr 172.21.15.43:0/487339741 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:00.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a7e7fc640 1 -- 172.21.15.43:0/487339741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a801582e0 msgr2=0x7f8a801568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:00.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a7e7fc640 1 --2- 172.21.15.43:0/487339741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a801582e0 0x7f8a801568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a7e7fc640 1 -- 172.21.15.43:0/487339741 >> v2:172.21.15.162:3300/0 conn(0x7f8a8006cb30 msgr2=0x7f8a800b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:00.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a7e7fc640 1 --2- 172.21.15.43:0/487339741 >> v2:172.21.15.162:3300/0 conn(0x7f8a8006cb30 0x7f8a800b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.722+0000 7f8a7e7fc640 1 -- 172.21.15.43:0/487339741 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a80158770 con 0x7f8a80157940 2024-04-24T23:08:00.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a7e7fc640 1 --2- 172.21.15.43:0/487339741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a80157940 0x7f8a80157da0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8a8006d240 tx=0x7f8a7401c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf97420e689ca18 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:00.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a7dffb640 1 -- 172.21.15.43:0/487339741 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a740b0070 con 0x7f8a80157940 2024-04-24T23:08:00.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a7dffb640 1 -- 172.21.15.43:0/487339741 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a740ab600 con 0x7f8a80157940 2024-04-24T23:08:00.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a7dffb640 1 -- 172.21.15.43:0/487339741 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a740ab9d0 con 0x7f8a80157940 2024-04-24T23:08:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 -- 172.21.15.43:0/487339741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a80157940 msgr2=0x7f8a80157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 --2- 172.21.15.43:0/487339741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a80157940 0x7f8a80157da0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8a8006d240 tx=0x7f8a7401c1d0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 -- 172.21.15.43:0/487339741 shutdown_connections 2024-04-24T23:08:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 --2- 172.21.15.43:0/487339741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a801582e0 0x7f8a801568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 --2- 172.21.15.43:0/487339741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a80157940 0x7f8a80157da0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 --2- 172.21.15.43:0/487339741 >> v2:172.21.15.162:3300/0 conn(0x7f8a8006cb30 0x7f8a800b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 -- 172.21.15.43:0/487339741 >> 172.21.15.43:0/487339741 conn(0x7f8a800b8d60 msgr2=0x7f8a800b9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 -- 172.21.15.43:0/487339741 shutdown_connections 2024-04-24T23:08:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 -- 172.21.15.43:0/487339741 wait complete. 2024-04-24T23:08:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 Processor -- start 2024-04-24T23:08:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 -- start start 2024-04-24T23:08:00.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a8006cb30 0x7f8a80152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a80157940 0x7f8a801ec8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a801582e0 0x7f8a801ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8a800b2d10 con 0x7f8a80157940 2024-04-24T23:08:00.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a800b36c0 con 0x7f8a8006cb30 2024-04-24T23:08:00.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a8582b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a800b2220 con 0x7f8a801582e0 2024-04-24T23:08:00.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a7e7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a80157940 0x7f8a801ec8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a7e7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a80157940 0x7f8a801ec8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54624/0 (socket says 172.21.15.43:54624) 2024-04-24T23:08:00.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a7e7fc640 1 -- 172.21.15.43:0/3233119109 learned_addr learned my addr 172.21.15.43:0/3233119109 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:00.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a7e7fc640 1 -- 172.21.15.43:0/3233119109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a801582e0 msgr2=0x7f8a801ecde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a7e7fc640 1 --2- 172.21.15.43:0/3233119109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a801582e0 0x7f8a801ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a7e7fc640 1 -- 172.21.15.43:0/3233119109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a8006cb30 msgr2=0x7f8a80152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a7e7fc640 1 --2- 172.21.15.43:0/3233119109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a8006cb30 0x7f8a80152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.726+0000 7f8a7e7fc640 1 -- 172.21.15.43:0/3233119109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8015c500 con 0x7f8a80157940 2024-04-24T23:08:00.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.730+0000 7f8a7e7fc640 1 --2- 172.21.15.43:0/3233119109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a80157940 0x7f8a801ec8a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8a7401a880 tx=0x7f8a74018f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:00.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.730+0000 7f8a67fff640 1 -- 172.21.15.43:0/3233119109 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a740b0040 con 0x7f8a80157940 2024-04-24T23:08:00.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.730+0000 7f8a67fff640 1 -- 172.21.15.43:0/3233119109 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a740b9070 con 0x7f8a80157940 2024-04-24T23:08:00.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.730+0000 7f8a8582b640 1 -- 172.21.15.43:0/3233119109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8015b420 con 0x7f8a80157940 2024-04-24T23:08:00.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.730+0000 7f8a67fff640 1 -- 172.21.15.43:0/3233119109 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a740b4660 con 0x7f8a80157940 2024-04-24T23:08:00.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.730+0000 7f8a8582b640 1 -- 172.21.15.43:0/3233119109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a8015b130 con 0x7f8a80157940 2024-04-24T23:08:00.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.730+0000 7f8a8582b640 1 -- 172.21.15.43:0/3233119109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a8004f580 con 0x7f8a80157940 2024-04-24T23:08:00.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.730+0000 7f8a67fff640 1 -- 172.21.15.43:0/3233119109 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a740b4800 con 0x7f8a80157940 2024-04-24T23:08:00.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.730+0000 7f8a67fff640 1 --2- 172.21.15.43:0/3233119109 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8a6c0678c0 0x7f8a6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:00.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.730+0000 7f8a67fff640 1 -- 172.21.15.43:0/3233119109 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f8a7411fe70 con 0x7f8a80157940 2024-04-24T23:08:00.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.730+0000 7f8a7effd640 1 --2- 172.21.15.43:0/3233119109 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8a6c0678c0 0x7f8a6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:00.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.730+0000 7f8a7effd640 1 --2- 172.21.15.43:0/3233119109 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8a6c0678c0 0x7f8a6c069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a70006140 tx=0x7f8a7000b420 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:00.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.734+0000 7f8a67fff640 1 -- 172.21.15.43:0/3233119109 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8a80158770 con 0x7f8a80157940 2024-04-24T23:08:00.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.890+0000 7f8a8582b640 1 -- 172.21.15.43:0/3233119109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8a80068760 con 0x7f8a80157940 2024-04-24T23:08:00.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.890+0000 7f8a67fff640 1 -- 172.21.15.43:0/3233119109 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f8a740a4e20 con 0x7f8a80157940 2024-04-24T23:08:00.893 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-24T23:08:00.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.894+0000 7f8a8582b640 1 -- 172.21.15.43:0/3233119109 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8a6c0678c0 msgr2=0x7f8a6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.894+0000 7f8a8582b640 1 --2- 172.21.15.43:0/3233119109 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8a6c0678c0 0x7f8a6c069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a70006140 tx=0x7f8a7000b420 comp rx=0 tx=0).stop 2024-04-24T23:08:00.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.894+0000 7f8a8582b640 1 -- 172.21.15.43:0/3233119109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a80157940 msgr2=0x7f8a801ec8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:00.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.894+0000 7f8a8582b640 1 --2- 172.21.15.43:0/3233119109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a80157940 0x7f8a801ec8a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8a7401a880 tx=0x7f8a74018f70 comp rx=0 tx=0).stop 2024-04-24T23:08:00.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.894+0000 7f8a8582b640 1 -- 172.21.15.43:0/3233119109 shutdown_connections 2024-04-24T23:08:00.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.894+0000 7f8a8582b640 1 --2- 172.21.15.43:0/3233119109 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8a6c0678c0 0x7f8a6c069d80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.894+0000 7f8a8582b640 1 --2- 172.21.15.43:0/3233119109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a801582e0 0x7f8a801ecde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.894+0000 7f8a8582b640 1 --2- 172.21.15.43:0/3233119109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a80157940 0x7f8a801ec8a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.894+0000 7f8a8582b640 1 --2- 172.21.15.43:0/3233119109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a8006cb30 0x7f8a80152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:00.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.894+0000 7f8a8582b640 1 -- 172.21.15.43:0/3233119109 >> 172.21.15.43:0/3233119109 conn(0x7f8a800b8d60 msgr2=0x7f8a800b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:00.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.894+0000 7f8a8582b640 1 -- 172.21.15.43:0/3233119109 shutdown_connections 2024-04-24T23:08:00.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:00.894+0000 7f8a8582b640 1 -- 172.21.15.43:0/3233119109 wait complete. 2024-04-24T23:08:00.912 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-24T23:08:01.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.018+0000 7f27d4496640 1 Processor -- start 2024-04-24T23:08:01.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d4496640 1 -- start start 2024-04-24T23:08:01.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d4496640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27cc0b6bc0 0x7f27cc0b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d4496640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f27cc1489a0 0x7f27cc13f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d4496640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27cc0b6110 con 0x7f27cc148e00 2024-04-24T23:08:01.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d4496640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f27cc0b5ec0 con 0x7f27cc1489a0 2024-04-24T23:08:01.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d4496640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27cc0b7890 con 0x7f27cc0b6bc0 2024-04-24T23:08:01.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d2a33640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f27cc148e00 0x7f27cc145410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33816/0 (socket says 172.21.15.43:33816) 2024-04-24T23:08:01.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d2a33640 1 -- 172.21.15.43:0/4198111455 learned_addr learned my addr 172.21.15.43:0/4198111455 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:01.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d2232640 1 --2- 172.21.15.43:0/4198111455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27cc0b6bc0 0x7f27cc0b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1a31640 1 --2- 172.21.15.43:0/4198111455 >> v2:172.21.15.162:3300/0 conn(0x7f27cc1489a0 0x7f27cc13f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 -- 172.21.15.43:0/4198111455 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1793960442 0 0) 0x7f27cc0b6110 con 0x7f27cc148e00 2024-04-24T23:08:01.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 -- 172.21.15.43:0/4198111455 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27b8003530 con 0x7f27cc148e00 2024-04-24T23:08:01.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 -- 172.21.15.43:0/4198111455 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3196112220 0 0) 0x7f27b8003530 con 0x7f27cc148e00 2024-04-24T23:08:01.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 -- 172.21.15.43:0/4198111455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27cc0b6bc0 msgr2=0x7f27cc0b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:01.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 --2- 172.21.15.43:0/4198111455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27cc0b6bc0 0x7f27cc0b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 -- 172.21.15.43:0/4198111455 >> v2:172.21.15.162:3300/0 conn(0x7f27cc1489a0 msgr2=0x7f27cc13f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:01.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 --2- 172.21.15.43:0/4198111455 >> v2:172.21.15.162:3300/0 conn(0x7f27cc1489a0 0x7f27cc13f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 -- 172.21.15.43:0/4198111455 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27cc0b74e0 con 0x7f27cc148e00 2024-04-24T23:08:01.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 -- 172.21.15.43:0/4198111455 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f27c4001a00 con 0x7f27cc148e00 2024-04-24T23:08:01.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 -- 172.21.15.43:0/4198111455 >> v1:172.21.15.43:6789/0 conn(0x7f27cc148e00 legacy=0x7f27cc145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 --2- 172.21.15.43:0/4198111455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27b80039c0 0x7f27b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 --2- 172.21.15.43:0/4198111455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27cc0b6bc0 0x7f27b8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 --2- 172.21.15.43:0/4198111455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27b8004d50 0x7f27b80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 -- 172.21.15.43:0/4198111455 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc0b5ec0 con 0x7f27b80039c0 2024-04-24T23:08:01.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 -- 172.21.15.43:0/4198111455 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc0b7890 con 0x7f27b8004d50 2024-04-24T23:08:01.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1230640 1 -- 172.21.15.43:0/4198111455 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27b800bb30 con 0x7f27cc0b6bc0 2024-04-24T23:08:01.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d2232640 1 --2- 172.21.15.43:0/4198111455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27b80039c0 0x7f27b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d1a31640 1 --2- 172.21.15.43:0/4198111455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27cc0b6bc0 0x7f27b8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d2a33640 1 --2- 172.21.15.43:0/4198111455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27b8004d50 0x7f27b80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d2232640 1 -- 172.21.15.43:0/4198111455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27cc0b6bc0 msgr2=0x7f27b8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:01.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d2232640 1 --2- 172.21.15.43:0/4198111455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27cc0b6bc0 0x7f27b8004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d2232640 1 -- 172.21.15.43:0/4198111455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27b8004d50 msgr2=0x7f27b80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:01.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d2232640 1 --2- 172.21.15.43:0/4198111455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27b8004d50 0x7f27b80051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.022+0000 7f27d2232640 1 -- 172.21.15.43:0/4198111455 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b8003530 con 0x7f27b80039c0 2024-04-24T23:08:01.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.026+0000 7f27d2232640 1 --2- 172.21.15.43:0/4198111455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27b80039c0 0x7f27b8003de0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f27c800ba30 tx=0x7f27c801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aab9cf9e6f1a80d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:01.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.026+0000 7f27d1230640 1 -- 172.21.15.43:0/4198111455 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c80b3070 con 0x7f27b80039c0 2024-04-24T23:08:01.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.026+0000 7f27d1230640 1 -- 172.21.15.43:0/4198111455 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c80ae630 con 0x7f27b80039c0 2024-04-24T23:08:01.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.026+0000 7f27d1230640 1 -- 172.21.15.43:0/4198111455 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c80aa050 con 0x7f27b80039c0 2024-04-24T23:08:01.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.026+0000 7f27d4496640 1 -- 172.21.15.43:0/4198111455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27b80039c0 msgr2=0x7f27b8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.026+0000 7f27d4496640 1 --2- 172.21.15.43:0/4198111455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27b80039c0 0x7f27b8003de0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f27c800ba30 tx=0x7f27c801c6a0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.026+0000 7f27d2a33640 1 -- 172.21.15.43:0/4198111455 reap_dead start 2024-04-24T23:08:01.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.026+0000 7f27d4496640 1 -- 172.21.15.43:0/4198111455 shutdown_connections 2024-04-24T23:08:01.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.026+0000 7f27d4496640 1 -- 172.21.15.43:0/4198111455 >> 172.21.15.43:0/4198111455 conn(0x7f27cc061c30 msgr2=0x7f27cc062040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:01.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.026+0000 7f27d4496640 1 -- 172.21.15.43:0/4198111455 shutdown_connections 2024-04-24T23:08:01.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.026+0000 7f27d4496640 1 -- 172.21.15.43:0/4198111455 wait complete. 2024-04-24T23:08:01.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.026+0000 7f27d4496640 1 Processor -- start 2024-04-24T23:08:01.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.026+0000 7f27d4496640 1 -- start start 2024-04-24T23:08:01.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d4496640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27b80039c0 0x7f27cc14f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d4496640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27cc140ee0 0x7f27cc14d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d4496640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27cc1e14d0 0x7f27cc1e1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d4496640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc0b1f40 con 0x7f27cc1e14d0 2024-04-24T23:08:01.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d4496640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc0b1dc0 con 0x7f27b80039c0 2024-04-24T23:08:01.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d4496640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27cc150d40 con 0x7f27cc140ee0 2024-04-24T23:08:01.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d2a33640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27cc1e14d0 0x7f27cc1e1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d2a33640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27cc1e14d0 0x7f27cc1e1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54642/0 (socket says 172.21.15.43:54642) 2024-04-24T23:08:01.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d2a33640 1 -- 172.21.15.43:0/2693537611 learned_addr learned my addr 172.21.15.43:0/2693537611 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:01.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d1a31640 1 --2- 172.21.15.43:0/2693537611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27cc140ee0 0x7f27cc14d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d2232640 1 --2- 172.21.15.43:0/2693537611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27b80039c0 0x7f27cc14f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d2a33640 1 -- 172.21.15.43:0/2693537611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27cc140ee0 msgr2=0x7f27cc14d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d2a33640 1 --2- 172.21.15.43:0/2693537611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27cc140ee0 0x7f27cc14d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d2a33640 1 -- 172.21.15.43:0/2693537611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27b80039c0 msgr2=0x7f27cc14f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d2a33640 1 --2- 172.21.15.43:0/2693537611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27b80039c0 0x7f27cc14f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d2a33640 1 -- 172.21.15.43:0/2693537611 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27cc14ec50 con 0x7f27cc1e14d0 2024-04-24T23:08:01.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d2a33640 1 --2- 172.21.15.43:0/2693537611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27cc1e14d0 0x7f27cc1e1980 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0b81d0 tx=0x7f27c400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:01.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27c2ffd640 1 -- 172.21.15.43:0/2693537611 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4004d70 con 0x7f27cc1e14d0 2024-04-24T23:08:01.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27c2ffd640 1 -- 172.21.15.43:0/2693537611 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c400bb80 con 0x7f27cc1e14d0 2024-04-24T23:08:01.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d4496640 1 -- 172.21.15.43:0/2693537611 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27cc14c840 con 0x7f27cc1e14d0 2024-04-24T23:08:01.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27c2ffd640 1 -- 172.21.15.43:0/2693537611 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4007070 con 0x7f27cc1e14d0 2024-04-24T23:08:01.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d4496640 1 -- 172.21.15.43:0/2693537611 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27cc142880 con 0x7f27cc1e14d0 2024-04-24T23:08:01.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d4496640 1 -- 172.21.15.43:0/2693537611 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27cc04f580 con 0x7f27cc1e14d0 2024-04-24T23:08:01.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27c2ffd640 1 -- 172.21.15.43:0/2693537611 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f27c401b020 con 0x7f27cc1e14d0 2024-04-24T23:08:01.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27c2ffd640 1 --2- 172.21.15.43:0/2693537611 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f27b00678c0 0x7f27b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27d2232640 1 --2- 172.21.15.43:0/2693537611 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f27b00678c0 0x7f27b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.030+0000 7f27c2ffd640 1 -- 172.21.15.43:0/2693537611 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f27c40861d0 con 0x7f27cc1e14d0 2024-04-24T23:08:01.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.034+0000 7f27d2232640 1 --2- 172.21.15.43:0/2693537611 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f27b00678c0 0x7f27b0069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f27c80b0000 tx=0x7f27c80046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:01.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.034+0000 7f27c2ffd640 1 -- 172.21.15.43:0/2693537611 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f27c40568a0 con 0x7f27cc1e14d0 2024-04-24T23:08:01.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.190+0000 7f27d4496640 1 -- 172.21.15.43:0/2693537611 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f27cc14c5f0 con 0x7f27cc1e14d0 2024-04-24T23:08:01.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.190+0000 7f27c2ffd640 1 -- 172.21.15.43:0/2693537611 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f27c40561a0 con 0x7f27cc1e14d0 2024-04-24T23:08:01.194 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-24T23:08:01.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.194+0000 7f27d4496640 1 -- 172.21.15.43:0/2693537611 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f27b00678c0 msgr2=0x7f27b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.194+0000 7f27d4496640 1 --2- 172.21.15.43:0/2693537611 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f27b00678c0 0x7f27b0069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f27c80b0000 tx=0x7f27c80046d0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.194+0000 7f27d4496640 1 -- 172.21.15.43:0/2693537611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27cc1e14d0 msgr2=0x7f27cc1e1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.194+0000 7f27d4496640 1 --2- 172.21.15.43:0/2693537611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27cc1e14d0 0x7f27cc1e1980 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0b81d0 tx=0x7f27c400b4a0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.194+0000 7f27d4496640 1 -- 172.21.15.43:0/2693537611 shutdown_connections 2024-04-24T23:08:01.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.194+0000 7f27d4496640 1 --2- 172.21.15.43:0/2693537611 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f27b00678c0 0x7f27b0069d80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.194+0000 7f27d4496640 1 --2- 172.21.15.43:0/2693537611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27cc1e14d0 0x7f27cc1e1980 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.194+0000 7f27d4496640 1 --2- 172.21.15.43:0/2693537611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27cc140ee0 0x7f27cc14d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.194+0000 7f27d4496640 1 --2- 172.21.15.43:0/2693537611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27b80039c0 0x7f27cc14f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.194+0000 7f27d4496640 1 -- 172.21.15.43:0/2693537611 >> 172.21.15.43:0/2693537611 conn(0x7f27cc061c30 msgr2=0x7f27cc150210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:01.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.194+0000 7f27d4496640 1 -- 172.21.15.43:0/2693537611 shutdown_connections 2024-04-24T23:08:01.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.194+0000 7f27d4496640 1 -- 172.21.15.43:0/2693537611 wait complete. 2024-04-24T23:08:01.212 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-24T23:08:01.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.322+0000 7f544d4b2640 1 Processor -- start 2024-04-24T23:08:01.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.322+0000 7f544d4b2640 1 -- start start 2024-04-24T23:08:01.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.322+0000 7f544d4b2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f544813eff0 0x7f544813f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.322+0000 7f544d4b2640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f544814dbc0 0x7f544814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.322+0000 7f544d4b2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5448062270 con 0x7f5448061e90 2024-04-24T23:08:01.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.322+0000 7f544d4b2640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f5448071800 con 0x7f544814dbc0 2024-04-24T23:08:01.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.322+0000 7f544d4b2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5448145cf0 con 0x7f544813eff0 2024-04-24T23:08:01.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.322+0000 7f54477fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f544814dbc0 0x7f544814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.322+0000 7f54477fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f544814dbc0 0x7f544814ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54648/0 (socket says 172.21.15.43:54648) 2024-04-24T23:08:01.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f54477fe640 1 -- 172.21.15.43:0/2231471171 learned_addr learned my addr 172.21.15.43:0/2231471171 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:01.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f54467fc640 1 --2- 172.21.15.43:0/2231471171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f544813eff0 0x7f544813f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f54477fe640 1 -- 172.21.15.43:0/2231471171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f544813eff0 msgr2=0x7f544813f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:01.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f54477fe640 1 --2- 172.21.15.43:0/2231471171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f544813eff0 0x7f544813f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f54477fe640 1 -- 172.21.15.43:0/2231471171 >> v1:172.21.15.162:6789/0 conn(0x7f5448061e90 legacy=0x7f5448071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f54477fe640 1 -- 172.21.15.43:0/2231471171 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54481456a0 con 0x7f544814dbc0 2024-04-24T23:08:01.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f54477fe640 1 --2- 172.21.15.43:0/2231471171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f544814dbc0 0x7f544814ffb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5448071980 tx=0x7f544001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc8a650291e66b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:01.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f5445ffb640 1 -- 172.21.15.43:0/2231471171 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54400a56e0 con 0x7f544814dbc0 2024-04-24T23:08:01.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f5445ffb640 1 -- 172.21.15.43:0/2231471171 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54400a5880 con 0x7f544814dbc0 2024-04-24T23:08:01.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f5445ffb640 1 -- 172.21.15.43:0/2231471171 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54400a5c50 con 0x7f544814dbc0 2024-04-24T23:08:01.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f544d4b2640 1 -- 172.21.15.43:0/2231471171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f544814dbc0 msgr2=0x7f544814ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f544d4b2640 1 --2- 172.21.15.43:0/2231471171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f544814dbc0 0x7f544814ffb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5448071980 tx=0x7f544001ca10 comp rx=0 tx=0).stop 2024-04-24T23:08:01.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f544d4b2640 1 -- 172.21.15.43:0/2231471171 shutdown_connections 2024-04-24T23:08:01.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f544d4b2640 1 --2- 172.21.15.43:0/2231471171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f544813eff0 0x7f544813f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f544d4b2640 1 --2- 172.21.15.43:0/2231471171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f544814dbc0 0x7f544814ffb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.326+0000 7f544d4b2640 1 -- 172.21.15.43:0/2231471171 >> 172.21.15.43:0/2231471171 conn(0x7f54480b93e0 msgr2=0x7f54480b97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:01.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f544d4b2640 1 -- 172.21.15.43:0/2231471171 shutdown_connections 2024-04-24T23:08:01.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f544d4b2640 1 -- 172.21.15.43:0/2231471171 wait complete. 2024-04-24T23:08:01.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f544d4b2640 1 Processor -- start 2024-04-24T23:08:01.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f544d4b2640 1 -- start start 2024-04-24T23:08:01.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f544d4b2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5448061e90 0x7f54481e1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f544d4b2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f544813eff0 0x7f54480b5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f544d4b2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f544814dbc0 0x7f54480b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f544d4b2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f54480707e0 con 0x7f544814dbc0 2024-04-24T23:08:01.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f544d4b2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54480725f0 con 0x7f544813eff0 2024-04-24T23:08:01.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f544d4b2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5448070960 con 0x7f5448061e90 2024-04-24T23:08:01.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f54477fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f544814dbc0 0x7f54480b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f54477fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f544814dbc0 0x7f54480b5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54652/0 (socket says 172.21.15.43:54652) 2024-04-24T23:08:01.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f54477fe640 1 -- 172.21.15.43:0/3481441310 learned_addr learned my addr 172.21.15.43:0/3481441310 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:01.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f54467fc640 1 --2- 172.21.15.43:0/3481441310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f544813eff0 0x7f54480b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f5446ffd640 1 --2- 172.21.15.43:0/3481441310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5448061e90 0x7f54481e1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f54477fe640 1 -- 172.21.15.43:0/3481441310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5448061e90 msgr2=0x7f54481e1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f54477fe640 1 --2- 172.21.15.43:0/3481441310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5448061e90 0x7f54481e1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f54477fe640 1 -- 172.21.15.43:0/3481441310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f544813eff0 msgr2=0x7f54480b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f54477fe640 1 --2- 172.21.15.43:0/3481441310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f544813eff0 0x7f54480b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f54477fe640 1 -- 172.21.15.43:0/3481441310 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54481e1d40 con 0x7f544814dbc0 2024-04-24T23:08:01.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f54477fe640 1 --2- 172.21.15.43:0/3481441310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f544814dbc0 0x7f54480b5ba0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f54400af040 tx=0x7f54400197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:01.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f543f7fe640 1 -- 172.21.15.43:0/3481441310 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54400bc070 con 0x7f544814dbc0 2024-04-24T23:08:01.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f543f7fe640 1 -- 172.21.15.43:0/3481441310 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54400b8640 con 0x7f544814dbc0 2024-04-24T23:08:01.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f544d4b2640 1 -- 172.21.15.43:0/3481441310 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54480b6280 con 0x7f544814dbc0 2024-04-24T23:08:01.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f543f7fe640 1 -- 172.21.15.43:0/3481441310 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54400b8a10 con 0x7f544814dbc0 2024-04-24T23:08:01.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f544d4b2640 1 -- 172.21.15.43:0/3481441310 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54480b6c80 con 0x7f544814dbc0 2024-04-24T23:08:01.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.330+0000 7f544d4b2640 1 -- 172.21.15.43:0/3481441310 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f544806c200 con 0x7f544814dbc0 2024-04-24T23:08:01.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.334+0000 7f543f7fe640 1 -- 172.21.15.43:0/3481441310 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f54400bf070 con 0x7f544814dbc0 2024-04-24T23:08:01.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.334+0000 7f543f7fe640 1 --2- 172.21.15.43:0/3481441310 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f54280678c0 0x7f5428069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.334+0000 7f543f7fe640 1 -- 172.21.15.43:0/3481441310 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f5440120f10 con 0x7f544814dbc0 2024-04-24T23:08:01.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.334+0000 7f5446ffd640 1 --2- 172.21.15.43:0/3481441310 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f54280678c0 0x7f5428069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.334+0000 7f5446ffd640 1 --2- 172.21.15.43:0/3481441310 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f54280678c0 0x7f5428069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5438007fd0 tx=0x7f5438009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:01.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.338+0000 7f543f7fe640 1 -- 172.21.15.43:0/3481441310 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5440016600 con 0x7f544814dbc0 2024-04-24T23:08:01.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.494+0000 7f544d4b2640 1 -- 172.21.15.43:0/3481441310 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f544804f580 con 0x7f544814dbc0 2024-04-24T23:08:01.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.494+0000 7f543f7fe640 1 -- 172.21.15.43:0/3481441310 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f54400f1870 con 0x7f544814dbc0 2024-04-24T23:08:01.495 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-24T23:08:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.494+0000 7f544d4b2640 1 -- 172.21.15.43:0/3481441310 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f54280678c0 msgr2=0x7f5428069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.494+0000 7f544d4b2640 1 --2- 172.21.15.43:0/3481441310 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f54280678c0 0x7f5428069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5438007fd0 tx=0x7f5438009040 comp rx=0 tx=0).stop 2024-04-24T23:08:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.494+0000 7f544d4b2640 1 -- 172.21.15.43:0/3481441310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f544814dbc0 msgr2=0x7f54480b5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.494+0000 7f544d4b2640 1 --2- 172.21.15.43:0/3481441310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f544814dbc0 0x7f54480b5ba0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f54400af040 tx=0x7f54400197b0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.494+0000 7f544d4b2640 1 -- 172.21.15.43:0/3481441310 shutdown_connections 2024-04-24T23:08:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.494+0000 7f544d4b2640 1 --2- 172.21.15.43:0/3481441310 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f54280678c0 0x7f5428069d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.494+0000 7f544d4b2640 1 --2- 172.21.15.43:0/3481441310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f544814dbc0 0x7f54480b5ba0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.494+0000 7f544d4b2640 1 --2- 172.21.15.43:0/3481441310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f544813eff0 0x7f54480b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.494+0000 7f544d4b2640 1 --2- 172.21.15.43:0/3481441310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5448061e90 0x7f54481e1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.494+0000 7f544d4b2640 1 -- 172.21.15.43:0/3481441310 >> 172.21.15.43:0/3481441310 conn(0x7f54480b93e0 msgr2=0x7f5448144470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.494+0000 7f544d4b2640 1 -- 172.21.15.43:0/3481441310 shutdown_connections 2024-04-24T23:08:01.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.494+0000 7f544d4b2640 1 -- 172.21.15.43:0/3481441310 wait complete. 2024-04-24T23:08:01.513 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-24T23:08:01.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.638+0000 7ff8e5618640 1 Processor -- start 2024-04-24T23:08:01.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.638+0000 7ff8e5618640 1 -- start start 2024-04-24T23:08:01.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8e5618640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff8e014dc70 0x7ff8e0150060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8e5618640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e00b6de0 con 0x7ff8e00b6a00 2024-04-24T23:08:01.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8e5618640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e00721c0 con 0x7ff8e0070ea0 2024-04-24T23:08:01.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8e5618640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff8e00716e0 con 0x7ff8e014dc70 2024-04-24T23:08:01.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8deffd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff8e00b6a00 0x7ff8e0147940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33820/0 (socket says 172.21.15.43:33820) 2024-04-24T23:08:01.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8deffd640 1 -- 172.21.15.43:0/421854859 learned_addr learned my addr 172.21.15.43:0/421854859 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:01.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8df7fe640 1 --2- 172.21.15.43:0/421854859 >> v2:172.21.15.162:3300/0 conn(0x7ff8e014dc70 0x7ff8e0150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8ddffb640 1 -- 172.21.15.43:0/421854859 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 831553022 0 0) 0x7ff8e00b6de0 con 0x7ff8e00b6a00 2024-04-24T23:08:01.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8ddffb640 1 -- 172.21.15.43:0/421854859 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8cc003530 con 0x7ff8e00b6a00 2024-04-24T23:08:01.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8ddffb640 1 -- 172.21.15.43:0/421854859 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2978605739 0 0) 0x7ff8cc003530 con 0x7ff8e00b6a00 2024-04-24T23:08:01.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8ddffb640 1 -- 172.21.15.43:0/421854859 >> v2:172.21.15.162:3300/0 conn(0x7ff8e014dc70 msgr2=0x7ff8e0150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:01.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8ddffb640 1 --2- 172.21.15.43:0/421854859 >> v2:172.21.15.162:3300/0 conn(0x7ff8e014dc70 0x7ff8e0150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8ddffb640 1 -- 172.21.15.43:0/421854859 >> v1:172.21.15.162:6789/0 conn(0x7ff8e0070ea0 legacy=0x7ff8e013e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8ddffb640 1 -- 172.21.15.43:0/421854859 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e00719c0 con 0x7ff8e00b6a00 2024-04-24T23:08:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8ddffb640 1 -- 172.21.15.43:0/421854859 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7ff8d8001680 con 0x7ff8e00b6a00 2024-04-24T23:08:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8df7fe640 1 --2- 172.21.15.43:0/421854859 >> v2:172.21.15.162:3300/0 conn(0x7ff8e014dc70 0x7ff8e0150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:08:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8ddffb640 1 -- 172.21.15.43:0/421854859 >> v1:172.21.15.43:6789/0 conn(0x7ff8e00b6a00 legacy=0x7ff8e0147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8ddffb640 1 --2- 172.21.15.43:0/421854859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8cc0039c0 0x7ff8cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8ddffb640 1 --2- 172.21.15.43:0/421854859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc004810 0x7ff8cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8ddffb640 1 --2- 172.21.15.43:0/421854859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8cc0053d0 0x7ff8cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8ddffb640 1 -- 172.21.15.43:0/421854859 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e00716e0 con 0x7ff8cc0053d0 2024-04-24T23:08:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8ddffb640 1 -- 172.21.15.43:0/421854859 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc00c260 con 0x7ff8cc004810 2024-04-24T23:08:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8ddffb640 1 -- 172.21.15.43:0/421854859 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff8cc00c460 con 0x7ff8cc0039c0 2024-04-24T23:08:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8df7fe640 1 --2- 172.21.15.43:0/421854859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8cc0053d0 0x7ff8cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8de7fc640 1 --2- 172.21.15.43:0/421854859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc004810 0x7ff8cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8deffd640 1 --2- 172.21.15.43:0/421854859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8cc0039c0 0x7ff8cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8df7fe640 1 -- 172.21.15.43:0/421854859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8cc0039c0 msgr2=0x7ff8cc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:01.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8df7fe640 1 --2- 172.21.15.43:0/421854859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8cc0039c0 0x7ff8cc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8df7fe640 1 -- 172.21.15.43:0/421854859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc004810 msgr2=0x7ff8cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:01.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8df7fe640 1 --2- 172.21.15.43:0/421854859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc004810 0x7ff8cc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8df7fe640 1 -- 172.21.15.43:0/421854859 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc003530 con 0x7ff8cc0053d0 2024-04-24T23:08:01.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8df7fe640 1 -- 172.21.15.43:0/421854859 reap_dead start 2024-04-24T23:08:01.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.642+0000 7ff8df7fe640 1 --2- 172.21.15.43:0/421854859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8cc0053d0 0x7ff8cc00b9d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00073b0 tx=0x7ff8d001cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189ff7eafa1b45d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:01.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8ddffb640 1 -- 172.21.15.43:0/421854859 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0009c80 con 0x7ff8cc0053d0 2024-04-24T23:08:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8ddffb640 1 -- 172.21.15.43:0/421854859 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d00a5cf0 con 0x7ff8cc0053d0 2024-04-24T23:08:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8ddffb640 1 -- 172.21.15.43:0/421854859 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00ad660 con 0x7ff8cc0053d0 2024-04-24T23:08:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 -- 172.21.15.43:0/421854859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8cc0053d0 msgr2=0x7ff8cc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 --2- 172.21.15.43:0/421854859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8cc0053d0 0x7ff8cc00b9d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00073b0 tx=0x7ff8d001cef0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 -- 172.21.15.43:0/421854859 shutdown_connections 2024-04-24T23:08:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 --2- 172.21.15.43:0/421854859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8cc0053d0 0x7ff8cc00b9d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 -- 172.21.15.43:0/421854859 >> 172.21.15.43:0/421854859 conn(0x7ff8e006c300 msgr2=0x7ff8e006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 -- 172.21.15.43:0/421854859 shutdown_connections 2024-04-24T23:08:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 -- 172.21.15.43:0/421854859 wait complete. 2024-04-24T23:08:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 Processor -- start 2024-04-24T23:08:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 -- start start 2024-04-24T23:08:01.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8cc0053d0 0x7ff8e00b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8e01db8f0 0x7ff8e01dbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8e013adf0 0x7ff8e013b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e00b0da0 con 0x7ff8e01db8f0 2024-04-24T23:08:01.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e00b0c20 con 0x7ff8e013adf0 2024-04-24T23:08:01.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e0147940 con 0x7ff8cc0053d0 2024-04-24T23:08:01.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8de7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8e01db8f0 0x7ff8e01dbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8de7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8e01db8f0 0x7ff8e01dbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54664/0 (socket says 172.21.15.43:54664) 2024-04-24T23:08:01.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8de7fc640 1 -- 172.21.15.43:0/2310178732 learned_addr learned my addr 172.21.15.43:0/2310178732 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:01.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8de7fc640 1 -- 172.21.15.43:0/2310178732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8cc0053d0 msgr2=0x7ff8e00b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8de7fc640 1 --2- 172.21.15.43:0/2310178732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8cc0053d0 0x7ff8e00b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8de7fc640 1 -- 172.21.15.43:0/2310178732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8e013adf0 msgr2=0x7ff8e013b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8df7fe640 1 --2- 172.21.15.43:0/2310178732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8e013adf0 0x7ff8e013b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8de7fc640 1 --2- 172.21.15.43:0/2310178732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8e013adf0 0x7ff8e013b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8de7fc640 1 -- 172.21.15.43:0/2310178732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e01dc2b0 con 0x7ff8e01db8f0 2024-04-24T23:08:01.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8de7fc640 1 --2- 172.21.15.43:0/2310178732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8e01db8f0 0x7ff8e01dbd70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800e470 tx=0x7ff8c800e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:01.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8d77fe640 1 -- 172.21.15.43:0/2310178732 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80052e0 con 0x7ff8e01db8f0 2024-04-24T23:08:01.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8d77fe640 1 -- 172.21.15.43:0/2310178732 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c8018070 con 0x7ff8e01db8f0 2024-04-24T23:08:01.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8e5618640 1 -- 172.21.15.43:0/2310178732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e00b3250 con 0x7ff8e01db8f0 2024-04-24T23:08:01.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.646+0000 7ff8d77fe640 1 -- 172.21.15.43:0/2310178732 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8003820 con 0x7ff8e01db8f0 2024-04-24T23:08:01.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.650+0000 7ff8e5618640 1 -- 172.21.15.43:0/2310178732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e01476d0 con 0x7ff8e01db8f0 2024-04-24T23:08:01.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.650+0000 7ff8e5618640 1 -- 172.21.15.43:0/2310178732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e004f580 con 0x7ff8e01db8f0 2024-04-24T23:08:01.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.650+0000 7ff8d77fe640 1 -- 172.21.15.43:0/2310178732 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff8c80039c0 con 0x7ff8e01db8f0 2024-04-24T23:08:01.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.650+0000 7ff8d77fe640 1 --2- 172.21.15.43:0/2310178732 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff8c00678c0 0x7ff8c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.650+0000 7ff8d77fe640 1 -- 172.21.15.43:0/2310178732 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7ff8c8085ba0 con 0x7ff8e01db8f0 2024-04-24T23:08:01.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.650+0000 7ff8deffd640 1 --2- 172.21.15.43:0/2310178732 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff8c00678c0 0x7ff8c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.650+0000 7ff8deffd640 1 --2- 172.21.15.43:0/2310178732 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff8c00678c0 0x7ff8c0069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8001ec0 tx=0x7ff8d8000ff0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:01.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.654+0000 7ff8d77fe640 1 -- 172.21.15.43:0/2310178732 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ff8e01dc2b0 con 0x7ff8e01db8f0 2024-04-24T23:08:01.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.810+0000 7ff8e5618640 1 -- 172.21.15.43:0/2310178732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff8e01db510 con 0x7ff8e01db8f0 2024-04-24T23:08:01.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.810+0000 7ff8d77fe640 1 -- 172.21.15.43:0/2310178732 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7ff8c80563a0 con 0x7ff8e01db8f0 2024-04-24T23:08:01.813 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-24T23:08:01.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.814+0000 7ff8e5618640 1 -- 172.21.15.43:0/2310178732 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff8c00678c0 msgr2=0x7ff8c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.814+0000 7ff8e5618640 1 --2- 172.21.15.43:0/2310178732 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff8c00678c0 0x7ff8c0069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8001ec0 tx=0x7ff8d8000ff0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.814+0000 7ff8e5618640 1 -- 172.21.15.43:0/2310178732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8e01db8f0 msgr2=0x7ff8e01dbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.814+0000 7ff8e5618640 1 --2- 172.21.15.43:0/2310178732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8e01db8f0 0x7ff8e01dbd70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800e470 tx=0x7ff8c800e930 comp rx=0 tx=0).stop 2024-04-24T23:08:01.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.814+0000 7ff8e5618640 1 -- 172.21.15.43:0/2310178732 shutdown_connections 2024-04-24T23:08:01.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.814+0000 7ff8e5618640 1 --2- 172.21.15.43:0/2310178732 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7ff8c00678c0 0x7ff8c0069d80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.814+0000 7ff8e5618640 1 --2- 172.21.15.43:0/2310178732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8e013adf0 0x7ff8e013b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.814+0000 7ff8e5618640 1 --2- 172.21.15.43:0/2310178732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8e01db8f0 0x7ff8e01dbd70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.814+0000 7ff8e5618640 1 --2- 172.21.15.43:0/2310178732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8cc0053d0 0x7ff8e00b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.814+0000 7ff8e5618640 1 -- 172.21.15.43:0/2310178732 >> 172.21.15.43:0/2310178732 conn(0x7ff8e006c300 msgr2=0x7ff8e0142ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:01.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.814+0000 7ff8e5618640 1 -- 172.21.15.43:0/2310178732 shutdown_connections 2024-04-24T23:08:01.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.814+0000 7ff8e5618640 1 -- 172.21.15.43:0/2310178732 wait complete. 2024-04-24T23:08:01.831 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-24T23:08:01.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b3e0b640 1 Processor -- start 2024-04-24T23:08:01.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b3e0b640 1 -- start start 2024-04-24T23:08:01.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b3e0b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc4ac13f1f0 0x7fc4ac13f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b3e0b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc4ac14dce0 0x7fc4ac1500d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b3e0b640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4ac070060 con 0x7fc4ac0b2500 2024-04-24T23:08:01.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b3e0b640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc4ac13fbc0 con 0x7fc4ac13f1f0 2024-04-24T23:08:01.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b3e0b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc4ac0b28e0 con 0x7fc4ac14dce0 2024-04-24T23:08:01.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b13a6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc4ac13f1f0 0x7fc4ac13f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b13a6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc4ac13f1f0 0x7fc4ac13f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54672/0 (socket says 172.21.15.43:54672) 2024-04-24T23:08:01.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b13a6640 1 -- 172.21.15.43:0/2393911197 learned_addr learned my addr 172.21.15.43:0/2393911197 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:01.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b1ba7640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc4ac0b2500 0x7fc4ac145450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33832/0 (socket says 172.21.15.43:33832) 2024-04-24T23:08:01.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b23a8640 1 --2- 172.21.15.43:0/2393911197 >> v2:172.21.15.162:3300/0 conn(0x7fc4ac14dce0 0x7fc4ac1500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b13a6640 1 -- 172.21.15.43:0/2393911197 >> v2:172.21.15.162:3300/0 conn(0x7fc4ac14dce0 msgr2=0x7fc4ac1500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:01.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b13a6640 1 --2- 172.21.15.43:0/2393911197 >> v2:172.21.15.162:3300/0 conn(0x7fc4ac14dce0 0x7fc4ac1500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b13a6640 1 -- 172.21.15.43:0/2393911197 >> v1:172.21.15.43:6789/0 conn(0x7fc4ac0b2500 legacy=0x7fc4ac145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b13a6640 1 -- 172.21.15.43:0/2393911197 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ac0af8f0 con 0x7fc4ac13f1f0 2024-04-24T23:08:01.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b0ba5640 1 -- 172.21.15.43:0/2393911197 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2762079829 0 0) 0x7fc4ac070060 con 0x7fc4ac0b2500 2024-04-24T23:08:01.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.954+0000 7fc4b23a8640 1 --2- 172.21.15.43:0/2393911197 >> v2:172.21.15.162:3300/0 conn(0x7fc4ac14dce0 0x7fc4ac1500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b13a6640 1 --2- 172.21.15.43:0/2393911197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4ac13f1f0 0x7fc4ac13f680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0b4a80 tx=0x7fc49c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bd01d576958ecc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b0ba5640 1 -- 172.21.15.43:0/2393911197 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0b0070 con 0x7fc4ac13f1f0 2024-04-24T23:08:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b0ba5640 1 -- 172.21.15.43:0/2393911197 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49c0ab600 con 0x7fc4ac13f1f0 2024-04-24T23:08:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b0ba5640 1 -- 172.21.15.43:0/2393911197 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0ab9d0 con 0x7fc4ac13f1f0 2024-04-24T23:08:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 -- 172.21.15.43:0/2393911197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4ac13f1f0 msgr2=0x7fc4ac13f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 --2- 172.21.15.43:0/2393911197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4ac13f1f0 0x7fc4ac13f680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0b4a80 tx=0x7fc49c01c520 comp rx=0 tx=0).stop 2024-04-24T23:08:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 -- 172.21.15.43:0/2393911197 shutdown_connections 2024-04-24T23:08:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 --2- 172.21.15.43:0/2393911197 >> v2:172.21.15.162:3300/0 conn(0x7fc4ac14dce0 0x7fc4ac1500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 --2- 172.21.15.43:0/2393911197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4ac13f1f0 0x7fc4ac13f680 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 -- 172.21.15.43:0/2393911197 >> 172.21.15.43:0/2393911197 conn(0x7fc4ac0b5690 msgr2=0x7fc4ac0b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 -- 172.21.15.43:0/2393911197 shutdown_connections 2024-04-24T23:08:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 -- 172.21.15.43:0/2393911197 wait complete. 2024-04-24T23:08:01.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 Processor -- start 2024-04-24T23:08:01.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 -- start start 2024-04-24T23:08:01.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ac0b2500 0x7fc4ac144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ac13f1f0 0x7fc4ac133c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4ac14dce0 0x7fc4ac138490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac0b5410 con 0x7fc4ac14dce0 2024-04-24T23:08:01.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac0b5290 con 0x7fc4ac0b2500 2024-04-24T23:08:01.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4ac0b4af0 con 0x7fc4ac13f1f0 2024-04-24T23:08:01.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b23a8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4ac14dce0 0x7fc4ac138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b23a8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4ac14dce0 0x7fc4ac138490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54674/0 (socket says 172.21.15.43:54674) 2024-04-24T23:08:01.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b23a8640 1 -- 172.21.15.43:0/1520583413 learned_addr learned my addr 172.21.15.43:0/1520583413 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:01.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b1ba7640 1 --2- 172.21.15.43:0/1520583413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ac0b2500 0x7fc4ac144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b23a8640 1 -- 172.21.15.43:0/1520583413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ac13f1f0 msgr2=0x7fc4ac133c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b13a6640 1 --2- 172.21.15.43:0/1520583413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ac13f1f0 0x7fc4ac133c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b23a8640 1 --2- 172.21.15.43:0/1520583413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ac13f1f0 0x7fc4ac133c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b23a8640 1 -- 172.21.15.43:0/1520583413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ac0b2500 msgr2=0x7fc4ac144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:01.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b23a8640 1 --2- 172.21.15.43:0/1520583413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ac0b2500 0x7fc4ac144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:01.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b23a8640 1 -- 172.21.15.43:0/1520583413 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ac134ee0 con 0x7fc4ac14dce0 2024-04-24T23:08:01.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b13a6640 1 --2- 172.21.15.43:0/1520583413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ac13f1f0 0x7fc4ac133c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:01.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b23a8640 1 --2- 172.21.15.43:0/1520583413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4ac14dce0 0x7fc4ac138490 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800c7f0 tx=0x7fc4a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:01.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4a27fc640 1 -- 172.21.15.43:0/1520583413 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8015070 con 0x7fc4ac14dce0 2024-04-24T23:08:01.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4a27fc640 1 -- 172.21.15.43:0/1520583413 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a8007860 con 0x7fc4ac14dce0 2024-04-24T23:08:01.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 -- 172.21.15.43:0/1520583413 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ac138e80 con 0x7fc4ac14dce0 2024-04-24T23:08:01.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4a27fc640 1 -- 172.21.15.43:0/1520583413 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8007c50 con 0x7fc4ac14dce0 2024-04-24T23:08:01.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.958+0000 7fc4b3e0b640 1 -- 172.21.15.43:0/1520583413 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ac1351c0 con 0x7fc4ac14dce0 2024-04-24T23:08:01.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.962+0000 7fc4b3e0b640 1 -- 172.21.15.43:0/1520583413 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4ac04f580 con 0x7fc4ac14dce0 2024-04-24T23:08:01.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.962+0000 7fc4a27fc640 1 -- 172.21.15.43:0/1520583413 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc4a8018070 con 0x7fc4ac14dce0 2024-04-24T23:08:01.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.962+0000 7fc4a27fc640 1 --2- 172.21.15.43:0/1520583413 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc4900678c0 0x7fc490069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:01.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.962+0000 7fc4a27fc640 1 -- 172.21.15.43:0/1520583413 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fc4a8086650 con 0x7fc4ac14dce0 2024-04-24T23:08:01.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.962+0000 7fc4b1ba7640 1 --2- 172.21.15.43:0/1520583413 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc4900678c0 0x7fc490069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:01.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.962+0000 7fc4b1ba7640 1 --2- 172.21.15.43:0/1520583413 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc4900678c0 0x7fc490069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40012f0 tx=0x7fc4a4005ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:01.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:01.966+0000 7fc4a27fc640 1 -- 172.21.15.43:0/1520583413 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc4a8056e30 con 0x7fc4ac14dce0 2024-04-24T23:08:02.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:02.138+0000 7fc4b3e0b640 1 -- 172.21.15.43:0/1520583413 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc4ac071970 con 0x7fc4ac14dce0 2024-04-24T23:08:02.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:02.138+0000 7fc4a27fc640 1 -- 172.21.15.43:0/1520583413 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fc4a8056730 con 0x7fc4ac14dce0 2024-04-24T23:08:02.139 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2024-04-24T23:08:02.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:02.138+0000 7fc4b3e0b640 1 -- 172.21.15.43:0/1520583413 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc4900678c0 msgr2=0x7fc490069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:02.138+0000 7fc4b3e0b640 1 --2- 172.21.15.43:0/1520583413 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc4900678c0 0x7fc490069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40012f0 tx=0x7fc4a4005ec0 comp rx=0 tx=0).stop 2024-04-24T23:08:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:02.138+0000 7fc4b3e0b640 1 -- 172.21.15.43:0/1520583413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4ac14dce0 msgr2=0x7fc4ac138490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:02.138+0000 7fc4b3e0b640 1 --2- 172.21.15.43:0/1520583413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4ac14dce0 0x7fc4ac138490 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800c7f0 tx=0x7fc4a800ccb0 comp rx=0 tx=0).stop 2024-04-24T23:08:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:02.138+0000 7fc4b3e0b640 1 -- 172.21.15.43:0/1520583413 shutdown_connections 2024-04-24T23:08:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:02.138+0000 7fc4b3e0b640 1 --2- 172.21.15.43:0/1520583413 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc4900678c0 0x7fc490069d80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:02.138+0000 7fc4b3e0b640 1 --2- 172.21.15.43:0/1520583413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4ac14dce0 0x7fc4ac138490 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:02.138+0000 7fc4b3e0b640 1 --2- 172.21.15.43:0/1520583413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ac13f1f0 0x7fc4ac133c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:02.138+0000 7fc4b3e0b640 1 --2- 172.21.15.43:0/1520583413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ac0b2500 0x7fc4ac144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:02.138+0000 7fc4b3e0b640 1 -- 172.21.15.43:0/1520583413 >> 172.21.15.43:0/1520583413 conn(0x7fc4ac0b5690 msgr2=0x7fc4ac06d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:02.138+0000 7fc4b3e0b640 1 -- 172.21.15.43:0/1520583413 shutdown_connections 2024-04-24T23:08:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:02.138+0000 7fc4b3e0b640 1 -- 172.21.15.43:0/1520583413 wait complete. 2024-04-24T23:08:02.163 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi043.front.sepia.ceph.com... 2024-04-24T23:08:02.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:08:02.163 DEBUG:teuthology.orchestra.run.smithi043:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-24T23:08:02.382 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi043.stderr:ceph-fuse[33807]: fuse finished with error 0 and tester_r 0 2024-04-24T23:08:02.383 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:02.482 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-04-24T23:08:02.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:08:02.482 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-24T23:08:02.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:08:02.541 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-24T23:08:03.290 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-24T23:08:03.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:08:03.291 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-24T23:08:03.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-24T23:08:03.306 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-04-24T23:08:03.472 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-24T23:08:03.488 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T23:08:03.489 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:08:03.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fccae201640 1 Processor -- start 2024-04-24T23:08:03.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fccae201640 1 -- start start 2024-04-24T23:08:03.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fccae201640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcca80b60a0 0x7fcca80b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:03.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fccae201640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcca8070eb0 0x7fcca814aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:03.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fccae201640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca80b56a0 0x7fcca81414d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:03.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fccae201640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fcca80b5210 con 0x7fcca8070eb0 2024-04-24T23:08:03.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fccae201640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcca80721f0 con 0x7fcca80b60a0 2024-04-24T23:08:03.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fccae201640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcca80b6480 con 0x7fcca80b56a0 2024-04-24T23:08:03.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fcca6ffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcca8070eb0 0x7fcca814aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:03.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fcca6ffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcca8070eb0 0x7fcca814aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54684/0 (socket says 172.21.15.43:54684) 2024-04-24T23:08:03.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fcca6ffd640 1 -- 172.21.15.43:0/4067766224 learned_addr learned my addr 172.21.15.43:0/4067766224 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:03.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fcca7fff640 1 --2- 172.21.15.43:0/4067766224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca80b56a0 0x7fcca81414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:03.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fcca6ffd640 1 -- 172.21.15.43:0/4067766224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca80b56a0 msgr2=0x7fcca81414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:03.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fcca77fe640 1 --2- 172.21.15.43:0/4067766224 >> v2:172.21.15.162:3300/0 conn(0x7fcca80b60a0 0x7fcca80b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:03.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fcca6ffd640 1 --2- 172.21.15.43:0/4067766224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca80b56a0 0x7fcca81414d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fcca6ffd640 1 -- 172.21.15.43:0/4067766224 >> v2:172.21.15.162:3300/0 conn(0x7fcca80b60a0 msgr2=0x7fcca80b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:03.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fcca6ffd640 1 --2- 172.21.15.43:0/4067766224 >> v2:172.21.15.162:3300/0 conn(0x7fcca80b60a0 0x7fcca80b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fcca6ffd640 1 -- 172.21.15.43:0/4067766224 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca80b6dc0 con 0x7fcca8070eb0 2024-04-24T23:08:03.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fcca7fff640 1 --2- 172.21.15.43:0/4067766224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca80b56a0 0x7fcca81414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:03.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.606+0000 7fcca77fe640 1 --2- 172.21.15.43:0/4067766224 >> v2:172.21.15.162:3300/0 conn(0x7fcca80b60a0 0x7fcca80b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca6ffd640 1 --2- 172.21.15.43:0/4067766224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcca8070eb0 0x7fcca814aae0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcca80b47c0 tx=0x7fcc9c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc3927a9a80ba78 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca67fc640 1 -- 172.21.15.43:0/4067766224 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0aa660 con 0x7fcca8070eb0 2024-04-24T23:08:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca67fc640 1 -- 172.21.15.43:0/4067766224 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc9c0af070 con 0x7fcca8070eb0 2024-04-24T23:08:03.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca67fc640 1 -- 172.21.15.43:0/4067766224 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0aaa20 con 0x7fcca8070eb0 2024-04-24T23:08:03.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 -- 172.21.15.43:0/4067766224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcca8070eb0 msgr2=0x7fcca814aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:03.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 --2- 172.21.15.43:0/4067766224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcca8070eb0 0x7fcca814aae0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcca80b47c0 tx=0x7fcc9c01c520 comp rx=0 tx=0).stop 2024-04-24T23:08:03.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 -- 172.21.15.43:0/4067766224 shutdown_connections 2024-04-24T23:08:03.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 --2- 172.21.15.43:0/4067766224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca80b56a0 0x7fcca81414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 --2- 172.21.15.43:0/4067766224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcca8070eb0 0x7fcca814aae0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 --2- 172.21.15.43:0/4067766224 >> v2:172.21.15.162:3300/0 conn(0x7fcca80b60a0 0x7fcca80b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 -- 172.21.15.43:0/4067766224 >> 172.21.15.43:0/4067766224 conn(0x7fcca806c300 msgr2=0x7fcca806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:03.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 -- 172.21.15.43:0/4067766224 shutdown_connections 2024-04-24T23:08:03.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 -- 172.21.15.43:0/4067766224 wait complete. 2024-04-24T23:08:03.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 Processor -- start 2024-04-24T23:08:03.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 -- start start 2024-04-24T23:08:03.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcca8070eb0 0x7fcca81e0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:03.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca80b56a0 0x7fcca81427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:03.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca80b60a0 0x7fcca8142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:03.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcca806bd90 con 0x7fcca8070eb0 2024-04-24T23:08:03.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcca806bc10 con 0x7fcca80b60a0 2024-04-24T23:08:03.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcca806bf10 con 0x7fcca80b56a0 2024-04-24T23:08:03.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcca8070eb0 0x7fcca81e0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:03.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcca8070eb0 0x7fcca81e0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54696/0 (socket says 172.21.15.43:54696) 2024-04-24T23:08:03.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca77fe640 1 -- 172.21.15.43:0/4015022322 learned_addr learned my addr 172.21.15.43:0/4015022322 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:03.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca6ffd640 1 --2- 172.21.15.43:0/4015022322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca80b56a0 0x7fcca81427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:03.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca7fff640 1 --2- 172.21.15.43:0/4015022322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca80b60a0 0x7fcca8142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:03.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca77fe640 1 -- 172.21.15.43:0/4015022322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca80b56a0 msgr2=0x7fcca81427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:03.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca77fe640 1 --2- 172.21.15.43:0/4015022322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca80b56a0 0x7fcca81427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca77fe640 1 -- 172.21.15.43:0/4015022322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca80b60a0 msgr2=0x7fcca8142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:03.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca77fe640 1 --2- 172.21.15.43:0/4015022322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca80b60a0 0x7fcca8142ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca77fe640 1 -- 172.21.15.43:0/4015022322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca81dfc50 con 0x7fcca8070eb0 2024-04-24T23:08:03.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca7fff640 1 --2- 172.21.15.43:0/4015022322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca80b60a0 0x7fcca8142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:03.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcca77fe640 1 --2- 172.21.15.43:0/4015022322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcca8070eb0 0x7fcca81e0430 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800c7f0 tx=0x7fcc9800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:03.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcc8ffff640 1 -- 172.21.15.43:0/4015022322 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc98015070 con 0x7fcca8070eb0 2024-04-24T23:08:03.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcc8ffff640 1 -- 172.21.15.43:0/4015022322 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc98007820 con 0x7fcca8070eb0 2024-04-24T23:08:03.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 -- 172.21.15.43:0/4015022322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca8148030 con 0x7fcca8070eb0 2024-04-24T23:08:03.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fcc8ffff640 1 -- 172.21.15.43:0/4015022322 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc98007c10 con 0x7fcca8070eb0 2024-04-24T23:08:03.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.610+0000 7fccae201640 1 -- 172.21.15.43:0/4015022322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca81482f0 con 0x7fcca8070eb0 2024-04-24T23:08:03.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.614+0000 7fccae201640 1 -- 172.21.15.43:0/4015022322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca804f580 con 0x7fcca8070eb0 2024-04-24T23:08:03.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.614+0000 7fcc8ffff640 1 -- 172.21.15.43:0/4015022322 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcc98018070 con 0x7fcca8070eb0 2024-04-24T23:08:03.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.614+0000 7fcc8ffff640 1 --2- 172.21.15.43:0/4015022322 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcc940678c0 0x7fcc94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:03.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.614+0000 7fcc8ffff640 1 -- 172.21.15.43:0/4015022322 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fcc98086420 con 0x7fcca8070eb0 2024-04-24T23:08:03.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.614+0000 7fcca6ffd640 1 --2- 172.21.15.43:0/4015022322 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcc940678c0 0x7fcc94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:03.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.614+0000 7fcca6ffd640 1 --2- 172.21.15.43:0/4015022322 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcc940678c0 0x7fcc94069d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0ae000 tx=0x7fcc9c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:03.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.618+0000 7fcc8ffff640 1 -- 172.21.15.43:0/4015022322 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fcc98056d00 con 0x7fcca8070eb0 2024-04-24T23:08:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.774+0000 7fccae201640 1 -- 172.21.15.43:0/4015022322 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcca8151c30 con 0x7fcc940678c0 2024-04-24T23:08:03.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.798+0000 7fcc8ffff640 1 -- 172.21.15.43:0/4015022322 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335032 (secure 0 0 0) 0x7fcca8151c30 con 0x7fcc940678c0 2024-04-24T23:08:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:08:03.806 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-24T23:08:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.802+0000 7fccae201640 1 -- 172.21.15.43:0/4015022322 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcc940678c0 msgr2=0x7fcc94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.802+0000 7fccae201640 1 --2- 172.21.15.43:0/4015022322 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcc940678c0 0x7fcc94069d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0ae000 tx=0x7fcc9c0a7000 comp rx=0 tx=0).stop 2024-04-24T23:08:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.802+0000 7fccae201640 1 -- 172.21.15.43:0/4015022322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcca8070eb0 msgr2=0x7fcca81e0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.802+0000 7fccae201640 1 --2- 172.21.15.43:0/4015022322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcca8070eb0 0x7fcca81e0430 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800c7f0 tx=0x7fcc9800ccb0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.802+0000 7fccae201640 1 -- 172.21.15.43:0/4015022322 shutdown_connections 2024-04-24T23:08:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.802+0000 7fccae201640 1 --2- 172.21.15.43:0/4015022322 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fcc940678c0 0x7fcc94069d80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.802+0000 7fccae201640 1 --2- 172.21.15.43:0/4015022322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca80b60a0 0x7fcca8142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.802+0000 7fccae201640 1 --2- 172.21.15.43:0/4015022322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcca80b56a0 0x7fcca81427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.802+0000 7fccae201640 1 --2- 172.21.15.43:0/4015022322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcca8070eb0 0x7fcca81e0430 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.802+0000 7fccae201640 1 -- 172.21.15.43:0/4015022322 >> 172.21.15.43:0/4015022322 conn(0x7fcca806c300 msgr2=0x7fcca80b8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.802+0000 7fccae201640 1 -- 172.21.15.43:0/4015022322 shutdown_connections 2024-04-24T23:08:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.802+0000 7fccae201640 1 -- 172.21.15.43:0/4015022322 wait complete. 2024-04-24T23:08:03.821 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2024-04-24T23:08:02.387705+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":156625618,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":1258,"num_read_kb":1896,"num_write":71335,"num_write_kb":667060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65744,"ondisk_log_size":65744,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":900704,"kb_used_data":87904,"kb_used_omap":12,"kb_used_meta":812723,"kb_avail":754074016,"statfs":{"total":773094113280,"available":772171792384,"internally_reserved":0,"allocated":90013696,"data_stored":314174708,"data_compressed":57780696,"data_compressed_allocated":71680000,"data_compressed_original":297246720,"omap_allocated":12752,"internal_metadata":832228912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,7,5,6],"upper_bound":32},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-41100661,"num_objects":-4539,"num_object_clones":0,"num_object_copies":-13642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4539,"num_whiteouts":0,"num_read":25,"num_read_kb":247,"num_write":4668,"num_write_kb":6239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-108,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003511"},"pg_stats":[{"pgid":"2.1f","version":"27'518","reported_seq":547,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:50.667654+0000","last_change":"2024-04-24T23:00:15.425241+0000","last_active":"2024-04-24T23:07:50.667654+0000","last_peered":"2024-04-24T23:07:50.667654+0000","last_clean":"2024-04-24T23:07:50.667654+0000","last_became_active":"2024-04-24T23:00:15.417152+0000","last_became_peered":"2024-04-24T23:00:15.417152+0000","last_unstale":"2024-04-24T23:07:50.667654+0000","last_undegraded":"2024-04-24T23:07:50.667654+0000","last_fullsized":"2024-04-24T23:07:50.667654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":574,"num_write_kb":8831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'309","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.055031+0000","last_change":"2024-04-24T23:00:16.450360+0000","last_active":"2024-04-24T23:07:55.055031+0000","last_peered":"2024-04-24T23:07:55.055031+0000","last_clean":"2024-04-24T23:07:55.055031+0000","last_became_active":"2024-04-24T23:00:16.449631+0000","last_became_peered":"2024-04-24T23:00:16.449631+0000","last_unstale":"2024-04-24T23:07:55.055031+0000","last_undegraded":"2024-04-24T23:07:55.055031+0000","last_fullsized":"2024-04-24T23:07:55.055031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:03:09.773642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'1014","reported_seq":1035,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.824046+0000","last_change":"2024-04-24T23:00:20.537107+0000","last_active":"2024-04-24T23:07:55.824046+0000","last_peered":"2024-04-24T23:07:55.824046+0000","last_clean":"2024-04-24T23:07:55.824046+0000","last_became_active":"2024-04-24T23:00:20.535916+0000","last_became_peered":"2024-04-24T23:00:20.535916+0000","last_unstale":"2024-04-24T23:07:55.824046+0000","last_undegraded":"2024-04-24T23:07:55.824046+0000","last_fullsized":"2024-04-24T23:07:55.824046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1014,"log_dups_size":0,"ondisk_log_size":1014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.364772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":7177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'578","reported_seq":607,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.796855+0000","last_change":"2024-04-24T23:00:15.418251+0000","last_active":"2024-04-24T23:07:54.796855+0000","last_peered":"2024-04-24T23:07:54.796855+0000","last_clean":"2024-04-24T23:07:54.796855+0000","last_became_active":"2024-04-24T23:00:15.417502+0000","last_became_peered":"2024-04-24T23:00:15.417502+0000","last_unstale":"2024-04-24T23:07:54.796855+0000","last_undegraded":"2024-04-24T23:07:54.796855+0000","last_fullsized":"2024-04-24T23:07:54.796855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:50:53.490837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":611,"num_write_kb":25054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'282","reported_seq":309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.912926+0000","last_change":"2024-04-24T23:00:16.452960+0000","last_active":"2024-04-24T23:07:54.912926+0000","last_peered":"2024-04-24T23:07:54.912926+0000","last_clean":"2024-04-24T23:07:54.912926+0000","last_became_active":"2024-04-24T23:00:16.452212+0000","last_became_peered":"2024-04-24T23:00:16.452212+0000","last_unstale":"2024-04-24T23:07:54.912926+0000","last_undegraded":"2024-04-24T23:07:54.912926+0000","last_fullsized":"2024-04-24T23:07:54.912926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:26.361607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'1050","reported_seq":1071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.855066+0000","last_change":"2024-04-24T23:00:20.518435+0000","last_active":"2024-04-24T23:07:55.855066+0000","last_peered":"2024-04-24T23:07:55.855066+0000","last_clean":"2024-04-24T23:07:55.855066+0000","last_became_active":"2024-04-24T23:00:20.517975+0000","last_became_peered":"2024-04-24T23:00:20.517975+0000","last_unstale":"2024-04-24T23:07:55.855066+0000","last_undegraded":"2024-04-24T23:07:55.855066+0000","last_fullsized":"2024-04-24T23:07:55.855066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1050,"log_dups_size":0,"ondisk_log_size":1050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:36.410688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":6799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1034","reported_seq":1063,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:46.942698+0000","last_change":"2024-04-24T23:00:15.401804+0000","last_active":"2024-04-24T23:07:46.942698+0000","last_peered":"2024-04-24T23:07:46.942698+0000","last_clean":"2024-04-24T23:07:46.942698+0000","last_became_active":"2024-04-24T23:00:15.400064+0000","last_became_peered":"2024-04-24T23:00:15.400064+0000","last_unstale":"2024-04-24T23:07:46.942698+0000","last_undegraded":"2024-04-24T23:07:46.942698+0000","last_fullsized":"2024-04-24T23:07:46.942698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1034,"log_dups_size":0,"ondisk_log_size":1034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:26.588514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":1068,"num_write_kb":29480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'280","reported_seq":307,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.847890+0000","last_change":"2024-04-24T23:00:16.451873+0000","last_active":"2024-04-24T23:07:55.847890+0000","last_peered":"2024-04-24T23:07:55.847890+0000","last_clean":"2024-04-24T23:07:55.847890+0000","last_became_active":"2024-04-24T23:00:16.451601+0000","last_became_peered":"2024-04-24T23:00:16.451601+0000","last_unstale":"2024-04-24T23:07:55.847890+0000","last_undegraded":"2024-04-24T23:07:55.847890+0000","last_fullsized":"2024-04-24T23:07:55.847890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:14.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'993","reported_seq":1014,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.901309+0000","last_change":"2024-04-24T23:00:20.518757+0000","last_active":"2024-04-24T23:07:55.901309+0000","last_peered":"2024-04-24T23:07:55.901309+0000","last_clean":"2024-04-24T23:07:55.901309+0000","last_became_active":"2024-04-24T23:00:20.518002+0000","last_became_peered":"2024-04-24T23:00:20.518002+0000","last_unstale":"2024-04-24T23:07:55.901309+0000","last_undegraded":"2024-04-24T23:07:55.901309+0000","last_fullsized":"2024-04-24T23:07:55.901309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":6590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'200","reported_seq":229,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.779438+0000","last_change":"2024-04-24T23:00:15.398338+0000","last_active":"2024-04-24T23:07:54.779438+0000","last_peered":"2024-04-24T23:07:54.779438+0000","last_clean":"2024-04-24T23:07:54.779438+0000","last_became_active":"2024-04-24T23:00:15.395766+0000","last_became_peered":"2024-04-24T23:00:15.395766+0000","last_unstale":"2024-04-24T23:07:54.779438+0000","last_undegraded":"2024-04-24T23:07:54.779438+0000","last_fullsized":"2024-04-24T23:07:54.779438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:30.228280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":248,"num_write_kb":4421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'284","reported_seq":310,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.808339+0000","last_change":"2024-04-24T23:00:16.458641+0000","last_active":"2024-04-24T23:07:55.808339+0000","last_peered":"2024-04-24T23:07:55.808339+0000","last_clean":"2024-04-24T23:07:55.808339+0000","last_became_active":"2024-04-24T23:00:16.458237+0000","last_became_peered":"2024-04-24T23:00:16.458237+0000","last_unstale":"2024-04-24T23:07:55.808339+0000","last_undegraded":"2024-04-24T23:07:55.808339+0000","last_fullsized":"2024-04-24T23:07:55.808339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:22:17.631542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'1016","reported_seq":1044,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.883278+0000","last_change":"2024-04-24T23:00:57.665634+0000","last_active":"2024-04-24T23:07:55.883278+0000","last_peered":"2024-04-24T23:07:55.883278+0000","last_clean":"2024-04-24T23:07:55.883278+0000","last_became_active":"2024-04-24T23:00:57.664750+0000","last_became_peered":"2024-04-24T23:00:57.664750+0000","last_unstale":"2024-04-24T23:07:55.883278+0000","last_undegraded":"2024-04-24T23:07:55.883278+0000","last_fullsized":"2024-04-24T23:07:55.883278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:13.007846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":6657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,4],"acting":[2,6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'321","reported_seq":347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.852235+0000","last_change":"2024-04-24T23:00:16.448014+0000","last_active":"2024-04-24T23:07:55.852235+0000","last_peered":"2024-04-24T23:07:55.852235+0000","last_clean":"2024-04-24T23:07:55.852235+0000","last_became_active":"2024-04-24T23:00:16.447488+0000","last_became_peered":"2024-04-24T23:00:16.447488+0000","last_unstale":"2024-04-24T23:07:55.852235+0000","last_undegraded":"2024-04-24T23:07:55.852235+0000","last_fullsized":"2024-04-24T23:07:55.852235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:29.852278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'770","reported_seq":798,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.111019+0000","last_change":"2024-04-24T23:00:15.408781+0000","last_active":"2024-04-24T23:07:55.111019+0000","last_peered":"2024-04-24T23:07:55.111019+0000","last_clean":"2024-04-24T23:07:55.111019+0000","last_became_active":"2024-04-24T23:00:15.408120+0000","last_became_peered":"2024-04-24T23:00:15.408120+0000","last_unstale":"2024-04-24T23:07:55.111019+0000","last_undegraded":"2024-04-24T23:07:55.111019+0000","last_fullsized":"2024-04-24T23:07:55.111019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:38.560562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":817,"num_write_kb":21262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'991","reported_seq":1012,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.825524+0000","last_change":"2024-04-24T23:00:20.503964+0000","last_active":"2024-04-24T23:07:55.825524+0000","last_peered":"2024-04-24T23:07:55.825524+0000","last_clean":"2024-04-24T23:07:55.825524+0000","last_became_active":"2024-04-24T23:00:20.501703+0000","last_became_peered":"2024-04-24T23:00:20.501703+0000","last_unstale":"2024-04-24T23:07:55.825524+0000","last_undegraded":"2024-04-24T23:07:55.825524+0000","last_fullsized":"2024-04-24T23:07:55.825524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:40.258673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":7022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'329","reported_seq":356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.813960+0000","last_change":"2024-04-24T23:00:16.472987+0000","last_active":"2024-04-24T23:07:55.813960+0000","last_peered":"2024-04-24T23:07:55.813960+0000","last_clean":"2024-04-24T23:07:55.813960+0000","last_became_active":"2024-04-24T23:00:16.472226+0000","last_became_peered":"2024-04-24T23:00:16.472226+0000","last_unstale":"2024-04-24T23:07:55.813960+0000","last_undegraded":"2024-04-24T23:07:55.813960+0000","last_fullsized":"2024-04-24T23:07:55.813960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":260,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'309","reported_seq":338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:49.727569+0000","last_change":"2024-04-24T23:00:15.422963+0000","last_active":"2024-04-24T23:07:49.727569+0000","last_peered":"2024-04-24T23:07:49.727569+0000","last_clean":"2024-04-24T23:07:49.727569+0000","last_became_active":"2024-04-24T23:00:15.422121+0000","last_became_peered":"2024-04-24T23:00:15.422121+0000","last_unstale":"2024-04-24T23:07:49.727569+0000","last_undegraded":"2024-04-24T23:07:49.727569+0000","last_fullsized":"2024-04-24T23:07:49.727569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":340,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'1105","reported_seq":1126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.852798+0000","last_change":"2024-04-24T23:00:20.540688+0000","last_active":"2024-04-24T23:07:55.852798+0000","last_peered":"2024-04-24T23:07:55.852798+0000","last_clean":"2024-04-24T23:07:55.852798+0000","last_became_active":"2024-04-24T23:00:20.540220+0000","last_became_peered":"2024-04-24T23:00:20.540220+0000","last_unstale":"2024-04-24T23:07:55.852798+0000","last_undegraded":"2024-04-24T23:07:55.852798+0000","last_fullsized":"2024-04-24T23:07:55.852798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:33.931661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1391,"num_write_kb":7499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'328","reported_seq":355,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.884330+0000","last_change":"2024-04-24T23:00:16.488633+0000","last_active":"2024-04-24T23:07:55.884330+0000","last_peered":"2024-04-24T23:07:55.884330+0000","last_clean":"2024-04-24T23:07:55.884330+0000","last_became_active":"2024-04-24T23:00:16.487476+0000","last_became_peered":"2024-04-24T23:00:16.487476+0000","last_unstale":"2024-04-24T23:07:55.884330+0000","last_undegraded":"2024-04-24T23:07:55.884330+0000","last_fullsized":"2024-04-24T23:07:55.884330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:06.907656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'215","reported_seq":244,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.745513+0000","last_change":"2024-04-24T23:00:15.397973+0000","last_active":"2024-04-24T23:07:53.745513+0000","last_peered":"2024-04-24T23:07:53.745513+0000","last_clean":"2024-04-24T23:07:53.745513+0000","last_became_active":"2024-04-24T23:00:15.396600+0000","last_became_peered":"2024-04-24T23:00:15.396600+0000","last_unstale":"2024-04-24T23:07:53.745513+0000","last_undegraded":"2024-04-24T23:07:53.745513+0000","last_fullsized":"2024-04-24T23:07:53.745513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:22.932046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":224,"num_write_kb":12479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'989","reported_seq":1010,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.895864+0000","last_change":"2024-04-24T23:00:20.511547+0000","last_active":"2024-04-24T23:07:55.895864+0000","last_peered":"2024-04-24T23:07:55.895864+0000","last_clean":"2024-04-24T23:07:55.895864+0000","last_became_active":"2024-04-24T23:00:20.510602+0000","last_became_peered":"2024-04-24T23:00:20.510602+0000","last_unstale":"2024-04-24T23:07:55.895864+0000","last_undegraded":"2024-04-24T23:07:55.895864+0000","last_fullsized":"2024-04-24T23:07:55.895864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:17.847434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1239,"num_write_kb":6767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'347","reported_seq":373,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.821370+0000","last_change":"2024-04-24T23:00:16.483393+0000","last_active":"2024-04-24T23:07:55.821370+0000","last_peered":"2024-04-24T23:07:55.821370+0000","last_clean":"2024-04-24T23:07:55.821370+0000","last_became_active":"2024-04-24T23:00:16.483092+0000","last_became_peered":"2024-04-24T23:00:16.483092+0000","last_unstale":"2024-04-24T23:07:55.821370+0000","last_undegraded":"2024-04-24T23:07:55.821370+0000","last_fullsized":"2024-04-24T23:07:55.821370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:38.429072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'273","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.888601+0000","last_change":"2024-04-24T23:00:15.398005+0000","last_active":"2024-04-24T23:07:54.888601+0000","last_peered":"2024-04-24T23:07:54.888601+0000","last_clean":"2024-04-24T23:07:54.888601+0000","last_became_active":"2024-04-24T23:00:15.397638+0000","last_became_peered":"2024-04-24T23:00:15.397638+0000","last_unstale":"2024-04-24T23:07:54.888601+0000","last_undegraded":"2024-04-24T23:07:54.888601+0000","last_fullsized":"2024-04-24T23:07:54.888601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":320,"num_write_kb":4474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'934","reported_seq":955,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.854383+0000","last_change":"2024-04-24T23:00:20.505995+0000","last_active":"2024-04-24T23:07:55.854383+0000","last_peered":"2024-04-24T23:07:55.854383+0000","last_clean":"2024-04-24T23:07:55.854383+0000","last_became_active":"2024-04-24T23:00:20.505532+0000","last_became_peered":"2024-04-24T23:00:20.505532+0000","last_unstale":"2024-04-24T23:07:55.854383+0000","last_undegraded":"2024-04-24T23:07:55.854383+0000","last_fullsized":"2024-04-24T23:07:55.854383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:42.508455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":6588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'326","reported_seq":353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.820109+0000","last_change":"2024-04-24T23:00:16.484306+0000","last_active":"2024-04-24T23:07:55.820109+0000","last_peered":"2024-04-24T23:07:55.820109+0000","last_clean":"2024-04-24T23:07:55.820109+0000","last_became_active":"2024-04-24T23:00:16.483585+0000","last_became_peered":"2024-04-24T23:00:16.483585+0000","last_unstale":"2024-04-24T23:07:55.820109+0000","last_undegraded":"2024-04-24T23:07:55.820109+0000","last_fullsized":"2024-04-24T23:07:55.820109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:53.051451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'156","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.717711+0000","last_change":"2024-04-24T23:00:15.421158+0000","last_active":"2024-04-24T23:07:53.717711+0000","last_peered":"2024-04-24T23:07:53.717711+0000","last_clean":"2024-04-24T23:07:53.717711+0000","last_became_active":"2024-04-24T23:00:15.420839+0000","last_became_peered":"2024-04-24T23:00:15.420839+0000","last_unstale":"2024-04-24T23:07:53.717711+0000","last_undegraded":"2024-04-24T23:07:53.717711+0000","last_fullsized":"2024-04-24T23:07:53.717711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:03.276247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":209,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'1029","reported_seq":1050,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.904843+0000","last_change":"2024-04-24T23:00:20.519755+0000","last_active":"2024-04-24T23:07:55.904843+0000","last_peered":"2024-04-24T23:07:55.904843+0000","last_clean":"2024-04-24T23:07:55.904843+0000","last_became_active":"2024-04-24T23:00:20.518470+0000","last_became_peered":"2024-04-24T23:00:20.518470+0000","last_unstale":"2024-04-24T23:07:55.904843+0000","last_undegraded":"2024-04-24T23:07:55.904843+0000","last_fullsized":"2024-04-24T23:07:55.904843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:14.639189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":7455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'286","reported_seq":313,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.822901+0000","last_change":"2024-04-24T23:00:16.464487+0000","last_active":"2024-04-24T23:07:55.822901+0000","last_peered":"2024-04-24T23:07:55.822901+0000","last_clean":"2024-04-24T23:07:55.822901+0000","last_became_active":"2024-04-24T23:00:16.463565+0000","last_became_peered":"2024-04-24T23:00:16.463565+0000","last_unstale":"2024-04-24T23:07:55.822901+0000","last_undegraded":"2024-04-24T23:07:55.822901+0000","last_fullsized":"2024-04-24T23:07:55.822901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'444","reported_seq":473,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:56.114315+0000","last_change":"2024-04-24T23:00:15.400228+0000","last_active":"2024-04-24T23:07:56.114315+0000","last_peered":"2024-04-24T23:07:56.114315+0000","last_clean":"2024-04-24T23:07:56.114315+0000","last_became_active":"2024-04-24T23:00:15.397465+0000","last_became_peered":"2024-04-24T23:00:15.397465+0000","last_unstale":"2024-04-24T23:07:56.114315+0000","last_undegraded":"2024-04-24T23:07:56.114315+0000","last_fullsized":"2024-04-24T23:07:56.114315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7891308,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1194,"num_write_kb":9205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'1049","reported_seq":1070,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.906567+0000","last_change":"2024-04-24T23:00:20.516766+0000","last_active":"2024-04-24T23:07:55.906567+0000","last_peered":"2024-04-24T23:07:55.906567+0000","last_clean":"2024-04-24T23:07:55.906567+0000","last_became_active":"2024-04-24T23:00:20.515972+0000","last_became_peered":"2024-04-24T23:00:20.515972+0000","last_unstale":"2024-04-24T23:07:55.906567+0000","last_undegraded":"2024-04-24T23:07:55.906567+0000","last_fullsized":"2024-04-24T23:07:55.906567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1319,"num_write_kb":7165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'291","reported_seq":318,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.817277+0000","last_change":"2024-04-24T23:00:16.480627+0000","last_active":"2024-04-24T23:07:55.817277+0000","last_peered":"2024-04-24T23:07:55.817277+0000","last_clean":"2024-04-24T23:07:55.817277+0000","last_became_active":"2024-04-24T23:00:16.480021+0000","last_became_peered":"2024-04-24T23:00:16.480021+0000","last_unstale":"2024-04-24T23:07:55.817277+0000","last_undegraded":"2024-04-24T23:07:55.817277+0000","last_fullsized":"2024-04-24T23:07:55.817277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:04.285389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'297","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:44.623630+0000","last_change":"2024-04-24T23:00:15.428375+0000","last_active":"2024-04-24T23:07:44.623630+0000","last_peered":"2024-04-24T23:07:44.623630+0000","last_clean":"2024-04-24T23:07:44.623630+0000","last_became_active":"2024-04-24T23:00:15.428016+0000","last_became_peered":"2024-04-24T23:00:15.428016+0000","last_unstale":"2024-04-24T23:07:44.623630+0000","last_undegraded":"2024-04-24T23:07:44.623630+0000","last_fullsized":"2024-04-24T23:07:44.623630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:24.759195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":311,"num_write_kb":16738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'1004","reported_seq":1025,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.826119+0000","last_change":"2024-04-24T23:00:20.535274+0000","last_active":"2024-04-24T23:07:55.826119+0000","last_peered":"2024-04-24T23:07:55.826119+0000","last_clean":"2024-04-24T23:07:55.826119+0000","last_became_active":"2024-04-24T23:00:20.524747+0000","last_became_peered":"2024-04-24T23:00:20.524747+0000","last_unstale":"2024-04-24T23:07:55.826119+0000","last_undegraded":"2024-04-24T23:07:55.826119+0000","last_fullsized":"2024-04-24T23:07:55.826119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.814128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1252,"num_write_kb":7166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'314","reported_seq":340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.879978+0000","last_change":"2024-04-24T23:00:16.456641+0000","last_active":"2024-04-24T23:07:55.879978+0000","last_peered":"2024-04-24T23:07:55.879978+0000","last_clean":"2024-04-24T23:07:55.879978+0000","last_became_active":"2024-04-24T23:00:16.456268+0000","last_became_peered":"2024-04-24T23:00:16.456268+0000","last_unstale":"2024-04-24T23:07:55.879978+0000","last_undegraded":"2024-04-24T23:07:55.879978+0000","last_fullsized":"2024-04-24T23:07:55.879978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'112","reported_seq":141,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.896251+0000","last_change":"2024-04-24T23:00:15.429119+0000","last_active":"2024-04-24T23:07:54.896251+0000","last_peered":"2024-04-24T23:07:54.896251+0000","last_clean":"2024-04-24T23:07:54.896251+0000","last_became_active":"2024-04-24T23:00:15.428374+0000","last_became_peered":"2024-04-24T23:00:15.428374+0000","last_unstale":"2024-04-24T23:07:54.896251+0000","last_undegraded":"2024-04-24T23:07:54.896251+0000","last_fullsized":"2024-04-24T23:07:54.896251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:13:30.412685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":161,"num_write_kb":4386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'1030","reported_seq":1051,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.864947+0000","last_change":"2024-04-24T23:00:20.535730+0000","last_active":"2024-04-24T23:07:55.864947+0000","last_peered":"2024-04-24T23:07:55.864947+0000","last_clean":"2024-04-24T23:07:55.864947+0000","last_became_active":"2024-04-24T23:00:20.534430+0000","last_became_peered":"2024-04-24T23:00:20.534430+0000","last_unstale":"2024-04-24T23:07:55.864947+0000","last_undegraded":"2024-04-24T23:07:55.864947+0000","last_fullsized":"2024-04-24T23:07:55.864947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:35.156511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1288,"num_write_kb":6636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'309","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.767711+0000","last_change":"2024-04-24T23:00:16.444070+0000","last_active":"2024-04-24T23:07:55.767711+0000","last_peered":"2024-04-24T23:07:55.767711+0000","last_clean":"2024-04-24T23:07:55.767711+0000","last_became_active":"2024-04-24T23:00:16.443620+0000","last_became_peered":"2024-04-24T23:00:16.443620+0000","last_unstale":"2024-04-24T23:07:55.767711+0000","last_undegraded":"2024-04-24T23:07:55.767711+0000","last_fullsized":"2024-04-24T23:07:55.767711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:31.077128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'510","reported_seq":538,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:49.798261+0000","last_change":"2024-04-24T23:00:15.422571+0000","last_active":"2024-04-24T23:07:49.798261+0000","last_peered":"2024-04-24T23:07:49.798261+0000","last_clean":"2024-04-24T23:07:49.798261+0000","last_became_active":"2024-04-24T23:00:15.422167+0000","last_became_peered":"2024-04-24T23:00:15.422167+0000","last_unstale":"2024-04-24T23:07:49.798261+0000","last_undegraded":"2024-04-24T23:07:49.798261+0000","last_fullsized":"2024-04-24T23:07:49.798261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:29.417228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":552,"num_write_kb":25017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'943","reported_seq":964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.834843+0000","last_change":"2024-04-24T23:00:20.540587+0000","last_active":"2024-04-24T23:07:55.834843+0000","last_peered":"2024-04-24T23:07:55.834843+0000","last_clean":"2024-04-24T23:07:55.834843+0000","last_became_active":"2024-04-24T23:00:20.524719+0000","last_became_peered":"2024-04-24T23:00:20.524719+0000","last_unstale":"2024-04-24T23:07:55.834843+0000","last_undegraded":"2024-04-24T23:07:55.834843+0000","last_fullsized":"2024-04-24T23:07:55.834843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'312","reported_seq":339,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.900068+0000","last_change":"2024-04-24T23:00:16.471678+0000","last_active":"2024-04-24T23:07:55.900068+0000","last_peered":"2024-04-24T23:07:55.900068+0000","last_clean":"2024-04-24T23:07:55.900068+0000","last_became_active":"2024-04-24T23:00:16.469390+0000","last_became_peered":"2024-04-24T23:00:16.469390+0000","last_unstale":"2024-04-24T23:07:55.900068+0000","last_undegraded":"2024-04-24T23:07:55.900068+0000","last_fullsized":"2024-04-24T23:07:55.900068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:31:59.778549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'887","reported_seq":1585,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:56.723481+0000","last_change":"2024-04-24T23:00:15.423024+0000","last_active":"2024-04-24T23:07:56.723481+0000","last_peered":"2024-04-24T23:07:56.723481+0000","last_clean":"2024-04-24T23:07:56.723481+0000","last_became_active":"2024-04-24T23:00:15.422275+0000","last_became_peered":"2024-04-24T23:00:15.422275+0000","last_unstale":"2024-04-24T23:07:56.723481+0000","last_undegraded":"2024-04-24T23:07:56.723481+0000","last_fullsized":"2024-04-24T23:07:56.723481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9730440,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":691,"num_read_kb":1796,"num_write":947,"num_write_kb":14533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'1020","reported_seq":1041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.845109+0000","last_change":"2024-04-24T23:00:20.535131+0000","last_active":"2024-04-24T23:07:55.845109+0000","last_peered":"2024-04-24T23:07:55.845109+0000","last_clean":"2024-04-24T23:07:55.845109+0000","last_became_active":"2024-04-24T23:00:20.534325+0000","last_became_peered":"2024-04-24T23:00:20.534325+0000","last_unstale":"2024-04-24T23:07:55.845109+0000","last_undegraded":"2024-04-24T23:07:55.845109+0000","last_fullsized":"2024-04-24T23:07:55.845109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1281,"num_write_kb":6595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'298","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.827749+0000","last_change":"2024-04-24T23:00:16.451991+0000","last_active":"2024-04-24T23:07:55.827749+0000","last_peered":"2024-04-24T23:07:55.827749+0000","last_clean":"2024-04-24T23:07:55.827749+0000","last_became_active":"2024-04-24T23:00:16.451226+0000","last_became_peered":"2024-04-24T23:00:16.451226+0000","last_unstale":"2024-04-24T23:07:55.827749+0000","last_undegraded":"2024-04-24T23:07:55.827749+0000","last_fullsized":"2024-04-24T23:07:55.827749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:30.426371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'647","reported_seq":675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:51.887360+0000","last_change":"2024-04-24T23:00:15.414535+0000","last_active":"2024-04-24T23:07:51.887360+0000","last_peered":"2024-04-24T23:07:51.887360+0000","last_clean":"2024-04-24T23:07:51.887360+0000","last_became_active":"2024-04-24T23:00:15.414224+0000","last_became_peered":"2024-04-24T23:00:15.414224+0000","last_unstale":"2024-04-24T23:07:51.887360+0000","last_undegraded":"2024-04-24T23:07:51.887360+0000","last_fullsized":"2024-04-24T23:07:51.887360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:30.228280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":698,"num_write_kb":16967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'1115","reported_seq":1136,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.885451+0000","last_change":"2024-04-24T23:00:20.531159+0000","last_active":"2024-04-24T23:07:55.885451+0000","last_peered":"2024-04-24T23:07:55.885451+0000","last_clean":"2024-04-24T23:07:55.885451+0000","last_became_active":"2024-04-24T23:00:20.530682+0000","last_became_peered":"2024-04-24T23:00:20.530682+0000","last_unstale":"2024-04-24T23:07:55.885451+0000","last_undegraded":"2024-04-24T23:07:55.885451+0000","last_fullsized":"2024-04-24T23:07:55.885451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:45.629364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1380,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'286","reported_seq":313,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.032733+0000","last_change":"2024-04-24T23:00:16.481649+0000","last_active":"2024-04-24T23:07:55.032733+0000","last_peered":"2024-04-24T23:07:55.032733+0000","last_clean":"2024-04-24T23:07:55.032733+0000","last_became_active":"2024-04-24T23:00:16.477192+0000","last_became_peered":"2024-04-24T23:00:16.477192+0000","last_unstale":"2024-04-24T23:07:55.032733+0000","last_undegraded":"2024-04-24T23:07:55.032733+0000","last_fullsized":"2024-04-24T23:07:55.032733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:13.768051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'170","reported_seq":198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:38.824463+0000","last_change":"2024-04-24T23:00:15.407927+0000","last_active":"2024-04-24T23:07:38.824463+0000","last_peered":"2024-04-24T23:07:38.824463+0000","last_clean":"2024-04-24T23:07:38.824463+0000","last_became_active":"2024-04-24T23:00:15.407609+0000","last_became_peered":"2024-04-24T23:00:15.407609+0000","last_unstale":"2024-04-24T23:07:38.824463+0000","last_undegraded":"2024-04-24T23:07:38.824463+0000","last_fullsized":"2024-04-24T23:07:38.824463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:13.689340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":211,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:04:03.322959+0000","last_change":"2024-04-24T23:00:03.344529+0000","last_active":"2024-04-24T23:04:03.322959+0000","last_peered":"2024-04-24T23:04:03.322959+0000","last_clean":"2024-04-24T23:04:03.322959+0000","last_became_active":"2024-04-24T23:00:03.344074+0000","last_became_peered":"2024-04-24T23:00:03.344074+0000","last_unstale":"2024-04-24T23:04:03.322959+0000","last_undegraded":"2024-04-24T23:04:03.322959+0000","last_fullsized":"2024-04-24T23:04:03.322959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:02.322380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:02.322380+0000","last_clean_scrub_stamp":"2024-04-24T23:00:02.322380+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:40.550881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'994","reported_seq":1009,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.887079+0000","last_change":"2024-04-24T23:00:57.865441+0000","last_active":"2024-04-24T23:07:55.887079+0000","last_peered":"2024-04-24T23:07:55.887079+0000","last_clean":"2024-04-24T23:07:55.887079+0000","last_became_active":"2024-04-24T23:00:57.864235+0000","last_became_peered":"2024-04-24T23:00:57.864235+0000","last_unstale":"2024-04-24T23:07:55.887079+0000","last_undegraded":"2024-04-24T23:07:55.887079+0000","last_fullsized":"2024-04-24T23:07:55.887079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":994,"log_dups_size":0,"ondisk_log_size":994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:54.068285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1231,"num_write_kb":6895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2,0],"acting":[5,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"27'310","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.824018+0000","last_change":"2024-04-24T23:00:16.448759+0000","last_active":"2024-04-24T23:07:55.824018+0000","last_peered":"2024-04-24T23:07:55.824018+0000","last_clean":"2024-04-24T23:07:55.824018+0000","last_became_active":"2024-04-24T23:00:16.448187+0000","last_became_peered":"2024-04-24T23:00:16.448187+0000","last_unstale":"2024-04-24T23:07:55.824018+0000","last_undegraded":"2024-04-24T23:07:55.824018+0000","last_fullsized":"2024-04-24T23:07:55.824018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:08:59.708506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'231","reported_seq":260,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:42.632794+0000","last_change":"2024-04-24T23:00:15.436270+0000","last_active":"2024-04-24T23:07:42.632794+0000","last_peered":"2024-04-24T23:07:42.632794+0000","last_clean":"2024-04-24T23:07:42.632794+0000","last_became_active":"2024-04-24T23:00:15.425134+0000","last_became_peered":"2024-04-24T23:00:15.425134+0000","last_unstale":"2024-04-24T23:07:42.632794+0000","last_undegraded":"2024-04-24T23:07:42.632794+0000","last_fullsized":"2024-04-24T23:07:42.632794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":252,"num_write_kb":12509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'1044","reported_seq":1065,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.887165+0000","last_change":"2024-04-24T23:00:20.500617+0000","last_active":"2024-04-24T23:07:55.887165+0000","last_peered":"2024-04-24T23:07:55.887165+0000","last_clean":"2024-04-24T23:07:55.887165+0000","last_became_active":"2024-04-24T23:00:20.500158+0000","last_became_peered":"2024-04-24T23:00:20.500158+0000","last_unstale":"2024-04-24T23:07:55.887165+0000","last_undegraded":"2024-04-24T23:07:55.887165+0000","last_fullsized":"2024-04-24T23:07:55.887165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1044,"log_dups_size":0,"ondisk_log_size":1044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.814128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1291,"num_write_kb":7061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'343","reported_seq":370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.847367+0000","last_change":"2024-04-24T23:00:16.471754+0000","last_active":"2024-04-24T23:07:55.847367+0000","last_peered":"2024-04-24T23:07:55.847367+0000","last_clean":"2024-04-24T23:07:55.847367+0000","last_became_active":"2024-04-24T23:00:16.471497+0000","last_became_peered":"2024-04-24T23:00:16.471497+0000","last_unstale":"2024-04-24T23:07:55.847367+0000","last_undegraded":"2024-04-24T23:07:55.847367+0000","last_fullsized":"2024-04-24T23:07:55.847367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:27.760709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'523","reported_seq":552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:46.767969+0000","last_change":"2024-04-24T23:00:15.406401+0000","last_active":"2024-04-24T23:07:46.767969+0000","last_peered":"2024-04-24T23:07:46.767969+0000","last_clean":"2024-04-24T23:07:46.767969+0000","last_became_active":"2024-04-24T23:00:15.405636+0000","last_became_peered":"2024-04-24T23:00:15.405636+0000","last_unstale":"2024-04-24T23:07:46.767969+0000","last_undegraded":"2024-04-24T23:07:46.767969+0000","last_fullsized":"2024-04-24T23:07:46.767969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:02.654515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":558,"num_write_kb":25209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'1010","reported_seq":1031,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.846057+0000","last_change":"2024-04-24T23:00:20.502050+0000","last_active":"2024-04-24T23:07:55.846057+0000","last_peered":"2024-04-24T23:07:55.846057+0000","last_clean":"2024-04-24T23:07:55.846057+0000","last_became_active":"2024-04-24T23:00:20.500153+0000","last_became_peered":"2024-04-24T23:00:20.500153+0000","last_unstale":"2024-04-24T23:07:55.846057+0000","last_undegraded":"2024-04-24T23:07:55.846057+0000","last_fullsized":"2024-04-24T23:07:55.846057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:51.285256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":6978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'285","reported_seq":312,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.889024+0000","last_change":"2024-04-24T23:00:16.446762+0000","last_active":"2024-04-24T23:07:55.889024+0000","last_peered":"2024-04-24T23:07:55.889024+0000","last_clean":"2024-04-24T23:07:55.889024+0000","last_became_active":"2024-04-24T23:00:16.446170+0000","last_became_peered":"2024-04-24T23:00:16.446170+0000","last_unstale":"2024-04-24T23:07:55.889024+0000","last_undegraded":"2024-04-24T23:07:55.889024+0000","last_fullsized":"2024-04-24T23:07:55.889024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.801913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'342","reported_seq":371,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:48.758059+0000","last_change":"2024-04-24T23:00:15.423703+0000","last_active":"2024-04-24T23:07:48.758059+0000","last_peered":"2024-04-24T23:07:48.758059+0000","last_clean":"2024-04-24T23:07:48.758059+0000","last_became_active":"2024-04-24T23:00:15.414863+0000","last_became_peered":"2024-04-24T23:00:15.414863+0000","last_unstale":"2024-04-24T23:07:48.758059+0000","last_undegraded":"2024-04-24T23:07:48.758059+0000","last_fullsized":"2024-04-24T23:07:48.758059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:26.588514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":379,"num_write_kb":12861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'1068","reported_seq":1089,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.903097+0000","last_change":"2024-04-24T23:00:20.499277+0000","last_active":"2024-04-24T23:07:55.903097+0000","last_peered":"2024-04-24T23:07:55.903097+0000","last_clean":"2024-04-24T23:07:55.903097+0000","last_became_active":"2024-04-24T23:00:20.498802+0000","last_became_peered":"2024-04-24T23:00:20.498802+0000","last_unstale":"2024-04-24T23:07:55.903097+0000","last_undegraded":"2024-04-24T23:07:55.903097+0000","last_fullsized":"2024-04-24T23:07:55.903097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:32.166063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":7543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'283","reported_seq":309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.824441+0000","last_change":"2024-04-24T23:00:16.448112+0000","last_active":"2024-04-24T23:07:55.824441+0000","last_peered":"2024-04-24T23:07:55.824441+0000","last_clean":"2024-04-24T23:07:55.824441+0000","last_became_active":"2024-04-24T23:00:16.447838+0000","last_became_peered":"2024-04-24T23:00:16.447838+0000","last_unstale":"2024-04-24T23:07:55.824441+0000","last_undegraded":"2024-04-24T23:07:55.824441+0000","last_fullsized":"2024-04-24T23:07:55.824441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:24.143678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'304","reported_seq":333,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.892329+0000","last_change":"2024-04-24T23:00:15.420914+0000","last_active":"2024-04-24T23:07:54.892329+0000","last_peered":"2024-04-24T23:07:54.892329+0000","last_clean":"2024-04-24T23:07:54.892329+0000","last_became_active":"2024-04-24T23:00:15.420590+0000","last_became_peered":"2024-04-24T23:00:15.420590+0000","last_unstale":"2024-04-24T23:07:54.892329+0000","last_undegraded":"2024-04-24T23:07:54.892329+0000","last_fullsized":"2024-04-24T23:07:54.892329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:53.443962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":356,"num_write_kb":8611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'1045","reported_seq":1066,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.831690+0000","last_change":"2024-04-24T23:00:20.494192+0000","last_active":"2024-04-24T23:07:55.831690+0000","last_peered":"2024-04-24T23:07:55.831690+0000","last_clean":"2024-04-24T23:07:55.831690+0000","last_became_active":"2024-04-24T23:00:20.493784+0000","last_became_peered":"2024-04-24T23:00:20.493784+0000","last_unstale":"2024-04-24T23:07:55.831690+0000","last_undegraded":"2024-04-24T23:07:55.831690+0000","last_fullsized":"2024-04-24T23:07:55.831690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1045,"log_dups_size":0,"ondisk_log_size":1045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:10.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1330,"num_write_kb":7257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'361","reported_seq":387,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.827351+0000","last_change":"2024-04-24T23:00:16.452682+0000","last_active":"2024-04-24T23:07:55.827351+0000","last_peered":"2024-04-24T23:07:55.827351+0000","last_clean":"2024-04-24T23:07:55.827351+0000","last_became_active":"2024-04-24T23:00:16.447742+0000","last_became_peered":"2024-04-24T23:00:16.447742+0000","last_unstale":"2024-04-24T23:07:55.827351+0000","last_undegraded":"2024-04-24T23:07:55.827351+0000","last_fullsized":"2024-04-24T23:07:55.827351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.801913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'267","reported_seq":296,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:49.712201+0000","last_change":"2024-04-24T23:00:15.416986+0000","last_active":"2024-04-24T23:07:49.712201+0000","last_peered":"2024-04-24T23:07:49.712201+0000","last_clean":"2024-04-24T23:07:49.712201+0000","last_became_active":"2024-04-24T23:00:15.416198+0000","last_became_peered":"2024-04-24T23:00:15.416198+0000","last_unstale":"2024-04-24T23:07:49.712201+0000","last_undegraded":"2024-04-24T23:07:49.712201+0000","last_fullsized":"2024-04-24T23:07:49.712201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:27.810443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":330,"num_write_kb":8690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'1004","reported_seq":1025,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.833315+0000","last_change":"2024-04-24T23:00:20.526621+0000","last_active":"2024-04-24T23:07:55.833315+0000","last_peered":"2024-04-24T23:07:55.833315+0000","last_clean":"2024-04-24T23:07:55.833315+0000","last_became_active":"2024-04-24T23:00:20.525782+0000","last_became_peered":"2024-04-24T23:00:20.525782+0000","last_unstale":"2024-04-24T23:07:55.833315+0000","last_undegraded":"2024-04-24T23:07:55.833315+0000","last_fullsized":"2024-04-24T23:07:55.833315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:38:28.209697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":7027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'330","reported_seq":357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.040526+0000","last_change":"2024-04-24T23:00:16.454748+0000","last_active":"2024-04-24T23:07:55.040526+0000","last_peered":"2024-04-24T23:07:55.040526+0000","last_clean":"2024-04-24T23:07:55.040526+0000","last_became_active":"2024-04-24T23:00:16.454031+0000","last_became_peered":"2024-04-24T23:00:16.454031+0000","last_unstale":"2024-04-24T23:07:55.040526+0000","last_undegraded":"2024-04-24T23:07:55.040526+0000","last_fullsized":"2024-04-24T23:07:55.040526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:31.237423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'68","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.719195+0000","last_change":"2024-04-24T23:00:15.420149+0000","last_active":"2024-04-24T23:07:53.719195+0000","last_peered":"2024-04-24T23:07:53.719195+0000","last_clean":"2024-04-24T23:07:53.719195+0000","last_became_active":"2024-04-24T23:00:15.416688+0000","last_became_peered":"2024-04-24T23:00:15.416688+0000","last_unstale":"2024-04-24T23:07:53.719195+0000","last_undegraded":"2024-04-24T23:07:53.719195+0000","last_fullsized":"2024-04-24T23:07:53.719195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:27.810443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":106,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'996","reported_seq":1017,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.798909+0000","last_change":"2024-04-24T23:00:20.517137+0000","last_active":"2024-04-24T23:07:55.798909+0000","last_peered":"2024-04-24T23:07:55.798909+0000","last_clean":"2024-04-24T23:07:55.798909+0000","last_became_active":"2024-04-24T23:00:20.516152+0000","last_became_peered":"2024-04-24T23:00:20.516152+0000","last_unstale":"2024-04-24T23:07:55.798909+0000","last_undegraded":"2024-04-24T23:07:55.798909+0000","last_fullsized":"2024-04-24T23:07:55.798909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:29.452352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":6136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'302","reported_seq":328,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.737685+0000","last_change":"2024-04-24T23:00:16.458939+0000","last_active":"2024-04-24T23:07:55.737685+0000","last_peered":"2024-04-24T23:07:55.737685+0000","last_clean":"2024-04-24T23:07:55.737685+0000","last_became_active":"2024-04-24T23:00:16.458081+0000","last_became_peered":"2024-04-24T23:00:16.458081+0000","last_unstale":"2024-04-24T23:07:55.737685+0000","last_undegraded":"2024-04-24T23:07:55.737685+0000","last_fullsized":"2024-04-24T23:07:55.737685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:27.760709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'41","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:48.697005+0000","last_change":"2024-04-24T23:00:15.413409+0000","last_active":"2024-04-24T23:07:48.697005+0000","last_peered":"2024-04-24T23:07:48.697005+0000","last_clean":"2024-04-24T23:07:48.697005+0000","last_became_active":"2024-04-24T23:00:15.412847+0000","last_became_peered":"2024-04-24T23:00:15.412847+0000","last_unstale":"2024-04-24T23:07:48.697005+0000","last_undegraded":"2024-04-24T23:07:48.697005+0000","last_fullsized":"2024-04-24T23:07:48.697005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:35.114960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":81,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'915","reported_seq":936,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.796705+0000","last_change":"2024-04-24T23:00:20.536112+0000","last_active":"2024-04-24T23:07:55.796705+0000","last_peered":"2024-04-24T23:07:55.796705+0000","last_clean":"2024-04-24T23:07:55.796705+0000","last_became_active":"2024-04-24T23:00:20.529427+0000","last_became_peered":"2024-04-24T23:00:20.529427+0000","last_unstale":"2024-04-24T23:07:55.796705+0000","last_undegraded":"2024-04-24T23:07:55.796705+0000","last_fullsized":"2024-04-24T23:07:55.796705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:14.639189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":6219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'313","reported_seq":340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.826183+0000","last_change":"2024-04-24T23:00:16.465373+0000","last_active":"2024-04-24T23:07:55.826183+0000","last_peered":"2024-04-24T23:07:55.826183+0000","last_clean":"2024-04-24T23:07:55.826183+0000","last_became_active":"2024-04-24T23:00:16.464653+0000","last_became_peered":"2024-04-24T23:00:16.464653+0000","last_unstale":"2024-04-24T23:07:55.826183+0000","last_undegraded":"2024-04-24T23:07:55.826183+0000","last_fullsized":"2024-04-24T23:07:55.826183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:24.143678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'531","reported_seq":560,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:51.885087+0000","last_change":"2024-04-24T23:00:15.427483+0000","last_active":"2024-04-24T23:07:51.885087+0000","last_peered":"2024-04-24T23:07:51.885087+0000","last_clean":"2024-04-24T23:07:51.885087+0000","last_became_active":"2024-04-24T23:00:15.426641+0000","last_became_peered":"2024-04-24T23:00:15.426641+0000","last_unstale":"2024-04-24T23:07:51.885087+0000","last_undegraded":"2024-04-24T23:07:51.885087+0000","last_fullsized":"2024-04-24T23:07:51.885087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":566,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'952","reported_seq":973,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.846819+0000","last_change":"2024-04-24T23:00:20.518479+0000","last_active":"2024-04-24T23:07:55.846819+0000","last_peered":"2024-04-24T23:07:55.846819+0000","last_clean":"2024-04-24T23:07:55.846819+0000","last_became_active":"2024-04-24T23:00:20.517950+0000","last_became_peered":"2024-04-24T23:00:20.517950+0000","last_unstale":"2024-04-24T23:07:55.846819+0000","last_undegraded":"2024-04-24T23:07:55.846819+0000","last_fullsized":"2024-04-24T23:07:55.846819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:37:10.220625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":7094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'288","reported_seq":315,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.826408+0000","last_change":"2024-04-24T23:00:16.456931+0000","last_active":"2024-04-24T23:07:55.826408+0000","last_peered":"2024-04-24T23:07:55.826408+0000","last_clean":"2024-04-24T23:07:55.826408+0000","last_became_active":"2024-04-24T23:00:16.456636+0000","last_became_peered":"2024-04-24T23:00:16.456636+0000","last_unstale":"2024-04-24T23:07:55.826408+0000","last_undegraded":"2024-04-24T23:07:55.826408+0000","last_fullsized":"2024-04-24T23:07:55.826408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:10.559806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'568","reported_seq":596,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.112279+0000","last_change":"2024-04-24T23:00:15.428189+0000","last_active":"2024-04-24T23:07:55.112279+0000","last_peered":"2024-04-24T23:07:55.112279+0000","last_clean":"2024-04-24T23:07:55.112279+0000","last_became_active":"2024-04-24T23:00:15.427837+0000","last_became_peered":"2024-04-24T23:00:15.427837+0000","last_unstale":"2024-04-24T23:07:55.112279+0000","last_undegraded":"2024-04-24T23:07:55.112279+0000","last_fullsized":"2024-04-24T23:07:55.112279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":635,"num_write_kb":21119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'1015","reported_seq":1043,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.871904+0000","last_change":"2024-04-24T23:00:57.865502+0000","last_active":"2024-04-24T23:07:55.871904+0000","last_peered":"2024-04-24T23:07:55.871904+0000","last_clean":"2024-04-24T23:07:55.871904+0000","last_became_active":"2024-04-24T23:00:57.864156+0000","last_became_peered":"2024-04-24T23:00:57.864156+0000","last_unstale":"2024-04-24T23:07:55.871904+0000","last_undegraded":"2024-04-24T23:07:55.871904+0000","last_fullsized":"2024-04-24T23:07:55.871904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:23.399284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":6923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'287","reported_seq":313,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.742115+0000","last_change":"2024-04-24T23:00:16.453438+0000","last_active":"2024-04-24T23:07:55.742115+0000","last_peered":"2024-04-24T23:07:55.742115+0000","last_clean":"2024-04-24T23:07:55.742115+0000","last_became_active":"2024-04-24T23:00:16.453033+0000","last_became_peered":"2024-04-24T23:00:16.453033+0000","last_unstale":"2024-04-24T23:07:55.742115+0000","last_undegraded":"2024-04-24T23:07:55.742115+0000","last_fullsized":"2024-04-24T23:07:55.742115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:52:36.324979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'667","reported_seq":696,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.918276+0000","last_change":"2024-04-24T23:00:15.431369+0000","last_active":"2024-04-24T23:07:55.918276+0000","last_peered":"2024-04-24T23:07:55.918276+0000","last_clean":"2024-04-24T23:07:55.918276+0000","last_became_active":"2024-04-24T23:00:15.430254+0000","last_became_peered":"2024-04-24T23:00:15.430254+0000","last_unstale":"2024-04-24T23:07:55.918276+0000","last_undegraded":"2024-04-24T23:07:55.918276+0000","last_fullsized":"2024-04-24T23:07:55.918276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":729,"num_write_kb":21519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'963","reported_seq":984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.909844+0000","last_change":"2024-04-24T23:00:20.503369+0000","last_active":"2024-04-24T23:07:55.909844+0000","last_peered":"2024-04-24T23:07:55.909844+0000","last_clean":"2024-04-24T23:07:55.909844+0000","last_became_active":"2024-04-24T23:00:20.502285+0000","last_became_peered":"2024-04-24T23:00:20.502285+0000","last_unstale":"2024-04-24T23:07:55.909844+0000","last_undegraded":"2024-04-24T23:07:55.909844+0000","last_fullsized":"2024-04-24T23:07:55.909844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'290","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.744532+0000","last_change":"2024-04-24T23:00:16.452958+0000","last_active":"2024-04-24T23:07:55.744532+0000","last_peered":"2024-04-24T23:07:55.744532+0000","last_clean":"2024-04-24T23:07:55.744532+0000","last_became_active":"2024-04-24T23:00:16.451611+0000","last_became_peered":"2024-04-24T23:00:16.451611+0000","last_unstale":"2024-04-24T23:07:55.744532+0000","last_undegraded":"2024-04-24T23:07:55.744532+0000","last_fullsized":"2024-04-24T23:07:55.744532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:06.283705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'414","reported_seq":443,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.714346+0000","last_change":"2024-04-24T23:00:15.397614+0000","last_active":"2024-04-24T23:07:53.714346+0000","last_peered":"2024-04-24T23:07:53.714346+0000","last_clean":"2024-04-24T23:07:53.714346+0000","last_became_active":"2024-04-24T23:00:15.397253+0000","last_became_peered":"2024-04-24T23:00:15.397253+0000","last_unstale":"2024-04-24T23:07:53.714346+0000","last_undegraded":"2024-04-24T23:07:53.714346+0000","last_fullsized":"2024-04-24T23:07:53.714346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:38.560562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":486,"num_write_kb":21108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'1063","reported_seq":1084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.895876+0000","last_change":"2024-04-24T23:00:20.506736+0000","last_active":"2024-04-24T23:07:55.895876+0000","last_peered":"2024-04-24T23:07:55.895876+0000","last_clean":"2024-04-24T23:07:55.895876+0000","last_became_active":"2024-04-24T23:00:20.505504+0000","last_became_peered":"2024-04-24T23:00:20.505504+0000","last_unstale":"2024-04-24T23:07:55.895876+0000","last_undegraded":"2024-04-24T23:07:55.895876+0000","last_fullsized":"2024-04-24T23:07:55.895876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:10.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1319,"num_write_kb":7863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'334","reported_seq":360,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.031431+0000","last_change":"2024-04-24T23:00:16.451217+0000","last_active":"2024-04-24T23:07:55.031431+0000","last_peered":"2024-04-24T23:07:55.031431+0000","last_clean":"2024-04-24T23:07:55.031431+0000","last_became_active":"2024-04-24T23:00:16.450149+0000","last_became_peered":"2024-04-24T23:00:16.450149+0000","last_unstale":"2024-04-24T23:07:55.031431+0000","last_undegraded":"2024-04-24T23:07:55.031431+0000","last_fullsized":"2024-04-24T23:07:55.031431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:36.124103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'68","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:52.715205+0000","last_change":"2024-04-24T23:00:15.428164+0000","last_active":"2024-04-24T23:07:52.715205+0000","last_peered":"2024-04-24T23:07:52.715205+0000","last_clean":"2024-04-24T23:07:52.715205+0000","last_became_active":"2024-04-24T23:00:15.427857+0000","last_became_peered":"2024-04-24T23:00:15.427857+0000","last_unstale":"2024-04-24T23:07:52.715205+0000","last_undegraded":"2024-04-24T23:07:52.715205+0000","last_fullsized":"2024-04-24T23:07:52.715205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":104,"num_write_kb":4310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'1074","reported_seq":1095,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.849955+0000","last_change":"2024-04-24T23:00:20.507135+0000","last_active":"2024-04-24T23:07:55.849955+0000","last_peered":"2024-04-24T23:07:55.849955+0000","last_clean":"2024-04-24T23:07:55.849955+0000","last_became_active":"2024-04-24T23:00:20.506257+0000","last_became_peered":"2024-04-24T23:00:20.506257+0000","last_unstale":"2024-04-24T23:07:55.849955+0000","last_undegraded":"2024-04-24T23:07:55.849955+0000","last_fullsized":"2024-04-24T23:07:55.849955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":7398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1072","reported_seq":1100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.819077+0000","last_change":"2024-04-24T23:00:57.867192+0000","last_active":"2024-04-24T23:07:55.819077+0000","last_peered":"2024-04-24T23:07:55.819077+0000","last_clean":"2024-04-24T23:07:55.819077+0000","last_became_active":"2024-04-24T23:00:57.865999+0000","last_became_peered":"2024-04-24T23:00:57.865999+0000","last_unstale":"2024-04-24T23:07:55.819077+0000","last_undegraded":"2024-04-24T23:07:55.819077+0000","last_fullsized":"2024-04-24T23:07:55.819077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1072,"log_dups_size":0,"ondisk_log_size":1072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:48.727897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1313,"num_write_kb":7137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'317","reported_seq":344,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.042267+0000","last_change":"2024-04-24T23:00:16.478734+0000","last_active":"2024-04-24T23:07:55.042267+0000","last_peered":"2024-04-24T23:07:55.042267+0000","last_clean":"2024-04-24T23:07:55.042267+0000","last_became_active":"2024-04-24T23:00:16.477474+0000","last_became_peered":"2024-04-24T23:00:16.477474+0000","last_unstale":"2024-04-24T23:07:55.042267+0000","last_undegraded":"2024-04-24T23:07:55.042267+0000","last_fullsized":"2024-04-24T23:07:55.042267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.178504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'570","reported_seq":598,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:51.887527+0000","last_change":"2024-04-24T23:00:15.405948+0000","last_active":"2024-04-24T23:07:51.887527+0000","last_peered":"2024-04-24T23:07:51.887527+0000","last_clean":"2024-04-24T23:07:51.887527+0000","last_became_active":"2024-04-24T23:00:15.405608+0000","last_became_peered":"2024-04-24T23:00:15.405608+0000","last_unstale":"2024-04-24T23:07:51.887527+0000","last_undegraded":"2024-04-24T23:07:51.887527+0000","last_fullsized":"2024-04-24T23:07:51.887527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":627,"num_write_kb":21153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'936","reported_seq":957,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.888541+0000","last_change":"2024-04-24T23:00:20.493810+0000","last_active":"2024-04-24T23:07:55.888541+0000","last_peered":"2024-04-24T23:07:55.888541+0000","last_clean":"2024-04-24T23:07:55.888541+0000","last_became_active":"2024-04-24T23:00:20.492303+0000","last_became_peered":"2024-04-24T23:00:20.492303+0000","last_unstale":"2024-04-24T23:07:55.888541+0000","last_undegraded":"2024-04-24T23:07:55.888541+0000","last_fullsized":"2024-04-24T23:07:55.888541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:58:38.649805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":6525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'350","reported_seq":377,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.847429+0000","last_change":"2024-04-24T23:00:16.465460+0000","last_active":"2024-04-24T23:07:55.847429+0000","last_peered":"2024-04-24T23:07:55.847429+0000","last_clean":"2024-04-24T23:07:55.847429+0000","last_became_active":"2024-04-24T23:00:16.457311+0000","last_became_peered":"2024-04-24T23:00:16.457311+0000","last_unstale":"2024-04-24T23:07:55.847429+0000","last_undegraded":"2024-04-24T23:07:55.847429+0000","last_fullsized":"2024-04-24T23:07:55.847429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:43:08.876496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":274,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'151","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.731772+0000","last_change":"2024-04-24T23:00:15.436608+0000","last_active":"2024-04-24T23:07:55.731772+0000","last_peered":"2024-04-24T23:07:55.731772+0000","last_clean":"2024-04-24T23:07:55.731772+0000","last_became_active":"2024-04-24T23:00:15.435730+0000","last_became_peered":"2024-04-24T23:00:15.435730+0000","last_unstale":"2024-04-24T23:07:55.731772+0000","last_undegraded":"2024-04-24T23:07:55.731772+0000","last_fullsized":"2024-04-24T23:07:55.731772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":198,"num_write_kb":4560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'1083","reported_seq":1111,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.719094+0000","last_change":"2024-04-24T23:00:15.417533+0000","last_active":"2024-04-24T23:07:53.719094+0000","last_peered":"2024-04-24T23:07:53.719094+0000","last_clean":"2024-04-24T23:07:53.719094+0000","last_became_active":"2024-04-24T23:00:15.417226+0000","last_became_peered":"2024-04-24T23:00:15.417226+0000","last_unstale":"2024-04-24T23:07:53.719094+0000","last_undegraded":"2024-04-24T23:07:53.719094+0000","last_fullsized":"2024-04-24T23:07:53.719094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1083,"log_dups_size":0,"ondisk_log_size":1083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:05.898513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":1127,"num_write_kb":29507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'292","reported_seq":319,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.844081+0000","last_change":"2024-04-24T23:00:16.483374+0000","last_active":"2024-04-24T23:07:55.844081+0000","last_peered":"2024-04-24T23:07:55.844081+0000","last_clean":"2024-04-24T23:07:55.844081+0000","last_became_active":"2024-04-24T23:00:16.482676+0000","last_became_peered":"2024-04-24T23:00:16.482676+0000","last_unstale":"2024-04-24T23:07:55.844081+0000","last_undegraded":"2024-04-24T23:07:55.844081+0000","last_fullsized":"2024-04-24T23:07:55.844081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:05.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'936","reported_seq":957,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.856157+0000","last_change":"2024-04-24T23:00:20.542916+0000","last_active":"2024-04-24T23:07:55.856157+0000","last_peered":"2024-04-24T23:07:55.856157+0000","last_clean":"2024-04-24T23:07:55.856157+0000","last_became_active":"2024-04-24T23:00:20.541822+0000","last_became_peered":"2024-04-24T23:00:20.541822+0000","last_unstale":"2024-04-24T23:07:55.856157+0000","last_undegraded":"2024-04-24T23:07:55.856157+0000","last_fullsized":"2024-04-24T23:07:55.856157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:31.840092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":5864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'464","reported_seq":493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:48.756371+0000","last_change":"2024-04-24T23:00:15.425495+0000","last_active":"2024-04-24T23:07:48.756371+0000","last_peered":"2024-04-24T23:07:48.756371+0000","last_clean":"2024-04-24T23:07:48.756371+0000","last_became_active":"2024-04-24T23:00:15.424739+0000","last_became_peered":"2024-04-24T23:00:15.424739+0000","last_unstale":"2024-04-24T23:07:48.756371+0000","last_undegraded":"2024-04-24T23:07:48.756371+0000","last_fullsized":"2024-04-24T23:07:48.756371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:49.740745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":495,"num_write_kb":8616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'322","reported_seq":349,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.824990+0000","last_change":"2024-04-24T23:00:16.454250+0000","last_active":"2024-04-24T23:07:55.824990+0000","last_peered":"2024-04-24T23:07:55.824990+0000","last_clean":"2024-04-24T23:07:55.824990+0000","last_became_active":"2024-04-24T23:00:16.453965+0000","last_became_peered":"2024-04-24T23:00:16.453965+0000","last_unstale":"2024-04-24T23:07:55.824990+0000","last_undegraded":"2024-04-24T23:07:55.824990+0000","last_fullsized":"2024-04-24T23:07:55.824990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'945","reported_seq":966,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.864627+0000","last_change":"2024-04-24T23:00:20.510475+0000","last_active":"2024-04-24T23:07:55.864627+0000","last_peered":"2024-04-24T23:07:55.864627+0000","last_clean":"2024-04-24T23:07:55.864627+0000","last_became_active":"2024-04-24T23:00:20.509269+0000","last_became_peered":"2024-04-24T23:00:20.509269+0000","last_unstale":"2024-04-24T23:07:55.864627+0000","last_undegraded":"2024-04-24T23:07:55.864627+0000","last_fullsized":"2024-04-24T23:07:55.864627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:09.596902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":6611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'342","reported_seq":368,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.870236+0000","last_change":"2024-04-24T23:00:16.456976+0000","last_active":"2024-04-24T23:07:55.870236+0000","last_peered":"2024-04-24T23:07:55.870236+0000","last_clean":"2024-04-24T23:07:55.870236+0000","last_became_active":"2024-04-24T23:00:16.456289+0000","last_became_peered":"2024-04-24T23:00:16.456289+0000","last_unstale":"2024-04-24T23:07:55.870236+0000","last_undegraded":"2024-04-24T23:07:55.870236+0000","last_fullsized":"2024-04-24T23:07:55.870236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'342","reported_seq":369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.876711+0000","last_change":"2024-04-24T23:00:16.471774+0000","last_active":"2024-04-24T23:07:55.876711+0000","last_peered":"2024-04-24T23:07:55.876711+0000","last_clean":"2024-04-24T23:07:55.876711+0000","last_became_active":"2024-04-24T23:00:16.466134+0000","last_became_peered":"2024-04-24T23:00:16.466134+0000","last_unstale":"2024-04-24T23:07:55.876711+0000","last_undegraded":"2024-04-24T23:07:55.876711+0000","last_fullsized":"2024-04-24T23:07:55.876711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:31.237423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'344","reported_seq":370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.862968+0000","last_change":"2024-04-24T23:00:16.465926+0000","last_active":"2024-04-24T23:07:55.862968+0000","last_peered":"2024-04-24T23:07:55.862968+0000","last_clean":"2024-04-24T23:07:55.862968+0000","last_became_active":"2024-04-24T23:00:16.465659+0000","last_became_peered":"2024-04-24T23:00:16.465659+0000","last_unstale":"2024-04-24T23:07:55.862968+0000","last_undegraded":"2024-04-24T23:07:55.862968+0000","last_fullsized":"2024-04-24T23:07:55.862968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:09:47.001195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'312","reported_seq":339,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.787739+0000","last_change":"2024-04-24T23:00:16.474929+0000","last_active":"2024-04-24T23:07:55.787739+0000","last_peered":"2024-04-24T23:07:55.787739+0000","last_clean":"2024-04-24T23:07:55.787739+0000","last_became_active":"2024-04-24T23:00:16.474181+0000","last_became_peered":"2024-04-24T23:00:16.474181+0000","last_unstale":"2024-04-24T23:07:55.787739+0000","last_undegraded":"2024-04-24T23:07:55.787739+0000","last_fullsized":"2024-04-24T23:07:55.787739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:56.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'294","reported_seq":321,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.804693+0000","last_change":"2024-04-24T23:00:16.458411+0000","last_active":"2024-04-24T23:07:55.804693+0000","last_peered":"2024-04-24T23:07:55.804693+0000","last_clean":"2024-04-24T23:07:55.804693+0000","last_became_active":"2024-04-24T23:00:16.457641+0000","last_became_peered":"2024-04-24T23:00:16.457641+0000","last_unstale":"2024-04-24T23:07:55.804693+0000","last_undegraded":"2024-04-24T23:07:55.804693+0000","last_fullsized":"2024-04-24T23:07:55.804693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:06.907656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'296","reported_seq":323,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.877058+0000","last_change":"2024-04-24T23:00:16.470324+0000","last_active":"2024-04-24T23:07:55.877058+0000","last_peered":"2024-04-24T23:07:55.877058+0000","last_clean":"2024-04-24T23:07:55.877058+0000","last_became_active":"2024-04-24T23:00:16.469614+0000","last_became_peered":"2024-04-24T23:00:16.469614+0000","last_unstale":"2024-04-24T23:07:55.877058+0000","last_undegraded":"2024-04-24T23:07:55.877058+0000","last_fullsized":"2024-04-24T23:07:55.877058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:05.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'361","reported_seq":387,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.886428+0000","last_change":"2024-04-24T23:00:16.450764+0000","last_active":"2024-04-24T23:07:55.886428+0000","last_peered":"2024-04-24T23:07:55.886428+0000","last_clean":"2024-04-24T23:07:55.886428+0000","last_became_active":"2024-04-24T23:00:16.450561+0000","last_became_peered":"2024-04-24T23:00:16.450561+0000","last_unstale":"2024-04-24T23:07:55.886428+0000","last_undegraded":"2024-04-24T23:07:55.886428+0000","last_fullsized":"2024-04-24T23:07:55.886428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:30.426371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'352","reported_seq":379,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.810269+0000","last_change":"2024-04-24T23:00:16.453953+0000","last_active":"2024-04-24T23:07:55.810269+0000","last_peered":"2024-04-24T23:07:55.810269+0000","last_clean":"2024-04-24T23:07:55.810269+0000","last_became_active":"2024-04-24T23:00:16.452345+0000","last_became_peered":"2024-04-24T23:00:16.452345+0000","last_unstale":"2024-04-24T23:07:55.810269+0000","last_undegraded":"2024-04-24T23:07:55.810269+0000","last_fullsized":"2024-04-24T23:07:55.810269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:58.273719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'330","reported_seq":356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.859472+0000","last_change":"2024-04-24T23:00:16.459030+0000","last_active":"2024-04-24T23:07:55.859472+0000","last_peered":"2024-04-24T23:07:55.859472+0000","last_clean":"2024-04-24T23:07:55.859472+0000","last_became_active":"2024-04-24T23:00:16.458402+0000","last_became_peered":"2024-04-24T23:00:16.458402+0000","last_unstale":"2024-04-24T23:07:55.859472+0000","last_undegraded":"2024-04-24T23:07:55.859472+0000","last_fullsized":"2024-04-24T23:07:55.859472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:33.558529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'298","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.893126+0000","last_change":"2024-04-24T23:00:16.456818+0000","last_active":"2024-04-24T23:07:54.893126+0000","last_peered":"2024-04-24T23:07:54.893126+0000","last_clean":"2024-04-24T23:07:54.893126+0000","last_became_active":"2024-04-24T23:00:16.453065+0000","last_became_peered":"2024-04-24T23:00:16.453065+0000","last_unstale":"2024-04-24T23:07:54.893126+0000","last_undegraded":"2024-04-24T23:07:54.893126+0000","last_fullsized":"2024-04-24T23:07:54.893126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:02.728439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'319","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.853778+0000","last_change":"2024-04-24T23:00:57.866802+0000","last_active":"2024-04-24T23:07:55.853778+0000","last_peered":"2024-04-24T23:07:55.853778+0000","last_clean":"2024-04-24T23:07:55.853778+0000","last_became_active":"2024-04-24T23:00:57.865894+0000","last_became_peered":"2024-04-24T23:00:57.865894+0000","last_unstale":"2024-04-24T23:07:55.853778+0000","last_undegraded":"2024-04-24T23:07:55.853778+0000","last_fullsized":"2024-04-24T23:07:55.853778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:31.077128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'298","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.834866+0000","last_change":"2024-04-24T23:00:16.478716+0000","last_active":"2024-04-24T23:07:55.834866+0000","last_peered":"2024-04-24T23:07:55.834866+0000","last_clean":"2024-04-24T23:07:55.834866+0000","last_became_active":"2024-04-24T23:00:16.477982+0000","last_became_peered":"2024-04-24T23:00:16.477982+0000","last_unstale":"2024-04-24T23:07:55.834866+0000","last_undegraded":"2024-04-24T23:07:55.834866+0000","last_fullsized":"2024-04-24T23:07:55.834866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:04.285389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'345","reported_seq":372,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.842536+0000","last_change":"2024-04-24T23:00:16.449265+0000","last_active":"2024-04-24T23:07:55.842536+0000","last_peered":"2024-04-24T23:07:55.842536+0000","last_clean":"2024-04-24T23:07:55.842536+0000","last_became_active":"2024-04-24T23:00:16.446583+0000","last_became_peered":"2024-04-24T23:00:16.446583+0000","last_unstale":"2024-04-24T23:07:55.842536+0000","last_undegraded":"2024-04-24T23:07:55.842536+0000","last_fullsized":"2024-04-24T23:07:55.842536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:38.429072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'300","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.765878+0000","last_change":"2024-04-24T23:00:16.483354+0000","last_active":"2024-04-24T23:07:55.765878+0000","last_peered":"2024-04-24T23:07:55.765878+0000","last_clean":"2024-04-24T23:07:55.765878+0000","last_became_active":"2024-04-24T23:00:16.483079+0000","last_became_peered":"2024-04-24T23:00:16.483079+0000","last_unstale":"2024-04-24T23:07:55.765878+0000","last_undegraded":"2024-04-24T23:07:55.765878+0000","last_fullsized":"2024-04-24T23:07:55.765878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:57:02.861698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'293","reported_seq":320,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.808924+0000","last_change":"2024-04-24T23:00:16.472605+0000","last_active":"2024-04-24T23:07:55.808924+0000","last_peered":"2024-04-24T23:07:55.808924+0000","last_clean":"2024-04-24T23:07:55.808924+0000","last_became_active":"2024-04-24T23:00:16.466076+0000","last_became_peered":"2024-04-24T23:00:16.466076+0000","last_unstale":"2024-04-24T23:07:55.808924+0000","last_undegraded":"2024-04-24T23:07:55.808924+0000","last_fullsized":"2024-04-24T23:07:55.808924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'316","reported_seq":342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.948785+0000","last_change":"2024-04-24T23:00:16.457737+0000","last_active":"2024-04-24T23:07:54.948785+0000","last_peered":"2024-04-24T23:07:54.948785+0000","last_clean":"2024-04-24T23:07:54.948785+0000","last_became_active":"2024-04-24T23:00:16.453949+0000","last_became_peered":"2024-04-24T23:00:16.453949+0000","last_unstale":"2024-04-24T23:07:54.948785+0000","last_undegraded":"2024-04-24T23:07:54.948785+0000","last_fullsized":"2024-04-24T23:07:54.948785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:08.928463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'325","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.898422+0000","last_change":"2024-04-24T23:00:16.452839+0000","last_active":"2024-04-24T23:07:55.898422+0000","last_peered":"2024-04-24T23:07:55.898422+0000","last_clean":"2024-04-24T23:07:55.898422+0000","last_became_active":"2024-04-24T23:00:16.445253+0000","last_became_peered":"2024-04-24T23:00:16.445253+0000","last_unstale":"2024-04-24T23:07:55.898422+0000","last_undegraded":"2024-04-24T23:07:55.898422+0000","last_fullsized":"2024-04-24T23:07:55.898422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:23.938299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'300","reported_seq":327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.837775+0000","last_change":"2024-04-24T23:00:16.455784+0000","last_active":"2024-04-24T23:07:55.837775+0000","last_peered":"2024-04-24T23:07:55.837775+0000","last_clean":"2024-04-24T23:07:55.837775+0000","last_became_active":"2024-04-24T23:00:16.454953+0000","last_became_peered":"2024-04-24T23:00:16.454953+0000","last_unstale":"2024-04-24T23:07:55.837775+0000","last_undegraded":"2024-04-24T23:07:55.837775+0000","last_fullsized":"2024-04-24T23:07:55.837775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:32.545524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'310","reported_seq":337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.982689+0000","last_change":"2024-04-24T23:00:16.468365+0000","last_active":"2024-04-24T23:07:54.982689+0000","last_peered":"2024-04-24T23:07:54.982689+0000","last_clean":"2024-04-24T23:07:54.982689+0000","last_became_active":"2024-04-24T23:00:16.467630+0000","last_became_peered":"2024-04-24T23:00:16.467630+0000","last_unstale":"2024-04-24T23:07:54.982689+0000","last_undegraded":"2024-04-24T23:07:54.982689+0000","last_fullsized":"2024-04-24T23:07:54.982689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'299","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.891514+0000","last_change":"2024-04-24T23:00:16.456188+0000","last_active":"2024-04-24T23:07:55.891514+0000","last_peered":"2024-04-24T23:07:55.891514+0000","last_clean":"2024-04-24T23:07:55.891514+0000","last_became_active":"2024-04-24T23:00:16.455114+0000","last_became_peered":"2024-04-24T23:00:16.455114+0000","last_unstale":"2024-04-24T23:07:55.891514+0000","last_undegraded":"2024-04-24T23:07:55.891514+0000","last_fullsized":"2024-04-24T23:07:55.891514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:36.124103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'280","reported_seq":307,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.919164+0000","last_change":"2024-04-24T23:00:16.450776+0000","last_active":"2024-04-24T23:07:54.919164+0000","last_peered":"2024-04-24T23:07:54.919164+0000","last_clean":"2024-04-24T23:07:54.919164+0000","last_became_active":"2024-04-24T23:00:16.450466+0000","last_became_peered":"2024-04-24T23:00:16.450466+0000","last_unstale":"2024-04-24T23:07:54.919164+0000","last_undegraded":"2024-04-24T23:07:54.919164+0000","last_fullsized":"2024-04-24T23:07:54.919164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:32.331306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'301","reported_seq":328,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.824146+0000","last_change":"2024-04-24T23:00:16.450743+0000","last_active":"2024-04-24T23:07:55.824146+0000","last_peered":"2024-04-24T23:07:55.824146+0000","last_clean":"2024-04-24T23:07:55.824146+0000","last_became_active":"2024-04-24T23:00:16.450279+0000","last_became_peered":"2024-04-24T23:00:16.450279+0000","last_unstale":"2024-04-24T23:07:55.824146+0000","last_undegraded":"2024-04-24T23:07:55.824146+0000","last_fullsized":"2024-04-24T23:07:55.824146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:00.869015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'283","reported_seq":310,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.826150+0000","last_change":"2024-04-24T23:00:16.446745+0000","last_active":"2024-04-24T23:07:55.826150+0000","last_peered":"2024-04-24T23:07:55.826150+0000","last_clean":"2024-04-24T23:07:55.826150+0000","last_became_active":"2024-04-24T23:00:16.446317+0000","last_became_peered":"2024-04-24T23:00:16.446317+0000","last_unstale":"2024-04-24T23:07:55.826150+0000","last_undegraded":"2024-04-24T23:07:55.826150+0000","last_fullsized":"2024-04-24T23:07:55.826150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:47.110869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'326","reported_seq":353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.759740+0000","last_change":"2024-04-24T23:00:16.446352+0000","last_active":"2024-04-24T23:07:55.759740+0000","last_peered":"2024-04-24T23:07:55.759740+0000","last_clean":"2024-04-24T23:07:55.759740+0000","last_became_active":"2024-04-24T23:00:16.445839+0000","last_became_peered":"2024-04-24T23:00:16.445839+0000","last_unstale":"2024-04-24T23:07:55.759740+0000","last_undegraded":"2024-04-24T23:07:55.759740+0000","last_fullsized":"2024-04-24T23:07:55.759740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'264","reported_seq":291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.864112+0000","last_change":"2024-04-24T23:00:16.451439+0000","last_active":"2024-04-24T23:07:53.864112+0000","last_peered":"2024-04-24T23:07:53.864112+0000","last_clean":"2024-04-24T23:07:53.864112+0000","last_became_active":"2024-04-24T23:00:16.450293+0000","last_became_peered":"2024-04-24T23:00:16.450293+0000","last_unstale":"2024-04-24T23:07:53.864112+0000","last_undegraded":"2024-04-24T23:07:53.864112+0000","last_fullsized":"2024-04-24T23:07:53.864112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:19.586817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'309","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.801587+0000","last_change":"2024-04-24T23:00:16.482222+0000","last_active":"2024-04-24T23:07:55.801587+0000","last_peered":"2024-04-24T23:07:55.801587+0000","last_clean":"2024-04-24T23:07:55.801587+0000","last_became_active":"2024-04-24T23:00:16.481897+0000","last_became_peered":"2024-04-24T23:00:16.481897+0000","last_unstale":"2024-04-24T23:07:55.801587+0000","last_undegraded":"2024-04-24T23:07:55.801587+0000","last_fullsized":"2024-04-24T23:07:55.801587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'312","reported_seq":338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.842591+0000","last_change":"2024-04-24T23:00:16.482100+0000","last_active":"2024-04-24T23:07:55.842591+0000","last_peered":"2024-04-24T23:07:55.842591+0000","last_clean":"2024-04-24T23:07:55.842591+0000","last_became_active":"2024-04-24T23:00:16.481832+0000","last_became_peered":"2024-04-24T23:00:16.481832+0000","last_unstale":"2024-04-24T23:07:55.842591+0000","last_undegraded":"2024-04-24T23:07:55.842591+0000","last_fullsized":"2024-04-24T23:07:55.842591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'319","reported_seq":346,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.850019+0000","last_change":"2024-04-24T23:00:16.466121+0000","last_active":"2024-04-24T23:07:55.850019+0000","last_peered":"2024-04-24T23:07:55.850019+0000","last_clean":"2024-04-24T23:07:55.850019+0000","last_became_active":"2024-04-24T23:00:16.465749+0000","last_became_peered":"2024-04-24T23:00:16.465749+0000","last_unstale":"2024-04-24T23:07:55.850019+0000","last_undegraded":"2024-04-24T23:07:55.850019+0000","last_fullsized":"2024-04-24T23:07:55.850019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:05.734745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'300","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.811380+0000","last_change":"2024-04-24T23:00:16.481682+0000","last_active":"2024-04-24T23:07:55.811380+0000","last_peered":"2024-04-24T23:07:55.811380+0000","last_clean":"2024-04-24T23:07:55.811380+0000","last_became_active":"2024-04-24T23:00:16.481381+0000","last_became_peered":"2024-04-24T23:00:16.481381+0000","last_unstale":"2024-04-24T23:07:55.811380+0000","last_undegraded":"2024-04-24T23:07:55.811380+0000","last_fullsized":"2024-04-24T23:07:55.811380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:14.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'298","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.837116+0000","last_change":"2024-04-24T23:00:16.461984+0000","last_active":"2024-04-24T23:07:55.837116+0000","last_peered":"2024-04-24T23:07:55.837116+0000","last_clean":"2024-04-24T23:07:55.837116+0000","last_became_active":"2024-04-24T23:00:16.461267+0000","last_became_peered":"2024-04-24T23:00:16.461267+0000","last_unstale":"2024-04-24T23:07:55.837116+0000","last_undegraded":"2024-04-24T23:07:55.837116+0000","last_fullsized":"2024-04-24T23:07:55.837116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:53:00.776972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'322","reported_seq":349,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.055917+0000","last_change":"2024-04-24T23:00:16.460191+0000","last_active":"2024-04-24T23:07:55.055917+0000","last_peered":"2024-04-24T23:07:55.055917+0000","last_clean":"2024-04-24T23:07:55.055917+0000","last_became_active":"2024-04-24T23:00:16.459445+0000","last_became_peered":"2024-04-24T23:00:16.459445+0000","last_unstale":"2024-04-24T23:07:55.055917+0000","last_undegraded":"2024-04-24T23:07:55.055917+0000","last_fullsized":"2024-04-24T23:07:55.055917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:12.313822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'302","reported_seq":329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.882819+0000","last_change":"2024-04-24T23:00:16.450409+0000","last_active":"2024-04-24T23:07:55.882819+0000","last_peered":"2024-04-24T23:07:55.882819+0000","last_clean":"2024-04-24T23:07:55.882819+0000","last_became_active":"2024-04-24T23:00:16.450061+0000","last_became_peered":"2024-04-24T23:00:16.450061+0000","last_unstale":"2024-04-24T23:07:55.882819+0000","last_undegraded":"2024-04-24T23:07:55.882819+0000","last_fullsized":"2024-04-24T23:07:55.882819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:23.938299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40344,"num_write_kb":220872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32314,"ondisk_log_size":32314,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15318,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19901,"ondisk_log_size":19901,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":156035250,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":1142,"num_read_kb":1796,"num_write":15514,"num_write_kb":443772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87621632,"data_stored":312070500,"data_compressed":57713942,"data_compressed_allocated":71589888,"data_compressed_original":296099840,"omap_allocated":0,"internal_metadata":0},"log_size":13412,"ondisk_log_size":13412,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509537,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116732,"kb_used_data":9204,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94255108,"statfs":{"total":96636764160,"available":96517230592,"internally_reserved":0,"allocated":9424896,"data_stored":30817518,"data_compressed":5693383,"data_compressed_allocated":7151616,"data_compressed_original":28721152,"omap_allocated":1590,"internal_metadata":110098890},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509537,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112904,"kb_used_data":9600,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94258936,"statfs":{"total":96636764160,"available":96521150464,"internally_reserved":0,"allocated":9830400,"data_stored":37368214,"data_compressed":6737911,"data_compressed_allocated":8192000,"data_compressed_original":35913728,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509538,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133964,"kb_used_data":12612,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94237876,"statfs":{"total":96636764160,"available":96499585024,"internally_reserved":0,"allocated":12914688,"data_stored":46253360,"data_compressed":8519580,"data_compressed_allocated":10514432,"data_compressed_original":44023808,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509538,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89148,"kb_used_data":3828,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94282692,"statfs":{"total":96636764160,"available":96545476608,"internally_reserved":0,"allocated":3919872,"data_stored":12699018,"data_compressed":2449723,"data_compressed_allocated":3092480,"data_compressed_original":12046336,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509538,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109104,"kb_used_data":9896,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94262736,"statfs":{"total":96636764160,"available":96525041664,"internally_reserved":0,"allocated":10133504,"data_stored":34260304,"data_compressed":6393594,"data_compressed_allocated":7995392,"data_compressed_original":32296960,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509537,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127780,"kb_used_data":16156,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94244060,"statfs":{"total":96636764160,"available":96505917440,"internally_reserved":0,"allocated":16543744,"data_stored":58338446,"data_compressed":10526573,"data_compressed_allocated":13012992,"data_compressed_original":54984704,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,7,5,6],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542243,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91380,"kb_used_data":10220,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94280460,"statfs":{"total":96636764160,"available":96543191040,"internally_reserved":0,"allocated":10465280,"data_stored":37864170,"data_compressed":6877701,"data_compressed_allocated":8454144,"data_compressed_original":36020224,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119692,"kb_used_data":16388,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94252148,"statfs":{"total":96636764160,"available":96514199552,"internally_reserved":0,"allocated":16781312,"data_stored":56573678,"data_compressed":10582231,"data_compressed_allocated":13266944,"data_compressed_original":53239808,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16261120,"data_stored":58223012,"data_compressed":10526573,"data_compressed_allocated":13012992,"data_compressed_original":54984704,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9785344,"data_stored":33554502,"data_compressed":6360217,"data_compressed_allocated":7950336,"data_compressed_original":31723520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3637248,"data_stored":12583584,"data_compressed":2449723,"data_compressed_allocated":3092480,"data_compressed_original":12046336,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":46137926,"data_compressed":8519580,"data_compressed_allocated":10514432,"data_compressed_original":44023808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9547776,"data_stored":37252780,"data_compressed":6737911,"data_compressed_allocated":8192000,"data_compressed_original":35913728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16433152,"data_stored":55867876,"data_compressed":10548854,"data_compressed_allocated":13221888,"data_compressed_original":52666368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10182656,"data_stored":37748736,"data_compressed":6877701,"data_compressed_allocated":8454144,"data_compressed_original":36020224,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9142272,"data_stored":30702084,"data_compressed":5693383,"data_compressed_allocated":7151616,"data_compressed_original":28721152,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:08:03.826 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:08:03.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.974+0000 7f5d164ea640 1 Processor -- start 2024-04-24T23:08:03.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.974+0000 7f5d164ea640 1 -- start start 2024-04-24T23:08:03.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.974+0000 7f5d164ea640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d10072e00 0x7f5d100b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:03.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.974+0000 7f5d164ea640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d10141550 0x7f5d101419b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:03.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.974+0000 7f5d164ea640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d10141ef0 con 0x7f5d1014ada0 2024-04-24T23:08:03.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.974+0000 7f5d164ea640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5d100b6de0 con 0x7f5d10072e00 2024-04-24T23:08:03.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.974+0000 7f5d164ea640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5d100b5780 con 0x7f5d10141550 2024-04-24T23:08:03.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.974+0000 7f5d0ffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d10072e00 0x7f5d100b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:03.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.974+0000 7f5d0ffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d10072e00 0x7f5d100b68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.43:50712/0 (socket says 172.21.15.43:50712) 2024-04-24T23:08:03.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.974+0000 7f5d0ffff640 1 -- 172.21.15.43:0/3149422984 learned_addr learned my addr 172.21.15.43:0/3149422984 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:03.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.974+0000 7f5d0f7fe640 1 --2- 172.21.15.43:0/3149422984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d10141550 0x7f5d101419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:03.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.974+0000 7f5d0ffff640 1 -- 172.21.15.43:0/3149422984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d10141550 msgr2=0x7f5d101419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:03.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.974+0000 7f5d0ffff640 1 --2- 172.21.15.43:0/3149422984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d10141550 0x7f5d101419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.974+0000 7f5d0ffff640 1 -- 172.21.15.43:0/3149422984 >> v1:172.21.15.162:6789/0 conn(0x7f5d1014ada0 legacy=0x7f5d1014b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:03.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.974+0000 7f5d0ffff640 1 -- 172.21.15.43:0/3149422984 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d100b74f0 con 0x7f5d10072e00 2024-04-24T23:08:03.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d0ffff640 1 --2- 172.21.15.43:0/3149422984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d10072e00 0x7f5d100b68a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009870 tx=0x7f5d0401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4d5b662821edcd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:03.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d0effd640 1 -- 172.21.15.43:0/3149422984 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d040b0070 con 0x7f5d10072e00 2024-04-24T23:08:03.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d0effd640 1 -- 172.21.15.43:0/3149422984 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d040ab600 con 0x7f5d10072e00 2024-04-24T23:08:03.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d0effd640 1 -- 172.21.15.43:0/3149422984 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d040ab9d0 con 0x7f5d10072e00 2024-04-24T23:08:03.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 -- 172.21.15.43:0/3149422984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d10072e00 msgr2=0x7f5d100b68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:03.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 --2- 172.21.15.43:0/3149422984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d10072e00 0x7f5d100b68a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009870 tx=0x7f5d0401c440 comp rx=0 tx=0).stop 2024-04-24T23:08:03.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 -- 172.21.15.43:0/3149422984 shutdown_connections 2024-04-24T23:08:03.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 --2- 172.21.15.43:0/3149422984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d10141550 0x7f5d101419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 --2- 172.21.15.43:0/3149422984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d10072e00 0x7f5d100b68a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 -- 172.21.15.43:0/3149422984 >> 172.21.15.43:0/3149422984 conn(0x7f5d100b7880 msgr2=0x7f5d100b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:03.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 -- 172.21.15.43:0/3149422984 shutdown_connections 2024-04-24T23:08:03.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 -- 172.21.15.43:0/3149422984 wait complete. 2024-04-24T23:08:03.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 Processor -- start 2024-04-24T23:08:03.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 -- start start 2024-04-24T23:08:03.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d10072e00 0x7f5d100ba260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:03.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d10141550 0x7f5d101460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:03.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1014ada0 0x7f5d101400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:03.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5d10154810 con 0x7f5d10072e00 2024-04-24T23:08:03.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1006ea50 con 0x7f5d1014ada0 2024-04-24T23:08:03.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d164ea640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5d10154990 con 0x7f5d10141550 2024-04-24T23:08:03.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d0ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d10072e00 0x7f5d100ba260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:03.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d0ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d10072e00 0x7f5d100ba260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54698/0 (socket says 172.21.15.43:54698) 2024-04-24T23:08:03.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d0ffff640 1 -- 172.21.15.43:0/63927836 learned_addr learned my addr 172.21.15.43:0/63927836 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:03.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d14a87640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1014ada0 0x7f5d101400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:03.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d0f7fe640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d10141550 0x7f5d101460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:03.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d0ffff640 1 -- 172.21.15.43:0/63927836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d10141550 msgr2=0x7f5d101460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:03.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d0ffff640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d10141550 0x7f5d101460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d0ffff640 1 -- 172.21.15.43:0/63927836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1014ada0 msgr2=0x7f5d101400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:03.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d0ffff640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1014ada0 0x7f5d101400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:03.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d0ffff640 1 -- 172.21.15.43:0/63927836 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d10146610 con 0x7f5d10072e00 2024-04-24T23:08:03.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d0f7fe640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d10141550 0x7f5d101460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:03.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d14a87640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1014ada0 0x7f5d101400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:03.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.978+0000 7f5d0ffff640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d10072e00 0x7f5d100ba260 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5d0401a070 tx=0x7f5d0401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:03.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.982+0000 7f5d0cff9640 1 -- 172.21.15.43:0/63927836 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d040ba020 con 0x7f5d10072e00 2024-04-24T23:08:03.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.982+0000 7f5d0cff9640 1 -- 172.21.15.43:0/63927836 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d040b6620 con 0x7f5d10072e00 2024-04-24T23:08:03.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.982+0000 7f5d164ea640 1 -- 172.21.15.43:0/63927836 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d101468e0 con 0x7f5d10072e00 2024-04-24T23:08:03.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.982+0000 7f5d0cff9640 1 -- 172.21.15.43:0/63927836 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d040b0040 con 0x7f5d10072e00 2024-04-24T23:08:03.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.982+0000 7f5d164ea640 1 -- 172.21.15.43:0/63927836 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d1013fb80 con 0x7f5d10072e00 2024-04-24T23:08:03.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.982+0000 7f5d164ea640 1 -- 172.21.15.43:0/63927836 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d1004f580 con 0x7f5d10072e00 2024-04-24T23:08:03.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.982+0000 7f5d0cff9640 1 -- 172.21.15.43:0/63927836 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5d040bd020 con 0x7f5d10072e00 2024-04-24T23:08:03.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.982+0000 7f5d0cff9640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5cfc0678c0 0x7f5cfc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:03.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.982+0000 7f5d0cff9640 1 -- 172.21.15.43:0/63927836 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f5d04120700 con 0x7f5d10072e00 2024-04-24T23:08:03.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.982+0000 7f5d0f7fe640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5cfc0678c0 0x7f5cfc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:03.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.982+0000 7f5d0f7fe640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5cfc0678c0 0x7f5cfc069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5d1013f310 tx=0x7f5d00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:03.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:03.986+0000 7f5d0cff9640 1 -- 172.21.15.43:0/63927836 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5d040c4030 con 0x7f5d10072e00 2024-04-24T23:08:04.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.142+0000 7f5d164ea640 1 -- 172.21.15.43:0/63927836 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d10141cd0 con 0x7f5cfc0678c0 2024-04-24T23:08:04.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.158+0000 7f5d0cff9640 1 -- 172.21.15.43:0/63927836 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335032 (secure 0 0 0) 0x7f5d10141cd0 con 0x7f5cfc0678c0 2024-04-24T23:08:04.162 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:08:04.164 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-24T23:08:04.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.162+0000 7f5d164ea640 1 -- 172.21.15.43:0/63927836 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5cfc0678c0 msgr2=0x7f5cfc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:04.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.162+0000 7f5d164ea640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5cfc0678c0 0x7f5cfc069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5d1013f310 tx=0x7f5d00008040 comp rx=0 tx=0).stop 2024-04-24T23:08:04.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.162+0000 7f5d164ea640 1 -- 172.21.15.43:0/63927836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d10072e00 msgr2=0x7f5d100ba260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:04.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.162+0000 7f5d164ea640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d10072e00 0x7f5d100ba260 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5d0401a070 tx=0x7f5d0401ac80 comp rx=0 tx=0).stop 2024-04-24T23:08:04.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.162+0000 7f5d164ea640 1 -- 172.21.15.43:0/63927836 shutdown_connections 2024-04-24T23:08:04.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.162+0000 7f5d164ea640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5cfc0678c0 0x7f5cfc069d80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.162+0000 7f5d164ea640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1014ada0 0x7f5d101400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.162+0000 7f5d164ea640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d10141550 0x7f5d101460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.162+0000 7f5d164ea640 1 --2- 172.21.15.43:0/63927836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d10072e00 0x7f5d100ba260 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.162+0000 7f5d164ea640 1 -- 172.21.15.43:0/63927836 >> 172.21.15.43:0/63927836 conn(0x7f5d100b7880 msgr2=0x7f5d100722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:04.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.162+0000 7f5d164ea640 1 -- 172.21.15.43:0/63927836 shutdown_connections 2024-04-24T23:08:04.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.162+0000 7f5d164ea640 1 -- 172.21.15.43:0/63927836 wait complete. 2024-04-24T23:08:04.179 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2024-04-24T23:08:02.387705+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":156625618,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":1258,"num_read_kb":1896,"num_write":71335,"num_write_kb":667060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65744,"ondisk_log_size":65744,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":900704,"kb_used_data":87904,"kb_used_omap":12,"kb_used_meta":812723,"kb_avail":754074016,"statfs":{"total":773094113280,"available":772171792384,"internally_reserved":0,"allocated":90013696,"data_stored":314174708,"data_compressed":57780696,"data_compressed_allocated":71680000,"data_compressed_original":297246720,"omap_allocated":12752,"internal_metadata":832228912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,7,5,6],"upper_bound":32},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-41100661,"num_objects":-4539,"num_object_clones":0,"num_object_copies":-13642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4539,"num_whiteouts":0,"num_read":25,"num_read_kb":247,"num_write":4668,"num_write_kb":6239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-108,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003511"},"pg_stats":[{"pgid":"2.1f","version":"27'518","reported_seq":547,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:50.667654+0000","last_change":"2024-04-24T23:00:15.425241+0000","last_active":"2024-04-24T23:07:50.667654+0000","last_peered":"2024-04-24T23:07:50.667654+0000","last_clean":"2024-04-24T23:07:50.667654+0000","last_became_active":"2024-04-24T23:00:15.417152+0000","last_became_peered":"2024-04-24T23:00:15.417152+0000","last_unstale":"2024-04-24T23:07:50.667654+0000","last_undegraded":"2024-04-24T23:07:50.667654+0000","last_fullsized":"2024-04-24T23:07:50.667654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":574,"num_write_kb":8831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'309","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.055031+0000","last_change":"2024-04-24T23:00:16.450360+0000","last_active":"2024-04-24T23:07:55.055031+0000","last_peered":"2024-04-24T23:07:55.055031+0000","last_clean":"2024-04-24T23:07:55.055031+0000","last_became_active":"2024-04-24T23:00:16.449631+0000","last_became_peered":"2024-04-24T23:00:16.449631+0000","last_unstale":"2024-04-24T23:07:55.055031+0000","last_undegraded":"2024-04-24T23:07:55.055031+0000","last_fullsized":"2024-04-24T23:07:55.055031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:03:09.773642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'1014","reported_seq":1035,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.824046+0000","last_change":"2024-04-24T23:00:20.537107+0000","last_active":"2024-04-24T23:07:55.824046+0000","last_peered":"2024-04-24T23:07:55.824046+0000","last_clean":"2024-04-24T23:07:55.824046+0000","last_became_active":"2024-04-24T23:00:20.535916+0000","last_became_peered":"2024-04-24T23:00:20.535916+0000","last_unstale":"2024-04-24T23:07:55.824046+0000","last_undegraded":"2024-04-24T23:07:55.824046+0000","last_fullsized":"2024-04-24T23:07:55.824046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1014,"log_dups_size":0,"ondisk_log_size":1014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.364772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":7177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'578","reported_seq":607,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.796855+0000","last_change":"2024-04-24T23:00:15.418251+0000","last_active":"2024-04-24T23:07:54.796855+0000","last_peered":"2024-04-24T23:07:54.796855+0000","last_clean":"2024-04-24T23:07:54.796855+0000","last_became_active":"2024-04-24T23:00:15.417502+0000","last_became_peered":"2024-04-24T23:00:15.417502+0000","last_unstale":"2024-04-24T23:07:54.796855+0000","last_undegraded":"2024-04-24T23:07:54.796855+0000","last_fullsized":"2024-04-24T23:07:54.796855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:50:53.490837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":611,"num_write_kb":25054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'282","reported_seq":309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.912926+0000","last_change":"2024-04-24T23:00:16.452960+0000","last_active":"2024-04-24T23:07:54.912926+0000","last_peered":"2024-04-24T23:07:54.912926+0000","last_clean":"2024-04-24T23:07:54.912926+0000","last_became_active":"2024-04-24T23:00:16.452212+0000","last_became_peered":"2024-04-24T23:00:16.452212+0000","last_unstale":"2024-04-24T23:07:54.912926+0000","last_undegraded":"2024-04-24T23:07:54.912926+0000","last_fullsized":"2024-04-24T23:07:54.912926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:26.361607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'1050","reported_seq":1071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.855066+0000","last_change":"2024-04-24T23:00:20.518435+0000","last_active":"2024-04-24T23:07:55.855066+0000","last_peered":"2024-04-24T23:07:55.855066+0000","last_clean":"2024-04-24T23:07:55.855066+0000","last_became_active":"2024-04-24T23:00:20.517975+0000","last_became_peered":"2024-04-24T23:00:20.517975+0000","last_unstale":"2024-04-24T23:07:55.855066+0000","last_undegraded":"2024-04-24T23:07:55.855066+0000","last_fullsized":"2024-04-24T23:07:55.855066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1050,"log_dups_size":0,"ondisk_log_size":1050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:36.410688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":6799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1034","reported_seq":1063,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:46.942698+0000","last_change":"2024-04-24T23:00:15.401804+0000","last_active":"2024-04-24T23:07:46.942698+0000","last_peered":"2024-04-24T23:07:46.942698+0000","last_clean":"2024-04-24T23:07:46.942698+0000","last_became_active":"2024-04-24T23:00:15.400064+0000","last_became_peered":"2024-04-24T23:00:15.400064+0000","last_unstale":"2024-04-24T23:07:46.942698+0000","last_undegraded":"2024-04-24T23:07:46.942698+0000","last_fullsized":"2024-04-24T23:07:46.942698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1034,"log_dups_size":0,"ondisk_log_size":1034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:26.588514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":1068,"num_write_kb":29480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'280","reported_seq":307,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.847890+0000","last_change":"2024-04-24T23:00:16.451873+0000","last_active":"2024-04-24T23:07:55.847890+0000","last_peered":"2024-04-24T23:07:55.847890+0000","last_clean":"2024-04-24T23:07:55.847890+0000","last_became_active":"2024-04-24T23:00:16.451601+0000","last_became_peered":"2024-04-24T23:00:16.451601+0000","last_unstale":"2024-04-24T23:07:55.847890+0000","last_undegraded":"2024-04-24T23:07:55.847890+0000","last_fullsized":"2024-04-24T23:07:55.847890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:14.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'993","reported_seq":1014,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.901309+0000","last_change":"2024-04-24T23:00:20.518757+0000","last_active":"2024-04-24T23:07:55.901309+0000","last_peered":"2024-04-24T23:07:55.901309+0000","last_clean":"2024-04-24T23:07:55.901309+0000","last_became_active":"2024-04-24T23:00:20.518002+0000","last_became_peered":"2024-04-24T23:00:20.518002+0000","last_unstale":"2024-04-24T23:07:55.901309+0000","last_undegraded":"2024-04-24T23:07:55.901309+0000","last_fullsized":"2024-04-24T23:07:55.901309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":6590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'200","reported_seq":229,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.779438+0000","last_change":"2024-04-24T23:00:15.398338+0000","last_active":"2024-04-24T23:07:54.779438+0000","last_peered":"2024-04-24T23:07:54.779438+0000","last_clean":"2024-04-24T23:07:54.779438+0000","last_became_active":"2024-04-24T23:00:15.395766+0000","last_became_peered":"2024-04-24T23:00:15.395766+0000","last_unstale":"2024-04-24T23:07:54.779438+0000","last_undegraded":"2024-04-24T23:07:54.779438+0000","last_fullsized":"2024-04-24T23:07:54.779438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:30.228280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":248,"num_write_kb":4421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'284","reported_seq":310,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.808339+0000","last_change":"2024-04-24T23:00:16.458641+0000","last_active":"2024-04-24T23:07:55.808339+0000","last_peered":"2024-04-24T23:07:55.808339+0000","last_clean":"2024-04-24T23:07:55.808339+0000","last_became_active":"2024-04-24T23:00:16.458237+0000","last_became_peered":"2024-04-24T23:00:16.458237+0000","last_unstale":"2024-04-24T23:07:55.808339+0000","last_undegraded":"2024-04-24T23:07:55.808339+0000","last_fullsized":"2024-04-24T23:07:55.808339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:22:17.631542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'1016","reported_seq":1044,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.883278+0000","last_change":"2024-04-24T23:00:57.665634+0000","last_active":"2024-04-24T23:07:55.883278+0000","last_peered":"2024-04-24T23:07:55.883278+0000","last_clean":"2024-04-24T23:07:55.883278+0000","last_became_active":"2024-04-24T23:00:57.664750+0000","last_became_peered":"2024-04-24T23:00:57.664750+0000","last_unstale":"2024-04-24T23:07:55.883278+0000","last_undegraded":"2024-04-24T23:07:55.883278+0000","last_fullsized":"2024-04-24T23:07:55.883278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:13.007846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":6657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,4],"acting":[2,6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'321","reported_seq":347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.852235+0000","last_change":"2024-04-24T23:00:16.448014+0000","last_active":"2024-04-24T23:07:55.852235+0000","last_peered":"2024-04-24T23:07:55.852235+0000","last_clean":"2024-04-24T23:07:55.852235+0000","last_became_active":"2024-04-24T23:00:16.447488+0000","last_became_peered":"2024-04-24T23:00:16.447488+0000","last_unstale":"2024-04-24T23:07:55.852235+0000","last_undegraded":"2024-04-24T23:07:55.852235+0000","last_fullsized":"2024-04-24T23:07:55.852235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:29.852278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'770","reported_seq":798,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.111019+0000","last_change":"2024-04-24T23:00:15.408781+0000","last_active":"2024-04-24T23:07:55.111019+0000","last_peered":"2024-04-24T23:07:55.111019+0000","last_clean":"2024-04-24T23:07:55.111019+0000","last_became_active":"2024-04-24T23:00:15.408120+0000","last_became_peered":"2024-04-24T23:00:15.408120+0000","last_unstale":"2024-04-24T23:07:55.111019+0000","last_undegraded":"2024-04-24T23:07:55.111019+0000","last_fullsized":"2024-04-24T23:07:55.111019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:38.560562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":817,"num_write_kb":21262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'991","reported_seq":1012,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.825524+0000","last_change":"2024-04-24T23:00:20.503964+0000","last_active":"2024-04-24T23:07:55.825524+0000","last_peered":"2024-04-24T23:07:55.825524+0000","last_clean":"2024-04-24T23:07:55.825524+0000","last_became_active":"2024-04-24T23:00:20.501703+0000","last_became_peered":"2024-04-24T23:00:20.501703+0000","last_unstale":"2024-04-24T23:07:55.825524+0000","last_undegraded":"2024-04-24T23:07:55.825524+0000","last_fullsized":"2024-04-24T23:07:55.825524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:40.258673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":7022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'329","reported_seq":356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.813960+0000","last_change":"2024-04-24T23:00:16.472987+0000","last_active":"2024-04-24T23:07:55.813960+0000","last_peered":"2024-04-24T23:07:55.813960+0000","last_clean":"2024-04-24T23:07:55.813960+0000","last_became_active":"2024-04-24T23:00:16.472226+0000","last_became_peered":"2024-04-24T23:00:16.472226+0000","last_unstale":"2024-04-24T23:07:55.813960+0000","last_undegraded":"2024-04-24T23:07:55.813960+0000","last_fullsized":"2024-04-24T23:07:55.813960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":260,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'309","reported_seq":338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:49.727569+0000","last_change":"2024-04-24T23:00:15.422963+0000","last_active":"2024-04-24T23:07:49.727569+0000","last_peered":"2024-04-24T23:07:49.727569+0000","last_clean":"2024-04-24T23:07:49.727569+0000","last_became_active":"2024-04-24T23:00:15.422121+0000","last_became_peered":"2024-04-24T23:00:15.422121+0000","last_unstale":"2024-04-24T23:07:49.727569+0000","last_undegraded":"2024-04-24T23:07:49.727569+0000","last_fullsized":"2024-04-24T23:07:49.727569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":340,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'1105","reported_seq":1126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.852798+0000","last_change":"2024-04-24T23:00:20.540688+0000","last_active":"2024-04-24T23:07:55.852798+0000","last_peered":"2024-04-24T23:07:55.852798+0000","last_clean":"2024-04-24T23:07:55.852798+0000","last_became_active":"2024-04-24T23:00:20.540220+0000","last_became_peered":"2024-04-24T23:00:20.540220+0000","last_unstale":"2024-04-24T23:07:55.852798+0000","last_undegraded":"2024-04-24T23:07:55.852798+0000","last_fullsized":"2024-04-24T23:07:55.852798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:33.931661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1391,"num_write_kb":7499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'328","reported_seq":355,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.884330+0000","last_change":"2024-04-24T23:00:16.488633+0000","last_active":"2024-04-24T23:07:55.884330+0000","last_peered":"2024-04-24T23:07:55.884330+0000","last_clean":"2024-04-24T23:07:55.884330+0000","last_became_active":"2024-04-24T23:00:16.487476+0000","last_became_peered":"2024-04-24T23:00:16.487476+0000","last_unstale":"2024-04-24T23:07:55.884330+0000","last_undegraded":"2024-04-24T23:07:55.884330+0000","last_fullsized":"2024-04-24T23:07:55.884330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:06.907656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'215","reported_seq":244,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.745513+0000","last_change":"2024-04-24T23:00:15.397973+0000","last_active":"2024-04-24T23:07:53.745513+0000","last_peered":"2024-04-24T23:07:53.745513+0000","last_clean":"2024-04-24T23:07:53.745513+0000","last_became_active":"2024-04-24T23:00:15.396600+0000","last_became_peered":"2024-04-24T23:00:15.396600+0000","last_unstale":"2024-04-24T23:07:53.745513+0000","last_undegraded":"2024-04-24T23:07:53.745513+0000","last_fullsized":"2024-04-24T23:07:53.745513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:22.932046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":224,"num_write_kb":12479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'989","reported_seq":1010,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.895864+0000","last_change":"2024-04-24T23:00:20.511547+0000","last_active":"2024-04-24T23:07:55.895864+0000","last_peered":"2024-04-24T23:07:55.895864+0000","last_clean":"2024-04-24T23:07:55.895864+0000","last_became_active":"2024-04-24T23:00:20.510602+0000","last_became_peered":"2024-04-24T23:00:20.510602+0000","last_unstale":"2024-04-24T23:07:55.895864+0000","last_undegraded":"2024-04-24T23:07:55.895864+0000","last_fullsized":"2024-04-24T23:07:55.895864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:17.847434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1239,"num_write_kb":6767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'347","reported_seq":373,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.821370+0000","last_change":"2024-04-24T23:00:16.483393+0000","last_active":"2024-04-24T23:07:55.821370+0000","last_peered":"2024-04-24T23:07:55.821370+0000","last_clean":"2024-04-24T23:07:55.821370+0000","last_became_active":"2024-04-24T23:00:16.483092+0000","last_became_peered":"2024-04-24T23:00:16.483092+0000","last_unstale":"2024-04-24T23:07:55.821370+0000","last_undegraded":"2024-04-24T23:07:55.821370+0000","last_fullsized":"2024-04-24T23:07:55.821370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:38.429072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'273","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.888601+0000","last_change":"2024-04-24T23:00:15.398005+0000","last_active":"2024-04-24T23:07:54.888601+0000","last_peered":"2024-04-24T23:07:54.888601+0000","last_clean":"2024-04-24T23:07:54.888601+0000","last_became_active":"2024-04-24T23:00:15.397638+0000","last_became_peered":"2024-04-24T23:00:15.397638+0000","last_unstale":"2024-04-24T23:07:54.888601+0000","last_undegraded":"2024-04-24T23:07:54.888601+0000","last_fullsized":"2024-04-24T23:07:54.888601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":320,"num_write_kb":4474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'934","reported_seq":955,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.854383+0000","last_change":"2024-04-24T23:00:20.505995+0000","last_active":"2024-04-24T23:07:55.854383+0000","last_peered":"2024-04-24T23:07:55.854383+0000","last_clean":"2024-04-24T23:07:55.854383+0000","last_became_active":"2024-04-24T23:00:20.505532+0000","last_became_peered":"2024-04-24T23:00:20.505532+0000","last_unstale":"2024-04-24T23:07:55.854383+0000","last_undegraded":"2024-04-24T23:07:55.854383+0000","last_fullsized":"2024-04-24T23:07:55.854383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:42.508455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":6588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'326","reported_seq":353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.820109+0000","last_change":"2024-04-24T23:00:16.484306+0000","last_active":"2024-04-24T23:07:55.820109+0000","last_peered":"2024-04-24T23:07:55.820109+0000","last_clean":"2024-04-24T23:07:55.820109+0000","last_became_active":"2024-04-24T23:00:16.483585+0000","last_became_peered":"2024-04-24T23:00:16.483585+0000","last_unstale":"2024-04-24T23:07:55.820109+0000","last_undegraded":"2024-04-24T23:07:55.820109+0000","last_fullsized":"2024-04-24T23:07:55.820109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:53.051451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'156","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.717711+0000","last_change":"2024-04-24T23:00:15.421158+0000","last_active":"2024-04-24T23:07:53.717711+0000","last_peered":"2024-04-24T23:07:53.717711+0000","last_clean":"2024-04-24T23:07:53.717711+0000","last_became_active":"2024-04-24T23:00:15.420839+0000","last_became_peered":"2024-04-24T23:00:15.420839+0000","last_unstale":"2024-04-24T23:07:53.717711+0000","last_undegraded":"2024-04-24T23:07:53.717711+0000","last_fullsized":"2024-04-24T23:07:53.717711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:03.276247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":209,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'1029","reported_seq":1050,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.904843+0000","last_change":"2024-04-24T23:00:20.519755+0000","last_active":"2024-04-24T23:07:55.904843+0000","last_peered":"2024-04-24T23:07:55.904843+0000","last_clean":"2024-04-24T23:07:55.904843+0000","last_became_active":"2024-04-24T23:00:20.518470+0000","last_became_peered":"2024-04-24T23:00:20.518470+0000","last_unstale":"2024-04-24T23:07:55.904843+0000","last_undegraded":"2024-04-24T23:07:55.904843+0000","last_fullsized":"2024-04-24T23:07:55.904843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:14.639189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":7455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'286","reported_seq":313,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.822901+0000","last_change":"2024-04-24T23:00:16.464487+0000","last_active":"2024-04-24T23:07:55.822901+0000","last_peered":"2024-04-24T23:07:55.822901+0000","last_clean":"2024-04-24T23:07:55.822901+0000","last_became_active":"2024-04-24T23:00:16.463565+0000","last_became_peered":"2024-04-24T23:00:16.463565+0000","last_unstale":"2024-04-24T23:07:55.822901+0000","last_undegraded":"2024-04-24T23:07:55.822901+0000","last_fullsized":"2024-04-24T23:07:55.822901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'444","reported_seq":473,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:56.114315+0000","last_change":"2024-04-24T23:00:15.400228+0000","last_active":"2024-04-24T23:07:56.114315+0000","last_peered":"2024-04-24T23:07:56.114315+0000","last_clean":"2024-04-24T23:07:56.114315+0000","last_became_active":"2024-04-24T23:00:15.397465+0000","last_became_peered":"2024-04-24T23:00:15.397465+0000","last_unstale":"2024-04-24T23:07:56.114315+0000","last_undegraded":"2024-04-24T23:07:56.114315+0000","last_fullsized":"2024-04-24T23:07:56.114315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7891308,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1194,"num_write_kb":9205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'1049","reported_seq":1070,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.906567+0000","last_change":"2024-04-24T23:00:20.516766+0000","last_active":"2024-04-24T23:07:55.906567+0000","last_peered":"2024-04-24T23:07:55.906567+0000","last_clean":"2024-04-24T23:07:55.906567+0000","last_became_active":"2024-04-24T23:00:20.515972+0000","last_became_peered":"2024-04-24T23:00:20.515972+0000","last_unstale":"2024-04-24T23:07:55.906567+0000","last_undegraded":"2024-04-24T23:07:55.906567+0000","last_fullsized":"2024-04-24T23:07:55.906567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1319,"num_write_kb":7165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'291","reported_seq":318,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.817277+0000","last_change":"2024-04-24T23:00:16.480627+0000","last_active":"2024-04-24T23:07:55.817277+0000","last_peered":"2024-04-24T23:07:55.817277+0000","last_clean":"2024-04-24T23:07:55.817277+0000","last_became_active":"2024-04-24T23:00:16.480021+0000","last_became_peered":"2024-04-24T23:00:16.480021+0000","last_unstale":"2024-04-24T23:07:55.817277+0000","last_undegraded":"2024-04-24T23:07:55.817277+0000","last_fullsized":"2024-04-24T23:07:55.817277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:04.285389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'297","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:44.623630+0000","last_change":"2024-04-24T23:00:15.428375+0000","last_active":"2024-04-24T23:07:44.623630+0000","last_peered":"2024-04-24T23:07:44.623630+0000","last_clean":"2024-04-24T23:07:44.623630+0000","last_became_active":"2024-04-24T23:00:15.428016+0000","last_became_peered":"2024-04-24T23:00:15.428016+0000","last_unstale":"2024-04-24T23:07:44.623630+0000","last_undegraded":"2024-04-24T23:07:44.623630+0000","last_fullsized":"2024-04-24T23:07:44.623630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:24.759195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":311,"num_write_kb":16738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'1004","reported_seq":1025,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.826119+0000","last_change":"2024-04-24T23:00:20.535274+0000","last_active":"2024-04-24T23:07:55.826119+0000","last_peered":"2024-04-24T23:07:55.826119+0000","last_clean":"2024-04-24T23:07:55.826119+0000","last_became_active":"2024-04-24T23:00:20.524747+0000","last_became_peered":"2024-04-24T23:00:20.524747+0000","last_unstale":"2024-04-24T23:07:55.826119+0000","last_undegraded":"2024-04-24T23:07:55.826119+0000","last_fullsized":"2024-04-24T23:07:55.826119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.814128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1252,"num_write_kb":7166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'314","reported_seq":340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.879978+0000","last_change":"2024-04-24T23:00:16.456641+0000","last_active":"2024-04-24T23:07:55.879978+0000","last_peered":"2024-04-24T23:07:55.879978+0000","last_clean":"2024-04-24T23:07:55.879978+0000","last_became_active":"2024-04-24T23:00:16.456268+0000","last_became_peered":"2024-04-24T23:00:16.456268+0000","last_unstale":"2024-04-24T23:07:55.879978+0000","last_undegraded":"2024-04-24T23:07:55.879978+0000","last_fullsized":"2024-04-24T23:07:55.879978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'112","reported_seq":141,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.896251+0000","last_change":"2024-04-24T23:00:15.429119+0000","last_active":"2024-04-24T23:07:54.896251+0000","last_peered":"2024-04-24T23:07:54.896251+0000","last_clean":"2024-04-24T23:07:54.896251+0000","last_became_active":"2024-04-24T23:00:15.428374+0000","last_became_peered":"2024-04-24T23:00:15.428374+0000","last_unstale":"2024-04-24T23:07:54.896251+0000","last_undegraded":"2024-04-24T23:07:54.896251+0000","last_fullsized":"2024-04-24T23:07:54.896251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:13:30.412685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":161,"num_write_kb":4386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'1030","reported_seq":1051,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.864947+0000","last_change":"2024-04-24T23:00:20.535730+0000","last_active":"2024-04-24T23:07:55.864947+0000","last_peered":"2024-04-24T23:07:55.864947+0000","last_clean":"2024-04-24T23:07:55.864947+0000","last_became_active":"2024-04-24T23:00:20.534430+0000","last_became_peered":"2024-04-24T23:00:20.534430+0000","last_unstale":"2024-04-24T23:07:55.864947+0000","last_undegraded":"2024-04-24T23:07:55.864947+0000","last_fullsized":"2024-04-24T23:07:55.864947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:35.156511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1288,"num_write_kb":6636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'309","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.767711+0000","last_change":"2024-04-24T23:00:16.444070+0000","last_active":"2024-04-24T23:07:55.767711+0000","last_peered":"2024-04-24T23:07:55.767711+0000","last_clean":"2024-04-24T23:07:55.767711+0000","last_became_active":"2024-04-24T23:00:16.443620+0000","last_became_peered":"2024-04-24T23:00:16.443620+0000","last_unstale":"2024-04-24T23:07:55.767711+0000","last_undegraded":"2024-04-24T23:07:55.767711+0000","last_fullsized":"2024-04-24T23:07:55.767711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:31.077128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'510","reported_seq":538,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:49.798261+0000","last_change":"2024-04-24T23:00:15.422571+0000","last_active":"2024-04-24T23:07:49.798261+0000","last_peered":"2024-04-24T23:07:49.798261+0000","last_clean":"2024-04-24T23:07:49.798261+0000","last_became_active":"2024-04-24T23:00:15.422167+0000","last_became_peered":"2024-04-24T23:00:15.422167+0000","last_unstale":"2024-04-24T23:07:49.798261+0000","last_undegraded":"2024-04-24T23:07:49.798261+0000","last_fullsized":"2024-04-24T23:07:49.798261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:29.417228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":552,"num_write_kb":25017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'943","reported_seq":964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.834843+0000","last_change":"2024-04-24T23:00:20.540587+0000","last_active":"2024-04-24T23:07:55.834843+0000","last_peered":"2024-04-24T23:07:55.834843+0000","last_clean":"2024-04-24T23:07:55.834843+0000","last_became_active":"2024-04-24T23:00:20.524719+0000","last_became_peered":"2024-04-24T23:00:20.524719+0000","last_unstale":"2024-04-24T23:07:55.834843+0000","last_undegraded":"2024-04-24T23:07:55.834843+0000","last_fullsized":"2024-04-24T23:07:55.834843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'312","reported_seq":339,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.900068+0000","last_change":"2024-04-24T23:00:16.471678+0000","last_active":"2024-04-24T23:07:55.900068+0000","last_peered":"2024-04-24T23:07:55.900068+0000","last_clean":"2024-04-24T23:07:55.900068+0000","last_became_active":"2024-04-24T23:00:16.469390+0000","last_became_peered":"2024-04-24T23:00:16.469390+0000","last_unstale":"2024-04-24T23:07:55.900068+0000","last_undegraded":"2024-04-24T23:07:55.900068+0000","last_fullsized":"2024-04-24T23:07:55.900068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:31:59.778549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'887","reported_seq":1585,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:56.723481+0000","last_change":"2024-04-24T23:00:15.423024+0000","last_active":"2024-04-24T23:07:56.723481+0000","last_peered":"2024-04-24T23:07:56.723481+0000","last_clean":"2024-04-24T23:07:56.723481+0000","last_became_active":"2024-04-24T23:00:15.422275+0000","last_became_peered":"2024-04-24T23:00:15.422275+0000","last_unstale":"2024-04-24T23:07:56.723481+0000","last_undegraded":"2024-04-24T23:07:56.723481+0000","last_fullsized":"2024-04-24T23:07:56.723481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9730440,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":691,"num_read_kb":1796,"num_write":947,"num_write_kb":14533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'1020","reported_seq":1041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.845109+0000","last_change":"2024-04-24T23:00:20.535131+0000","last_active":"2024-04-24T23:07:55.845109+0000","last_peered":"2024-04-24T23:07:55.845109+0000","last_clean":"2024-04-24T23:07:55.845109+0000","last_became_active":"2024-04-24T23:00:20.534325+0000","last_became_peered":"2024-04-24T23:00:20.534325+0000","last_unstale":"2024-04-24T23:07:55.845109+0000","last_undegraded":"2024-04-24T23:07:55.845109+0000","last_fullsized":"2024-04-24T23:07:55.845109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1281,"num_write_kb":6595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'298","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.827749+0000","last_change":"2024-04-24T23:00:16.451991+0000","last_active":"2024-04-24T23:07:55.827749+0000","last_peered":"2024-04-24T23:07:55.827749+0000","last_clean":"2024-04-24T23:07:55.827749+0000","last_became_active":"2024-04-24T23:00:16.451226+0000","last_became_peered":"2024-04-24T23:00:16.451226+0000","last_unstale":"2024-04-24T23:07:55.827749+0000","last_undegraded":"2024-04-24T23:07:55.827749+0000","last_fullsized":"2024-04-24T23:07:55.827749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:30.426371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'647","reported_seq":675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:51.887360+0000","last_change":"2024-04-24T23:00:15.414535+0000","last_active":"2024-04-24T23:07:51.887360+0000","last_peered":"2024-04-24T23:07:51.887360+0000","last_clean":"2024-04-24T23:07:51.887360+0000","last_became_active":"2024-04-24T23:00:15.414224+0000","last_became_peered":"2024-04-24T23:00:15.414224+0000","last_unstale":"2024-04-24T23:07:51.887360+0000","last_undegraded":"2024-04-24T23:07:51.887360+0000","last_fullsized":"2024-04-24T23:07:51.887360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:30.228280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":698,"num_write_kb":16967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'1115","reported_seq":1136,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.885451+0000","last_change":"2024-04-24T23:00:20.531159+0000","last_active":"2024-04-24T23:07:55.885451+0000","last_peered":"2024-04-24T23:07:55.885451+0000","last_clean":"2024-04-24T23:07:55.885451+0000","last_became_active":"2024-04-24T23:00:20.530682+0000","last_became_peered":"2024-04-24T23:00:20.530682+0000","last_unstale":"2024-04-24T23:07:55.885451+0000","last_undegraded":"2024-04-24T23:07:55.885451+0000","last_fullsized":"2024-04-24T23:07:55.885451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:45.629364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1380,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'286","reported_seq":313,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.032733+0000","last_change":"2024-04-24T23:00:16.481649+0000","last_active":"2024-04-24T23:07:55.032733+0000","last_peered":"2024-04-24T23:07:55.032733+0000","last_clean":"2024-04-24T23:07:55.032733+0000","last_became_active":"2024-04-24T23:00:16.477192+0000","last_became_peered":"2024-04-24T23:00:16.477192+0000","last_unstale":"2024-04-24T23:07:55.032733+0000","last_undegraded":"2024-04-24T23:07:55.032733+0000","last_fullsized":"2024-04-24T23:07:55.032733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:13.768051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'170","reported_seq":198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:38.824463+0000","last_change":"2024-04-24T23:00:15.407927+0000","last_active":"2024-04-24T23:07:38.824463+0000","last_peered":"2024-04-24T23:07:38.824463+0000","last_clean":"2024-04-24T23:07:38.824463+0000","last_became_active":"2024-04-24T23:00:15.407609+0000","last_became_peered":"2024-04-24T23:00:15.407609+0000","last_unstale":"2024-04-24T23:07:38.824463+0000","last_undegraded":"2024-04-24T23:07:38.824463+0000","last_fullsized":"2024-04-24T23:07:38.824463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:13.689340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":211,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:04:03.322959+0000","last_change":"2024-04-24T23:00:03.344529+0000","last_active":"2024-04-24T23:04:03.322959+0000","last_peered":"2024-04-24T23:04:03.322959+0000","last_clean":"2024-04-24T23:04:03.322959+0000","last_became_active":"2024-04-24T23:00:03.344074+0000","last_became_peered":"2024-04-24T23:00:03.344074+0000","last_unstale":"2024-04-24T23:04:03.322959+0000","last_undegraded":"2024-04-24T23:04:03.322959+0000","last_fullsized":"2024-04-24T23:04:03.322959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:02.322380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:02.322380+0000","last_clean_scrub_stamp":"2024-04-24T23:00:02.322380+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:40.550881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'994","reported_seq":1009,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.887079+0000","last_change":"2024-04-24T23:00:57.865441+0000","last_active":"2024-04-24T23:07:55.887079+0000","last_peered":"2024-04-24T23:07:55.887079+0000","last_clean":"2024-04-24T23:07:55.887079+0000","last_became_active":"2024-04-24T23:00:57.864235+0000","last_became_peered":"2024-04-24T23:00:57.864235+0000","last_unstale":"2024-04-24T23:07:55.887079+0000","last_undegraded":"2024-04-24T23:07:55.887079+0000","last_fullsized":"2024-04-24T23:07:55.887079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":994,"log_dups_size":0,"ondisk_log_size":994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:54.068285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1231,"num_write_kb":6895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2,0],"acting":[5,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"27'310","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.824018+0000","last_change":"2024-04-24T23:00:16.448759+0000","last_active":"2024-04-24T23:07:55.824018+0000","last_peered":"2024-04-24T23:07:55.824018+0000","last_clean":"2024-04-24T23:07:55.824018+0000","last_became_active":"2024-04-24T23:00:16.448187+0000","last_became_peered":"2024-04-24T23:00:16.448187+0000","last_unstale":"2024-04-24T23:07:55.824018+0000","last_undegraded":"2024-04-24T23:07:55.824018+0000","last_fullsized":"2024-04-24T23:07:55.824018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:08:59.708506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'231","reported_seq":260,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:42.632794+0000","last_change":"2024-04-24T23:00:15.436270+0000","last_active":"2024-04-24T23:07:42.632794+0000","last_peered":"2024-04-24T23:07:42.632794+0000","last_clean":"2024-04-24T23:07:42.632794+0000","last_became_active":"2024-04-24T23:00:15.425134+0000","last_became_peered":"2024-04-24T23:00:15.425134+0000","last_unstale":"2024-04-24T23:07:42.632794+0000","last_undegraded":"2024-04-24T23:07:42.632794+0000","last_fullsized":"2024-04-24T23:07:42.632794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":252,"num_write_kb":12509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'1044","reported_seq":1065,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.887165+0000","last_change":"2024-04-24T23:00:20.500617+0000","last_active":"2024-04-24T23:07:55.887165+0000","last_peered":"2024-04-24T23:07:55.887165+0000","last_clean":"2024-04-24T23:07:55.887165+0000","last_became_active":"2024-04-24T23:00:20.500158+0000","last_became_peered":"2024-04-24T23:00:20.500158+0000","last_unstale":"2024-04-24T23:07:55.887165+0000","last_undegraded":"2024-04-24T23:07:55.887165+0000","last_fullsized":"2024-04-24T23:07:55.887165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1044,"log_dups_size":0,"ondisk_log_size":1044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.814128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1291,"num_write_kb":7061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'343","reported_seq":370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.847367+0000","last_change":"2024-04-24T23:00:16.471754+0000","last_active":"2024-04-24T23:07:55.847367+0000","last_peered":"2024-04-24T23:07:55.847367+0000","last_clean":"2024-04-24T23:07:55.847367+0000","last_became_active":"2024-04-24T23:00:16.471497+0000","last_became_peered":"2024-04-24T23:00:16.471497+0000","last_unstale":"2024-04-24T23:07:55.847367+0000","last_undegraded":"2024-04-24T23:07:55.847367+0000","last_fullsized":"2024-04-24T23:07:55.847367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:27.760709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'523","reported_seq":552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:46.767969+0000","last_change":"2024-04-24T23:00:15.406401+0000","last_active":"2024-04-24T23:07:46.767969+0000","last_peered":"2024-04-24T23:07:46.767969+0000","last_clean":"2024-04-24T23:07:46.767969+0000","last_became_active":"2024-04-24T23:00:15.405636+0000","last_became_peered":"2024-04-24T23:00:15.405636+0000","last_unstale":"2024-04-24T23:07:46.767969+0000","last_undegraded":"2024-04-24T23:07:46.767969+0000","last_fullsized":"2024-04-24T23:07:46.767969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:02.654515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":558,"num_write_kb":25209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'1010","reported_seq":1031,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.846057+0000","last_change":"2024-04-24T23:00:20.502050+0000","last_active":"2024-04-24T23:07:55.846057+0000","last_peered":"2024-04-24T23:07:55.846057+0000","last_clean":"2024-04-24T23:07:55.846057+0000","last_became_active":"2024-04-24T23:00:20.500153+0000","last_became_peered":"2024-04-24T23:00:20.500153+0000","last_unstale":"2024-04-24T23:07:55.846057+0000","last_undegraded":"2024-04-24T23:07:55.846057+0000","last_fullsized":"2024-04-24T23:07:55.846057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:51.285256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":6978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'285","reported_seq":312,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.889024+0000","last_change":"2024-04-24T23:00:16.446762+0000","last_active":"2024-04-24T23:07:55.889024+0000","last_peered":"2024-04-24T23:07:55.889024+0000","last_clean":"2024-04-24T23:07:55.889024+0000","last_became_active":"2024-04-24T23:00:16.446170+0000","last_became_peered":"2024-04-24T23:00:16.446170+0000","last_unstale":"2024-04-24T23:07:55.889024+0000","last_undegraded":"2024-04-24T23:07:55.889024+0000","last_fullsized":"2024-04-24T23:07:55.889024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.801913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'342","reported_seq":371,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:48.758059+0000","last_change":"2024-04-24T23:00:15.423703+0000","last_active":"2024-04-24T23:07:48.758059+0000","last_peered":"2024-04-24T23:07:48.758059+0000","last_clean":"2024-04-24T23:07:48.758059+0000","last_became_active":"2024-04-24T23:00:15.414863+0000","last_became_peered":"2024-04-24T23:00:15.414863+0000","last_unstale":"2024-04-24T23:07:48.758059+0000","last_undegraded":"2024-04-24T23:07:48.758059+0000","last_fullsized":"2024-04-24T23:07:48.758059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:26.588514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":379,"num_write_kb":12861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'1068","reported_seq":1089,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.903097+0000","last_change":"2024-04-24T23:00:20.499277+0000","last_active":"2024-04-24T23:07:55.903097+0000","last_peered":"2024-04-24T23:07:55.903097+0000","last_clean":"2024-04-24T23:07:55.903097+0000","last_became_active":"2024-04-24T23:00:20.498802+0000","last_became_peered":"2024-04-24T23:00:20.498802+0000","last_unstale":"2024-04-24T23:07:55.903097+0000","last_undegraded":"2024-04-24T23:07:55.903097+0000","last_fullsized":"2024-04-24T23:07:55.903097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:32.166063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":7543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'283","reported_seq":309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.824441+0000","last_change":"2024-04-24T23:00:16.448112+0000","last_active":"2024-04-24T23:07:55.824441+0000","last_peered":"2024-04-24T23:07:55.824441+0000","last_clean":"2024-04-24T23:07:55.824441+0000","last_became_active":"2024-04-24T23:00:16.447838+0000","last_became_peered":"2024-04-24T23:00:16.447838+0000","last_unstale":"2024-04-24T23:07:55.824441+0000","last_undegraded":"2024-04-24T23:07:55.824441+0000","last_fullsized":"2024-04-24T23:07:55.824441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:24.143678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'304","reported_seq":333,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.892329+0000","last_change":"2024-04-24T23:00:15.420914+0000","last_active":"2024-04-24T23:07:54.892329+0000","last_peered":"2024-04-24T23:07:54.892329+0000","last_clean":"2024-04-24T23:07:54.892329+0000","last_became_active":"2024-04-24T23:00:15.420590+0000","last_became_peered":"2024-04-24T23:00:15.420590+0000","last_unstale":"2024-04-24T23:07:54.892329+0000","last_undegraded":"2024-04-24T23:07:54.892329+0000","last_fullsized":"2024-04-24T23:07:54.892329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:53.443962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":356,"num_write_kb":8611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'1045","reported_seq":1066,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.831690+0000","last_change":"2024-04-24T23:00:20.494192+0000","last_active":"2024-04-24T23:07:55.831690+0000","last_peered":"2024-04-24T23:07:55.831690+0000","last_clean":"2024-04-24T23:07:55.831690+0000","last_became_active":"2024-04-24T23:00:20.493784+0000","last_became_peered":"2024-04-24T23:00:20.493784+0000","last_unstale":"2024-04-24T23:07:55.831690+0000","last_undegraded":"2024-04-24T23:07:55.831690+0000","last_fullsized":"2024-04-24T23:07:55.831690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1045,"log_dups_size":0,"ondisk_log_size":1045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:10.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1330,"num_write_kb":7257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'361","reported_seq":387,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.827351+0000","last_change":"2024-04-24T23:00:16.452682+0000","last_active":"2024-04-24T23:07:55.827351+0000","last_peered":"2024-04-24T23:07:55.827351+0000","last_clean":"2024-04-24T23:07:55.827351+0000","last_became_active":"2024-04-24T23:00:16.447742+0000","last_became_peered":"2024-04-24T23:00:16.447742+0000","last_unstale":"2024-04-24T23:07:55.827351+0000","last_undegraded":"2024-04-24T23:07:55.827351+0000","last_fullsized":"2024-04-24T23:07:55.827351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.801913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'267","reported_seq":296,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:49.712201+0000","last_change":"2024-04-24T23:00:15.416986+0000","last_active":"2024-04-24T23:07:49.712201+0000","last_peered":"2024-04-24T23:07:49.712201+0000","last_clean":"2024-04-24T23:07:49.712201+0000","last_became_active":"2024-04-24T23:00:15.416198+0000","last_became_peered":"2024-04-24T23:00:15.416198+0000","last_unstale":"2024-04-24T23:07:49.712201+0000","last_undegraded":"2024-04-24T23:07:49.712201+0000","last_fullsized":"2024-04-24T23:07:49.712201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:27.810443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":330,"num_write_kb":8690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'1004","reported_seq":1025,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.833315+0000","last_change":"2024-04-24T23:00:20.526621+0000","last_active":"2024-04-24T23:07:55.833315+0000","last_peered":"2024-04-24T23:07:55.833315+0000","last_clean":"2024-04-24T23:07:55.833315+0000","last_became_active":"2024-04-24T23:00:20.525782+0000","last_became_peered":"2024-04-24T23:00:20.525782+0000","last_unstale":"2024-04-24T23:07:55.833315+0000","last_undegraded":"2024-04-24T23:07:55.833315+0000","last_fullsized":"2024-04-24T23:07:55.833315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:38:28.209697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":7027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'330","reported_seq":357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.040526+0000","last_change":"2024-04-24T23:00:16.454748+0000","last_active":"2024-04-24T23:07:55.040526+0000","last_peered":"2024-04-24T23:07:55.040526+0000","last_clean":"2024-04-24T23:07:55.040526+0000","last_became_active":"2024-04-24T23:00:16.454031+0000","last_became_peered":"2024-04-24T23:00:16.454031+0000","last_unstale":"2024-04-24T23:07:55.040526+0000","last_undegraded":"2024-04-24T23:07:55.040526+0000","last_fullsized":"2024-04-24T23:07:55.040526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:31.237423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'68","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.719195+0000","last_change":"2024-04-24T23:00:15.420149+0000","last_active":"2024-04-24T23:07:53.719195+0000","last_peered":"2024-04-24T23:07:53.719195+0000","last_clean":"2024-04-24T23:07:53.719195+0000","last_became_active":"2024-04-24T23:00:15.416688+0000","last_became_peered":"2024-04-24T23:00:15.416688+0000","last_unstale":"2024-04-24T23:07:53.719195+0000","last_undegraded":"2024-04-24T23:07:53.719195+0000","last_fullsized":"2024-04-24T23:07:53.719195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:27.810443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":106,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'996","reported_seq":1017,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.798909+0000","last_change":"2024-04-24T23:00:20.517137+0000","last_active":"2024-04-24T23:07:55.798909+0000","last_peered":"2024-04-24T23:07:55.798909+0000","last_clean":"2024-04-24T23:07:55.798909+0000","last_became_active":"2024-04-24T23:00:20.516152+0000","last_became_peered":"2024-04-24T23:00:20.516152+0000","last_unstale":"2024-04-24T23:07:55.798909+0000","last_undegraded":"2024-04-24T23:07:55.798909+0000","last_fullsized":"2024-04-24T23:07:55.798909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:29.452352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":6136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'302","reported_seq":328,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.737685+0000","last_change":"2024-04-24T23:00:16.458939+0000","last_active":"2024-04-24T23:07:55.737685+0000","last_peered":"2024-04-24T23:07:55.737685+0000","last_clean":"2024-04-24T23:07:55.737685+0000","last_became_active":"2024-04-24T23:00:16.458081+0000","last_became_peered":"2024-04-24T23:00:16.458081+0000","last_unstale":"2024-04-24T23:07:55.737685+0000","last_undegraded":"2024-04-24T23:07:55.737685+0000","last_fullsized":"2024-04-24T23:07:55.737685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:27.760709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'41","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:48.697005+0000","last_change":"2024-04-24T23:00:15.413409+0000","last_active":"2024-04-24T23:07:48.697005+0000","last_peered":"2024-04-24T23:07:48.697005+0000","last_clean":"2024-04-24T23:07:48.697005+0000","last_became_active":"2024-04-24T23:00:15.412847+0000","last_became_peered":"2024-04-24T23:00:15.412847+0000","last_unstale":"2024-04-24T23:07:48.697005+0000","last_undegraded":"2024-04-24T23:07:48.697005+0000","last_fullsized":"2024-04-24T23:07:48.697005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:35.114960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":81,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'915","reported_seq":936,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.796705+0000","last_change":"2024-04-24T23:00:20.536112+0000","last_active":"2024-04-24T23:07:55.796705+0000","last_peered":"2024-04-24T23:07:55.796705+0000","last_clean":"2024-04-24T23:07:55.796705+0000","last_became_active":"2024-04-24T23:00:20.529427+0000","last_became_peered":"2024-04-24T23:00:20.529427+0000","last_unstale":"2024-04-24T23:07:55.796705+0000","last_undegraded":"2024-04-24T23:07:55.796705+0000","last_fullsized":"2024-04-24T23:07:55.796705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:14.639189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":6219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'313","reported_seq":340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.826183+0000","last_change":"2024-04-24T23:00:16.465373+0000","last_active":"2024-04-24T23:07:55.826183+0000","last_peered":"2024-04-24T23:07:55.826183+0000","last_clean":"2024-04-24T23:07:55.826183+0000","last_became_active":"2024-04-24T23:00:16.464653+0000","last_became_peered":"2024-04-24T23:00:16.464653+0000","last_unstale":"2024-04-24T23:07:55.826183+0000","last_undegraded":"2024-04-24T23:07:55.826183+0000","last_fullsized":"2024-04-24T23:07:55.826183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:24.143678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'531","reported_seq":560,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:51.885087+0000","last_change":"2024-04-24T23:00:15.427483+0000","last_active":"2024-04-24T23:07:51.885087+0000","last_peered":"2024-04-24T23:07:51.885087+0000","last_clean":"2024-04-24T23:07:51.885087+0000","last_became_active":"2024-04-24T23:00:15.426641+0000","last_became_peered":"2024-04-24T23:00:15.426641+0000","last_unstale":"2024-04-24T23:07:51.885087+0000","last_undegraded":"2024-04-24T23:07:51.885087+0000","last_fullsized":"2024-04-24T23:07:51.885087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":566,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'952","reported_seq":973,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.846819+0000","last_change":"2024-04-24T23:00:20.518479+0000","last_active":"2024-04-24T23:07:55.846819+0000","last_peered":"2024-04-24T23:07:55.846819+0000","last_clean":"2024-04-24T23:07:55.846819+0000","last_became_active":"2024-04-24T23:00:20.517950+0000","last_became_peered":"2024-04-24T23:00:20.517950+0000","last_unstale":"2024-04-24T23:07:55.846819+0000","last_undegraded":"2024-04-24T23:07:55.846819+0000","last_fullsized":"2024-04-24T23:07:55.846819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:37:10.220625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":7094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'288","reported_seq":315,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.826408+0000","last_change":"2024-04-24T23:00:16.456931+0000","last_active":"2024-04-24T23:07:55.826408+0000","last_peered":"2024-04-24T23:07:55.826408+0000","last_clean":"2024-04-24T23:07:55.826408+0000","last_became_active":"2024-04-24T23:00:16.456636+0000","last_became_peered":"2024-04-24T23:00:16.456636+0000","last_unstale":"2024-04-24T23:07:55.826408+0000","last_undegraded":"2024-04-24T23:07:55.826408+0000","last_fullsized":"2024-04-24T23:07:55.826408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:10.559806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'568","reported_seq":596,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.112279+0000","last_change":"2024-04-24T23:00:15.428189+0000","last_active":"2024-04-24T23:07:55.112279+0000","last_peered":"2024-04-24T23:07:55.112279+0000","last_clean":"2024-04-24T23:07:55.112279+0000","last_became_active":"2024-04-24T23:00:15.427837+0000","last_became_peered":"2024-04-24T23:00:15.427837+0000","last_unstale":"2024-04-24T23:07:55.112279+0000","last_undegraded":"2024-04-24T23:07:55.112279+0000","last_fullsized":"2024-04-24T23:07:55.112279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":635,"num_write_kb":21119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'1015","reported_seq":1043,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.871904+0000","last_change":"2024-04-24T23:00:57.865502+0000","last_active":"2024-04-24T23:07:55.871904+0000","last_peered":"2024-04-24T23:07:55.871904+0000","last_clean":"2024-04-24T23:07:55.871904+0000","last_became_active":"2024-04-24T23:00:57.864156+0000","last_became_peered":"2024-04-24T23:00:57.864156+0000","last_unstale":"2024-04-24T23:07:55.871904+0000","last_undegraded":"2024-04-24T23:07:55.871904+0000","last_fullsized":"2024-04-24T23:07:55.871904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:23.399284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":6923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'287","reported_seq":313,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.742115+0000","last_change":"2024-04-24T23:00:16.453438+0000","last_active":"2024-04-24T23:07:55.742115+0000","last_peered":"2024-04-24T23:07:55.742115+0000","last_clean":"2024-04-24T23:07:55.742115+0000","last_became_active":"2024-04-24T23:00:16.453033+0000","last_became_peered":"2024-04-24T23:00:16.453033+0000","last_unstale":"2024-04-24T23:07:55.742115+0000","last_undegraded":"2024-04-24T23:07:55.742115+0000","last_fullsized":"2024-04-24T23:07:55.742115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:52:36.324979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'667","reported_seq":696,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.918276+0000","last_change":"2024-04-24T23:00:15.431369+0000","last_active":"2024-04-24T23:07:55.918276+0000","last_peered":"2024-04-24T23:07:55.918276+0000","last_clean":"2024-04-24T23:07:55.918276+0000","last_became_active":"2024-04-24T23:00:15.430254+0000","last_became_peered":"2024-04-24T23:00:15.430254+0000","last_unstale":"2024-04-24T23:07:55.918276+0000","last_undegraded":"2024-04-24T23:07:55.918276+0000","last_fullsized":"2024-04-24T23:07:55.918276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":729,"num_write_kb":21519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'963","reported_seq":984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.909844+0000","last_change":"2024-04-24T23:00:20.503369+0000","last_active":"2024-04-24T23:07:55.909844+0000","last_peered":"2024-04-24T23:07:55.909844+0000","last_clean":"2024-04-24T23:07:55.909844+0000","last_became_active":"2024-04-24T23:00:20.502285+0000","last_became_peered":"2024-04-24T23:00:20.502285+0000","last_unstale":"2024-04-24T23:07:55.909844+0000","last_undegraded":"2024-04-24T23:07:55.909844+0000","last_fullsized":"2024-04-24T23:07:55.909844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'290","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.744532+0000","last_change":"2024-04-24T23:00:16.452958+0000","last_active":"2024-04-24T23:07:55.744532+0000","last_peered":"2024-04-24T23:07:55.744532+0000","last_clean":"2024-04-24T23:07:55.744532+0000","last_became_active":"2024-04-24T23:00:16.451611+0000","last_became_peered":"2024-04-24T23:00:16.451611+0000","last_unstale":"2024-04-24T23:07:55.744532+0000","last_undegraded":"2024-04-24T23:07:55.744532+0000","last_fullsized":"2024-04-24T23:07:55.744532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:06.283705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'414","reported_seq":443,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.714346+0000","last_change":"2024-04-24T23:00:15.397614+0000","last_active":"2024-04-24T23:07:53.714346+0000","last_peered":"2024-04-24T23:07:53.714346+0000","last_clean":"2024-04-24T23:07:53.714346+0000","last_became_active":"2024-04-24T23:00:15.397253+0000","last_became_peered":"2024-04-24T23:00:15.397253+0000","last_unstale":"2024-04-24T23:07:53.714346+0000","last_undegraded":"2024-04-24T23:07:53.714346+0000","last_fullsized":"2024-04-24T23:07:53.714346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:38.560562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":486,"num_write_kb":21108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'1063","reported_seq":1084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.895876+0000","last_change":"2024-04-24T23:00:20.506736+0000","last_active":"2024-04-24T23:07:55.895876+0000","last_peered":"2024-04-24T23:07:55.895876+0000","last_clean":"2024-04-24T23:07:55.895876+0000","last_became_active":"2024-04-24T23:00:20.505504+0000","last_became_peered":"2024-04-24T23:00:20.505504+0000","last_unstale":"2024-04-24T23:07:55.895876+0000","last_undegraded":"2024-04-24T23:07:55.895876+0000","last_fullsized":"2024-04-24T23:07:55.895876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:10.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1319,"num_write_kb":7863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'334","reported_seq":360,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.031431+0000","last_change":"2024-04-24T23:00:16.451217+0000","last_active":"2024-04-24T23:07:55.031431+0000","last_peered":"2024-04-24T23:07:55.031431+0000","last_clean":"2024-04-24T23:07:55.031431+0000","last_became_active":"2024-04-24T23:00:16.450149+0000","last_became_peered":"2024-04-24T23:00:16.450149+0000","last_unstale":"2024-04-24T23:07:55.031431+0000","last_undegraded":"2024-04-24T23:07:55.031431+0000","last_fullsized":"2024-04-24T23:07:55.031431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:36.124103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'68","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:52.715205+0000","last_change":"2024-04-24T23:00:15.428164+0000","last_active":"2024-04-24T23:07:52.715205+0000","last_peered":"2024-04-24T23:07:52.715205+0000","last_clean":"2024-04-24T23:07:52.715205+0000","last_became_active":"2024-04-24T23:00:15.427857+0000","last_became_peered":"2024-04-24T23:00:15.427857+0000","last_unstale":"2024-04-24T23:07:52.715205+0000","last_undegraded":"2024-04-24T23:07:52.715205+0000","last_fullsized":"2024-04-24T23:07:52.715205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":104,"num_write_kb":4310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'1074","reported_seq":1095,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.849955+0000","last_change":"2024-04-24T23:00:20.507135+0000","last_active":"2024-04-24T23:07:55.849955+0000","last_peered":"2024-04-24T23:07:55.849955+0000","last_clean":"2024-04-24T23:07:55.849955+0000","last_became_active":"2024-04-24T23:00:20.506257+0000","last_became_peered":"2024-04-24T23:00:20.506257+0000","last_unstale":"2024-04-24T23:07:55.849955+0000","last_undegraded":"2024-04-24T23:07:55.849955+0000","last_fullsized":"2024-04-24T23:07:55.849955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":7398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1072","reported_seq":1100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.819077+0000","last_change":"2024-04-24T23:00:57.867192+0000","last_active":"2024-04-24T23:07:55.819077+0000","last_peered":"2024-04-24T23:07:55.819077+0000","last_clean":"2024-04-24T23:07:55.819077+0000","last_became_active":"2024-04-24T23:00:57.865999+0000","last_became_peered":"2024-04-24T23:00:57.865999+0000","last_unstale":"2024-04-24T23:07:55.819077+0000","last_undegraded":"2024-04-24T23:07:55.819077+0000","last_fullsized":"2024-04-24T23:07:55.819077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1072,"log_dups_size":0,"ondisk_log_size":1072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:48.727897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1313,"num_write_kb":7137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'317","reported_seq":344,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.042267+0000","last_change":"2024-04-24T23:00:16.478734+0000","last_active":"2024-04-24T23:07:55.042267+0000","last_peered":"2024-04-24T23:07:55.042267+0000","last_clean":"2024-04-24T23:07:55.042267+0000","last_became_active":"2024-04-24T23:00:16.477474+0000","last_became_peered":"2024-04-24T23:00:16.477474+0000","last_unstale":"2024-04-24T23:07:55.042267+0000","last_undegraded":"2024-04-24T23:07:55.042267+0000","last_fullsized":"2024-04-24T23:07:55.042267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.178504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'570","reported_seq":598,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:51.887527+0000","last_change":"2024-04-24T23:00:15.405948+0000","last_active":"2024-04-24T23:07:51.887527+0000","last_peered":"2024-04-24T23:07:51.887527+0000","last_clean":"2024-04-24T23:07:51.887527+0000","last_became_active":"2024-04-24T23:00:15.405608+0000","last_became_peered":"2024-04-24T23:00:15.405608+0000","last_unstale":"2024-04-24T23:07:51.887527+0000","last_undegraded":"2024-04-24T23:07:51.887527+0000","last_fullsized":"2024-04-24T23:07:51.887527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":627,"num_write_kb":21153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'936","reported_seq":957,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.888541+0000","last_change":"2024-04-24T23:00:20.493810+0000","last_active":"2024-04-24T23:07:55.888541+0000","last_peered":"2024-04-24T23:07:55.888541+0000","last_clean":"2024-04-24T23:07:55.888541+0000","last_became_active":"2024-04-24T23:00:20.492303+0000","last_became_peered":"2024-04-24T23:00:20.492303+0000","last_unstale":"2024-04-24T23:07:55.888541+0000","last_undegraded":"2024-04-24T23:07:55.888541+0000","last_fullsized":"2024-04-24T23:07:55.888541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:58:38.649805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":6525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'350","reported_seq":377,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.847429+0000","last_change":"2024-04-24T23:00:16.465460+0000","last_active":"2024-04-24T23:07:55.847429+0000","last_peered":"2024-04-24T23:07:55.847429+0000","last_clean":"2024-04-24T23:07:55.847429+0000","last_became_active":"2024-04-24T23:00:16.457311+0000","last_became_peered":"2024-04-24T23:00:16.457311+0000","last_unstale":"2024-04-24T23:07:55.847429+0000","last_undegraded":"2024-04-24T23:07:55.847429+0000","last_fullsized":"2024-04-24T23:07:55.847429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:43:08.876496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":274,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'151","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.731772+0000","last_change":"2024-04-24T23:00:15.436608+0000","last_active":"2024-04-24T23:07:55.731772+0000","last_peered":"2024-04-24T23:07:55.731772+0000","last_clean":"2024-04-24T23:07:55.731772+0000","last_became_active":"2024-04-24T23:00:15.435730+0000","last_became_peered":"2024-04-24T23:00:15.435730+0000","last_unstale":"2024-04-24T23:07:55.731772+0000","last_undegraded":"2024-04-24T23:07:55.731772+0000","last_fullsized":"2024-04-24T23:07:55.731772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":198,"num_write_kb":4560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'1083","reported_seq":1111,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.719094+0000","last_change":"2024-04-24T23:00:15.417533+0000","last_active":"2024-04-24T23:07:53.719094+0000","last_peered":"2024-04-24T23:07:53.719094+0000","last_clean":"2024-04-24T23:07:53.719094+0000","last_became_active":"2024-04-24T23:00:15.417226+0000","last_became_peered":"2024-04-24T23:00:15.417226+0000","last_unstale":"2024-04-24T23:07:53.719094+0000","last_undegraded":"2024-04-24T23:07:53.719094+0000","last_fullsized":"2024-04-24T23:07:53.719094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1083,"log_dups_size":0,"ondisk_log_size":1083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:05.898513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":1127,"num_write_kb":29507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'292","reported_seq":319,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.844081+0000","last_change":"2024-04-24T23:00:16.483374+0000","last_active":"2024-04-24T23:07:55.844081+0000","last_peered":"2024-04-24T23:07:55.844081+0000","last_clean":"2024-04-24T23:07:55.844081+0000","last_became_active":"2024-04-24T23:00:16.482676+0000","last_became_peered":"2024-04-24T23:00:16.482676+0000","last_unstale":"2024-04-24T23:07:55.844081+0000","last_undegraded":"2024-04-24T23:07:55.844081+0000","last_fullsized":"2024-04-24T23:07:55.844081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:05.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'936","reported_seq":957,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.856157+0000","last_change":"2024-04-24T23:00:20.542916+0000","last_active":"2024-04-24T23:07:55.856157+0000","last_peered":"2024-04-24T23:07:55.856157+0000","last_clean":"2024-04-24T23:07:55.856157+0000","last_became_active":"2024-04-24T23:00:20.541822+0000","last_became_peered":"2024-04-24T23:00:20.541822+0000","last_unstale":"2024-04-24T23:07:55.856157+0000","last_undegraded":"2024-04-24T23:07:55.856157+0000","last_fullsized":"2024-04-24T23:07:55.856157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:31.840092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":5864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'464","reported_seq":493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:48.756371+0000","last_change":"2024-04-24T23:00:15.425495+0000","last_active":"2024-04-24T23:07:48.756371+0000","last_peered":"2024-04-24T23:07:48.756371+0000","last_clean":"2024-04-24T23:07:48.756371+0000","last_became_active":"2024-04-24T23:00:15.424739+0000","last_became_peered":"2024-04-24T23:00:15.424739+0000","last_unstale":"2024-04-24T23:07:48.756371+0000","last_undegraded":"2024-04-24T23:07:48.756371+0000","last_fullsized":"2024-04-24T23:07:48.756371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:49.740745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":495,"num_write_kb":8616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'322","reported_seq":349,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.824990+0000","last_change":"2024-04-24T23:00:16.454250+0000","last_active":"2024-04-24T23:07:55.824990+0000","last_peered":"2024-04-24T23:07:55.824990+0000","last_clean":"2024-04-24T23:07:55.824990+0000","last_became_active":"2024-04-24T23:00:16.453965+0000","last_became_peered":"2024-04-24T23:00:16.453965+0000","last_unstale":"2024-04-24T23:07:55.824990+0000","last_undegraded":"2024-04-24T23:07:55.824990+0000","last_fullsized":"2024-04-24T23:07:55.824990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'945","reported_seq":966,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.864627+0000","last_change":"2024-04-24T23:00:20.510475+0000","last_active":"2024-04-24T23:07:55.864627+0000","last_peered":"2024-04-24T23:07:55.864627+0000","last_clean":"2024-04-24T23:07:55.864627+0000","last_became_active":"2024-04-24T23:00:20.509269+0000","last_became_peered":"2024-04-24T23:00:20.509269+0000","last_unstale":"2024-04-24T23:07:55.864627+0000","last_undegraded":"2024-04-24T23:07:55.864627+0000","last_fullsized":"2024-04-24T23:07:55.864627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:09.596902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":6611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'342","reported_seq":368,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.870236+0000","last_change":"2024-04-24T23:00:16.456976+0000","last_active":"2024-04-24T23:07:55.870236+0000","last_peered":"2024-04-24T23:07:55.870236+0000","last_clean":"2024-04-24T23:07:55.870236+0000","last_became_active":"2024-04-24T23:00:16.456289+0000","last_became_peered":"2024-04-24T23:00:16.456289+0000","last_unstale":"2024-04-24T23:07:55.870236+0000","last_undegraded":"2024-04-24T23:07:55.870236+0000","last_fullsized":"2024-04-24T23:07:55.870236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'342","reported_seq":369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.876711+0000","last_change":"2024-04-24T23:00:16.471774+0000","last_active":"2024-04-24T23:07:55.876711+0000","last_peered":"2024-04-24T23:07:55.876711+0000","last_clean":"2024-04-24T23:07:55.876711+0000","last_became_active":"2024-04-24T23:00:16.466134+0000","last_became_peered":"2024-04-24T23:00:16.466134+0000","last_unstale":"2024-04-24T23:07:55.876711+0000","last_undegraded":"2024-04-24T23:07:55.876711+0000","last_fullsized":"2024-04-24T23:07:55.876711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:31.237423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'344","reported_seq":370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.862968+0000","last_change":"2024-04-24T23:00:16.465926+0000","last_active":"2024-04-24T23:07:55.862968+0000","last_peered":"2024-04-24T23:07:55.862968+0000","last_clean":"2024-04-24T23:07:55.862968+0000","last_became_active":"2024-04-24T23:00:16.465659+0000","last_became_peered":"2024-04-24T23:00:16.465659+0000","last_unstale":"2024-04-24T23:07:55.862968+0000","last_undegraded":"2024-04-24T23:07:55.862968+0000","last_fullsized":"2024-04-24T23:07:55.862968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:09:47.001195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'312","reported_seq":339,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.787739+0000","last_change":"2024-04-24T23:00:16.474929+0000","last_active":"2024-04-24T23:07:55.787739+0000","last_peered":"2024-04-24T23:07:55.787739+0000","last_clean":"2024-04-24T23:07:55.787739+0000","last_became_active":"2024-04-24T23:00:16.474181+0000","last_became_peered":"2024-04-24T23:00:16.474181+0000","last_unstale":"2024-04-24T23:07:55.787739+0000","last_undegraded":"2024-04-24T23:07:55.787739+0000","last_fullsized":"2024-04-24T23:07:55.787739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:56.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'294","reported_seq":321,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.804693+0000","last_change":"2024-04-24T23:00:16.458411+0000","last_active":"2024-04-24T23:07:55.804693+0000","last_peered":"2024-04-24T23:07:55.804693+0000","last_clean":"2024-04-24T23:07:55.804693+0000","last_became_active":"2024-04-24T23:00:16.457641+0000","last_became_peered":"2024-04-24T23:00:16.457641+0000","last_unstale":"2024-04-24T23:07:55.804693+0000","last_undegraded":"2024-04-24T23:07:55.804693+0000","last_fullsized":"2024-04-24T23:07:55.804693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:06.907656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'296","reported_seq":323,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.877058+0000","last_change":"2024-04-24T23:00:16.470324+0000","last_active":"2024-04-24T23:07:55.877058+0000","last_peered":"2024-04-24T23:07:55.877058+0000","last_clean":"2024-04-24T23:07:55.877058+0000","last_became_active":"2024-04-24T23:00:16.469614+0000","last_became_peered":"2024-04-24T23:00:16.469614+0000","last_unstale":"2024-04-24T23:07:55.877058+0000","last_undegraded":"2024-04-24T23:07:55.877058+0000","last_fullsized":"2024-04-24T23:07:55.877058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:05.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'361","reported_seq":387,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.886428+0000","last_change":"2024-04-24T23:00:16.450764+0000","last_active":"2024-04-24T23:07:55.886428+0000","last_peered":"2024-04-24T23:07:55.886428+0000","last_clean":"2024-04-24T23:07:55.886428+0000","last_became_active":"2024-04-24T23:00:16.450561+0000","last_became_peered":"2024-04-24T23:00:16.450561+0000","last_unstale":"2024-04-24T23:07:55.886428+0000","last_undegraded":"2024-04-24T23:07:55.886428+0000","last_fullsized":"2024-04-24T23:07:55.886428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:30.426371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'352","reported_seq":379,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.810269+0000","last_change":"2024-04-24T23:00:16.453953+0000","last_active":"2024-04-24T23:07:55.810269+0000","last_peered":"2024-04-24T23:07:55.810269+0000","last_clean":"2024-04-24T23:07:55.810269+0000","last_became_active":"2024-04-24T23:00:16.452345+0000","last_became_peered":"2024-04-24T23:00:16.452345+0000","last_unstale":"2024-04-24T23:07:55.810269+0000","last_undegraded":"2024-04-24T23:07:55.810269+0000","last_fullsized":"2024-04-24T23:07:55.810269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:58.273719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'330","reported_seq":356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.859472+0000","last_change":"2024-04-24T23:00:16.459030+0000","last_active":"2024-04-24T23:07:55.859472+0000","last_peered":"2024-04-24T23:07:55.859472+0000","last_clean":"2024-04-24T23:07:55.859472+0000","last_became_active":"2024-04-24T23:00:16.458402+0000","last_became_peered":"2024-04-24T23:00:16.458402+0000","last_unstale":"2024-04-24T23:07:55.859472+0000","last_undegraded":"2024-04-24T23:07:55.859472+0000","last_fullsized":"2024-04-24T23:07:55.859472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:33.558529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'298","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.893126+0000","last_change":"2024-04-24T23:00:16.456818+0000","last_active":"2024-04-24T23:07:54.893126+0000","last_peered":"2024-04-24T23:07:54.893126+0000","last_clean":"2024-04-24T23:07:54.893126+0000","last_became_active":"2024-04-24T23:00:16.453065+0000","last_became_peered":"2024-04-24T23:00:16.453065+0000","last_unstale":"2024-04-24T23:07:54.893126+0000","last_undegraded":"2024-04-24T23:07:54.893126+0000","last_fullsized":"2024-04-24T23:07:54.893126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:02.728439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'319","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.853778+0000","last_change":"2024-04-24T23:00:57.866802+0000","last_active":"2024-04-24T23:07:55.853778+0000","last_peered":"2024-04-24T23:07:55.853778+0000","last_clean":"2024-04-24T23:07:55.853778+0000","last_became_active":"2024-04-24T23:00:57.865894+0000","last_became_peered":"2024-04-24T23:00:57.865894+0000","last_unstale":"2024-04-24T23:07:55.853778+0000","last_undegraded":"2024-04-24T23:07:55.853778+0000","last_fullsized":"2024-04-24T23:07:55.853778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:31.077128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'298","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.834866+0000","last_change":"2024-04-24T23:00:16.478716+0000","last_active":"2024-04-24T23:07:55.834866+0000","last_peered":"2024-04-24T23:07:55.834866+0000","last_clean":"2024-04-24T23:07:55.834866+0000","last_became_active":"2024-04-24T23:00:16.477982+0000","last_became_peered":"2024-04-24T23:00:16.477982+0000","last_unstale":"2024-04-24T23:07:55.834866+0000","last_undegraded":"2024-04-24T23:07:55.834866+0000","last_fullsized":"2024-04-24T23:07:55.834866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:04.285389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'345","reported_seq":372,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.842536+0000","last_change":"2024-04-24T23:00:16.449265+0000","last_active":"2024-04-24T23:07:55.842536+0000","last_peered":"2024-04-24T23:07:55.842536+0000","last_clean":"2024-04-24T23:07:55.842536+0000","last_became_active":"2024-04-24T23:00:16.446583+0000","last_became_peered":"2024-04-24T23:00:16.446583+0000","last_unstale":"2024-04-24T23:07:55.842536+0000","last_undegraded":"2024-04-24T23:07:55.842536+0000","last_fullsized":"2024-04-24T23:07:55.842536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:38.429072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'300","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.765878+0000","last_change":"2024-04-24T23:00:16.483354+0000","last_active":"2024-04-24T23:07:55.765878+0000","last_peered":"2024-04-24T23:07:55.765878+0000","last_clean":"2024-04-24T23:07:55.765878+0000","last_became_active":"2024-04-24T23:00:16.483079+0000","last_became_peered":"2024-04-24T23:00:16.483079+0000","last_unstale":"2024-04-24T23:07:55.765878+0000","last_undegraded":"2024-04-24T23:07:55.765878+0000","last_fullsized":"2024-04-24T23:07:55.765878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:57:02.861698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'293","reported_seq":320,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.808924+0000","last_change":"2024-04-24T23:00:16.472605+0000","last_active":"2024-04-24T23:07:55.808924+0000","last_peered":"2024-04-24T23:07:55.808924+0000","last_clean":"2024-04-24T23:07:55.808924+0000","last_became_active":"2024-04-24T23:00:16.466076+0000","last_became_peered":"2024-04-24T23:00:16.466076+0000","last_unstale":"2024-04-24T23:07:55.808924+0000","last_undegraded":"2024-04-24T23:07:55.808924+0000","last_fullsized":"2024-04-24T23:07:55.808924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'316","reported_seq":342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.948785+0000","last_change":"2024-04-24T23:00:16.457737+0000","last_active":"2024-04-24T23:07:54.948785+0000","last_peered":"2024-04-24T23:07:54.948785+0000","last_clean":"2024-04-24T23:07:54.948785+0000","last_became_active":"2024-04-24T23:00:16.453949+0000","last_became_peered":"2024-04-24T23:00:16.453949+0000","last_unstale":"2024-04-24T23:07:54.948785+0000","last_undegraded":"2024-04-24T23:07:54.948785+0000","last_fullsized":"2024-04-24T23:07:54.948785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:08.928463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'325","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.898422+0000","last_change":"2024-04-24T23:00:16.452839+0000","last_active":"2024-04-24T23:07:55.898422+0000","last_peered":"2024-04-24T23:07:55.898422+0000","last_clean":"2024-04-24T23:07:55.898422+0000","last_became_active":"2024-04-24T23:00:16.445253+0000","last_became_peered":"2024-04-24T23:00:16.445253+0000","last_unstale":"2024-04-24T23:07:55.898422+0000","last_undegraded":"2024-04-24T23:07:55.898422+0000","last_fullsized":"2024-04-24T23:07:55.898422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:23.938299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'300","reported_seq":327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.837775+0000","last_change":"2024-04-24T23:00:16.455784+0000","last_active":"2024-04-24T23:07:55.837775+0000","last_peered":"2024-04-24T23:07:55.837775+0000","last_clean":"2024-04-24T23:07:55.837775+0000","last_became_active":"2024-04-24T23:00:16.454953+0000","last_became_peered":"2024-04-24T23:00:16.454953+0000","last_unstale":"2024-04-24T23:07:55.837775+0000","last_undegraded":"2024-04-24T23:07:55.837775+0000","last_fullsized":"2024-04-24T23:07:55.837775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:32.545524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'310","reported_seq":337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.982689+0000","last_change":"2024-04-24T23:00:16.468365+0000","last_active":"2024-04-24T23:07:54.982689+0000","last_peered":"2024-04-24T23:07:54.982689+0000","last_clean":"2024-04-24T23:07:54.982689+0000","last_became_active":"2024-04-24T23:00:16.467630+0000","last_became_peered":"2024-04-24T23:00:16.467630+0000","last_unstale":"2024-04-24T23:07:54.982689+0000","last_undegraded":"2024-04-24T23:07:54.982689+0000","last_fullsized":"2024-04-24T23:07:54.982689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'299","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.891514+0000","last_change":"2024-04-24T23:00:16.456188+0000","last_active":"2024-04-24T23:07:55.891514+0000","last_peered":"2024-04-24T23:07:55.891514+0000","last_clean":"2024-04-24T23:07:55.891514+0000","last_became_active":"2024-04-24T23:00:16.455114+0000","last_became_peered":"2024-04-24T23:00:16.455114+0000","last_unstale":"2024-04-24T23:07:55.891514+0000","last_undegraded":"2024-04-24T23:07:55.891514+0000","last_fullsized":"2024-04-24T23:07:55.891514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:36.124103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'280","reported_seq":307,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.919164+0000","last_change":"2024-04-24T23:00:16.450776+0000","last_active":"2024-04-24T23:07:54.919164+0000","last_peered":"2024-04-24T23:07:54.919164+0000","last_clean":"2024-04-24T23:07:54.919164+0000","last_became_active":"2024-04-24T23:00:16.450466+0000","last_became_peered":"2024-04-24T23:00:16.450466+0000","last_unstale":"2024-04-24T23:07:54.919164+0000","last_undegraded":"2024-04-24T23:07:54.919164+0000","last_fullsized":"2024-04-24T23:07:54.919164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:32.331306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'301","reported_seq":328,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.824146+0000","last_change":"2024-04-24T23:00:16.450743+0000","last_active":"2024-04-24T23:07:55.824146+0000","last_peered":"2024-04-24T23:07:55.824146+0000","last_clean":"2024-04-24T23:07:55.824146+0000","last_became_active":"2024-04-24T23:00:16.450279+0000","last_became_peered":"2024-04-24T23:00:16.450279+0000","last_unstale":"2024-04-24T23:07:55.824146+0000","last_undegraded":"2024-04-24T23:07:55.824146+0000","last_fullsized":"2024-04-24T23:07:55.824146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:00.869015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'283","reported_seq":310,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.826150+0000","last_change":"2024-04-24T23:00:16.446745+0000","last_active":"2024-04-24T23:07:55.826150+0000","last_peered":"2024-04-24T23:07:55.826150+0000","last_clean":"2024-04-24T23:07:55.826150+0000","last_became_active":"2024-04-24T23:00:16.446317+0000","last_became_peered":"2024-04-24T23:00:16.446317+0000","last_unstale":"2024-04-24T23:07:55.826150+0000","last_undegraded":"2024-04-24T23:07:55.826150+0000","last_fullsized":"2024-04-24T23:07:55.826150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:47.110869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'326","reported_seq":353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.759740+0000","last_change":"2024-04-24T23:00:16.446352+0000","last_active":"2024-04-24T23:07:55.759740+0000","last_peered":"2024-04-24T23:07:55.759740+0000","last_clean":"2024-04-24T23:07:55.759740+0000","last_became_active":"2024-04-24T23:00:16.445839+0000","last_became_peered":"2024-04-24T23:00:16.445839+0000","last_unstale":"2024-04-24T23:07:55.759740+0000","last_undegraded":"2024-04-24T23:07:55.759740+0000","last_fullsized":"2024-04-24T23:07:55.759740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'264","reported_seq":291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.864112+0000","last_change":"2024-04-24T23:00:16.451439+0000","last_active":"2024-04-24T23:07:53.864112+0000","last_peered":"2024-04-24T23:07:53.864112+0000","last_clean":"2024-04-24T23:07:53.864112+0000","last_became_active":"2024-04-24T23:00:16.450293+0000","last_became_peered":"2024-04-24T23:00:16.450293+0000","last_unstale":"2024-04-24T23:07:53.864112+0000","last_undegraded":"2024-04-24T23:07:53.864112+0000","last_fullsized":"2024-04-24T23:07:53.864112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:19.586817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'309","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.801587+0000","last_change":"2024-04-24T23:00:16.482222+0000","last_active":"2024-04-24T23:07:55.801587+0000","last_peered":"2024-04-24T23:07:55.801587+0000","last_clean":"2024-04-24T23:07:55.801587+0000","last_became_active":"2024-04-24T23:00:16.481897+0000","last_became_peered":"2024-04-24T23:00:16.481897+0000","last_unstale":"2024-04-24T23:07:55.801587+0000","last_undegraded":"2024-04-24T23:07:55.801587+0000","last_fullsized":"2024-04-24T23:07:55.801587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'312","reported_seq":338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.842591+0000","last_change":"2024-04-24T23:00:16.482100+0000","last_active":"2024-04-24T23:07:55.842591+0000","last_peered":"2024-04-24T23:07:55.842591+0000","last_clean":"2024-04-24T23:07:55.842591+0000","last_became_active":"2024-04-24T23:00:16.481832+0000","last_became_peered":"2024-04-24T23:00:16.481832+0000","last_unstale":"2024-04-24T23:07:55.842591+0000","last_undegraded":"2024-04-24T23:07:55.842591+0000","last_fullsized":"2024-04-24T23:07:55.842591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'319","reported_seq":346,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.850019+0000","last_change":"2024-04-24T23:00:16.466121+0000","last_active":"2024-04-24T23:07:55.850019+0000","last_peered":"2024-04-24T23:07:55.850019+0000","last_clean":"2024-04-24T23:07:55.850019+0000","last_became_active":"2024-04-24T23:00:16.465749+0000","last_became_peered":"2024-04-24T23:00:16.465749+0000","last_unstale":"2024-04-24T23:07:55.850019+0000","last_undegraded":"2024-04-24T23:07:55.850019+0000","last_fullsized":"2024-04-24T23:07:55.850019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:05.734745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'300","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.811380+0000","last_change":"2024-04-24T23:00:16.481682+0000","last_active":"2024-04-24T23:07:55.811380+0000","last_peered":"2024-04-24T23:07:55.811380+0000","last_clean":"2024-04-24T23:07:55.811380+0000","last_became_active":"2024-04-24T23:00:16.481381+0000","last_became_peered":"2024-04-24T23:00:16.481381+0000","last_unstale":"2024-04-24T23:07:55.811380+0000","last_undegraded":"2024-04-24T23:07:55.811380+0000","last_fullsized":"2024-04-24T23:07:55.811380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:14.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'298","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.837116+0000","last_change":"2024-04-24T23:00:16.461984+0000","last_active":"2024-04-24T23:07:55.837116+0000","last_peered":"2024-04-24T23:07:55.837116+0000","last_clean":"2024-04-24T23:07:55.837116+0000","last_became_active":"2024-04-24T23:00:16.461267+0000","last_became_peered":"2024-04-24T23:00:16.461267+0000","last_unstale":"2024-04-24T23:07:55.837116+0000","last_undegraded":"2024-04-24T23:07:55.837116+0000","last_fullsized":"2024-04-24T23:07:55.837116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:53:00.776972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'322","reported_seq":349,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.055917+0000","last_change":"2024-04-24T23:00:16.460191+0000","last_active":"2024-04-24T23:07:55.055917+0000","last_peered":"2024-04-24T23:07:55.055917+0000","last_clean":"2024-04-24T23:07:55.055917+0000","last_became_active":"2024-04-24T23:00:16.459445+0000","last_became_peered":"2024-04-24T23:00:16.459445+0000","last_unstale":"2024-04-24T23:07:55.055917+0000","last_undegraded":"2024-04-24T23:07:55.055917+0000","last_fullsized":"2024-04-24T23:07:55.055917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:12.313822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'302","reported_seq":329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.882819+0000","last_change":"2024-04-24T23:00:16.450409+0000","last_active":"2024-04-24T23:07:55.882819+0000","last_peered":"2024-04-24T23:07:55.882819+0000","last_clean":"2024-04-24T23:07:55.882819+0000","last_became_active":"2024-04-24T23:00:16.450061+0000","last_became_peered":"2024-04-24T23:00:16.450061+0000","last_unstale":"2024-04-24T23:07:55.882819+0000","last_undegraded":"2024-04-24T23:07:55.882819+0000","last_fullsized":"2024-04-24T23:07:55.882819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:23.938299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40344,"num_write_kb":220872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32314,"ondisk_log_size":32314,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15318,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19901,"ondisk_log_size":19901,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":156035250,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":1142,"num_read_kb":1796,"num_write":15514,"num_write_kb":443772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87621632,"data_stored":312070500,"data_compressed":57713942,"data_compressed_allocated":71589888,"data_compressed_original":296099840,"omap_allocated":0,"internal_metadata":0},"log_size":13412,"ondisk_log_size":13412,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509537,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116732,"kb_used_data":9204,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94255108,"statfs":{"total":96636764160,"available":96517230592,"internally_reserved":0,"allocated":9424896,"data_stored":30817518,"data_compressed":5693383,"data_compressed_allocated":7151616,"data_compressed_original":28721152,"omap_allocated":1590,"internal_metadata":110098890},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509537,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112904,"kb_used_data":9600,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94258936,"statfs":{"total":96636764160,"available":96521150464,"internally_reserved":0,"allocated":9830400,"data_stored":37368214,"data_compressed":6737911,"data_compressed_allocated":8192000,"data_compressed_original":35913728,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509538,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133964,"kb_used_data":12612,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94237876,"statfs":{"total":96636764160,"available":96499585024,"internally_reserved":0,"allocated":12914688,"data_stored":46253360,"data_compressed":8519580,"data_compressed_allocated":10514432,"data_compressed_original":44023808,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509538,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89148,"kb_used_data":3828,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94282692,"statfs":{"total":96636764160,"available":96545476608,"internally_reserved":0,"allocated":3919872,"data_stored":12699018,"data_compressed":2449723,"data_compressed_allocated":3092480,"data_compressed_original":12046336,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509538,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109104,"kb_used_data":9896,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94262736,"statfs":{"total":96636764160,"available":96525041664,"internally_reserved":0,"allocated":10133504,"data_stored":34260304,"data_compressed":6393594,"data_compressed_allocated":7995392,"data_compressed_original":32296960,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509537,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127780,"kb_used_data":16156,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94244060,"statfs":{"total":96636764160,"available":96505917440,"internally_reserved":0,"allocated":16543744,"data_stored":58338446,"data_compressed":10526573,"data_compressed_allocated":13012992,"data_compressed_original":54984704,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,7,5,6],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542243,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91380,"kb_used_data":10220,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94280460,"statfs":{"total":96636764160,"available":96543191040,"internally_reserved":0,"allocated":10465280,"data_stored":37864170,"data_compressed":6877701,"data_compressed_allocated":8454144,"data_compressed_original":36020224,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119692,"kb_used_data":16388,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94252148,"statfs":{"total":96636764160,"available":96514199552,"internally_reserved":0,"allocated":16781312,"data_stored":56573678,"data_compressed":10582231,"data_compressed_allocated":13266944,"data_compressed_original":53239808,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16261120,"data_stored":58223012,"data_compressed":10526573,"data_compressed_allocated":13012992,"data_compressed_original":54984704,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9785344,"data_stored":33554502,"data_compressed":6360217,"data_compressed_allocated":7950336,"data_compressed_original":31723520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3637248,"data_stored":12583584,"data_compressed":2449723,"data_compressed_allocated":3092480,"data_compressed_original":12046336,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":46137926,"data_compressed":8519580,"data_compressed_allocated":10514432,"data_compressed_original":44023808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9547776,"data_stored":37252780,"data_compressed":6737911,"data_compressed_allocated":8192000,"data_compressed_original":35913728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16433152,"data_stored":55867876,"data_compressed":10548854,"data_compressed_allocated":13221888,"data_compressed_original":52666368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10182656,"data_stored":37748736,"data_compressed":6877701,"data_compressed_allocated":8454144,"data_compressed_original":36020224,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9142272,"data_stored":30702084,"data_compressed":5693383,"data_compressed_allocated":7151616,"data_compressed_original":28721152,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:08:04.184 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T23:08:04.184 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:08:04.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf9375640 1 Processor -- start 2024-04-24T23:08:04.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf9375640 1 -- start start 2024-04-24T23:08:04.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf9375640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbcf4072f40 0x7fbcf4145500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:04.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf9375640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbcf406be60 0x7fbcf4145a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:04.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf9375640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf40b4ed0 0x7fbcf40b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:04.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf9375640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf40b61c0 con 0x7fbcf4072f40 2024-04-24T23:08:04.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf9375640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf40b5d30 con 0x7fbcf406be60 2024-04-24T23:08:04.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf9375640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf40b5720 con 0x7fbcf40b4ed0 2024-04-24T23:08:04.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf2ffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbcf4072f40 0x7fbcf4145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:04.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf2ffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbcf4072f40 0x7fbcf4145500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54702/0 (socket says 172.21.15.43:54702) 2024-04-24T23:08:04.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf2ffd640 1 -- 172.21.15.43:0/1898887815 learned_addr learned my addr 172.21.15.43:0/1898887815 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:04.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf37fe640 1 --2- 172.21.15.43:0/1898887815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf40b4ed0 0x7fbcf40b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:04.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf27fc640 1 --2- 172.21.15.43:0/1898887815 >> v2:172.21.15.162:3300/0 conn(0x7fbcf406be60 0x7fbcf4145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:04.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf2ffd640 1 -- 172.21.15.43:0/1898887815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf40b4ed0 msgr2=0x7fbcf40b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:04.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf2ffd640 1 --2- 172.21.15.43:0/1898887815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf40b4ed0 0x7fbcf40b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf2ffd640 1 -- 172.21.15.43:0/1898887815 >> v2:172.21.15.162:3300/0 conn(0x7fbcf406be60 msgr2=0x7fbcf4145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:04.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf2ffd640 1 --2- 172.21.15.43:0/1898887815 >> v2:172.21.15.162:3300/0 conn(0x7fbcf406be60 0x7fbcf4145a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf2ffd640 1 -- 172.21.15.43:0/1898887815 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf4073320 con 0x7fbcf4072f40 2024-04-24T23:08:04.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf37fe640 1 --2- 172.21.15.43:0/1898887815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf40b4ed0 0x7fbcf40b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:04.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf2ffd640 1 --2- 172.21.15.43:0/1898887815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf4072f40 0x7fbcf4145500 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4146630 tx=0x7fbce401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a242b0dc87caa8de server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:04.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf1ffb640 1 -- 172.21.15.43:0/1898887815 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce40a5790 con 0x7fbcf4072f40 2024-04-24T23:08:04.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf1ffb640 1 -- 172.21.15.43:0/1898887815 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce40a5930 con 0x7fbcf4072f40 2024-04-24T23:08:04.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.334+0000 7fbcf1ffb640 1 -- 172.21.15.43:0/1898887815 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce40a5d00 con 0x7fbcf4072f40 2024-04-24T23:08:04.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 -- 172.21.15.43:0/1898887815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf4072f40 msgr2=0x7fbcf4145500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:04.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 --2- 172.21.15.43:0/1898887815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf4072f40 0x7fbcf4145500 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4146630 tx=0x7fbce401c930 comp rx=0 tx=0).stop 2024-04-24T23:08:04.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 -- 172.21.15.43:0/1898887815 shutdown_connections 2024-04-24T23:08:04.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 --2- 172.21.15.43:0/1898887815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf40b4ed0 0x7fbcf40b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 --2- 172.21.15.43:0/1898887815 >> v2:172.21.15.162:3300/0 conn(0x7fbcf406be60 0x7fbcf4145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 --2- 172.21.15.43:0/1898887815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf4072f40 0x7fbcf4145500 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 -- 172.21.15.43:0/1898887815 >> 172.21.15.43:0/1898887815 conn(0x7fbcf406c300 msgr2=0x7fbcf406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:04.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 -- 172.21.15.43:0/1898887815 shutdown_connections 2024-04-24T23:08:04.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 -- 172.21.15.43:0/1898887815 wait complete. 2024-04-24T23:08:04.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 Processor -- start 2024-04-24T23:08:04.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 -- start start 2024-04-24T23:08:04.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf406be60 0x7fbcf41e4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:04.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf4072f40 0x7fbcf414df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:04.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf40b4ed0 0x7fbcf41458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:04.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf4149400 con 0x7fbcf4072f40 2024-04-24T23:08:04.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf4149280 con 0x7fbcf40b4ed0 2024-04-24T23:08:04.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf4149580 con 0x7fbcf406be60 2024-04-24T23:08:04.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf27fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf4072f40 0x7fbcf414df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:04.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf27fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf4072f40 0x7fbcf414df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54718/0 (socket says 172.21.15.43:54718) 2024-04-24T23:08:04.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf27fc640 1 -- 172.21.15.43:0/1523090822 learned_addr learned my addr 172.21.15.43:0/1523090822 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:04.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf2ffd640 1 --2- 172.21.15.43:0/1523090822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf406be60 0x7fbcf41e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:04.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf37fe640 1 --2- 172.21.15.43:0/1523090822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf40b4ed0 0x7fbcf41458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:04.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf27fc640 1 -- 172.21.15.43:0/1523090822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf406be60 msgr2=0x7fbcf41e4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:04.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf27fc640 1 --2- 172.21.15.43:0/1523090822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf406be60 0x7fbcf41e4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf27fc640 1 -- 172.21.15.43:0/1523090822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf40b4ed0 msgr2=0x7fbcf41458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:04.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf27fc640 1 --2- 172.21.15.43:0/1523090822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf40b4ed0 0x7fbcf41458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf27fc640 1 -- 172.21.15.43:0/1523090822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf41e3540 con 0x7fbcf4072f40 2024-04-24T23:08:04.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf37fe640 1 --2- 172.21.15.43:0/1523090822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf40b4ed0 0x7fbcf41458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:04.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf27fc640 1 --2- 172.21.15.43:0/1523090822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf4072f40 0x7fbcf414df70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbce800c7f0 tx=0x7fbce800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:04.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcdb7fe640 1 -- 172.21.15.43:0/1523090822 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8015070 con 0x7fbcf4072f40 2024-04-24T23:08:04.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcdb7fe640 1 -- 172.21.15.43:0/1523090822 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce8004240 con 0x7fbcf4072f40 2024-04-24T23:08:04.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcdb7fe640 1 -- 172.21.15.43:0/1523090822 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8003620 con 0x7fbcf4072f40 2024-04-24T23:08:04.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 -- 172.21.15.43:0/1523090822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf41e3820 con 0x7fbcf4072f40 2024-04-24T23:08:04.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.338+0000 7fbcf9375640 1 -- 172.21.15.43:0/1523090822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf4146180 con 0x7fbcf4072f40 2024-04-24T23:08:04.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.342+0000 7fbcf9375640 1 -- 172.21.15.43:0/1523090822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf41e3b50 con 0x7fbcf4072f40 2024-04-24T23:08:04.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.342+0000 7fbcdb7fe640 1 -- 172.21.15.43:0/1523090822 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbce80039d0 con 0x7fbcf4072f40 2024-04-24T23:08:04.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.342+0000 7fbcdb7fe640 1 --2- 172.21.15.43:0/1523090822 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbce00678c0 0x7fbce0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:04.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.342+0000 7fbcdb7fe640 1 -- 172.21.15.43:0/1523090822 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fbce80860c0 con 0x7fbcf4072f40 2024-04-24T23:08:04.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.342+0000 7fbcf2ffd640 1 --2- 172.21.15.43:0/1523090822 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbce00678c0 0x7fbce0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:04.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.342+0000 7fbcf2ffd640 1 --2- 172.21.15.43:0/1523090822 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbce00678c0 0x7fbce0069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbce40ae000 tx=0x7fbce40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:04.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.346+0000 7fbcdb7fe640 1 -- 172.21.15.43:0/1523090822 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fbce80568c0 con 0x7fbcf4072f40 2024-04-24T23:08:04.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.502+0000 7fbcf9375640 1 -- 172.21.15.43:0/1523090822 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbcf404f580 con 0x7fbce00678c0 2024-04-24T23:08:04.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.514+0000 7fbcdb7fe640 1 -- 172.21.15.43:0/1523090822 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335020 (secure 0 0 0) 0x7fbcf404f580 con 0x7fbce00678c0 2024-04-24T23:08:04.519 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:08:04.521 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-24T23:08:04.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.518+0000 7fbcf9375640 1 -- 172.21.15.43:0/1523090822 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbce00678c0 msgr2=0x7fbce0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:04.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.518+0000 7fbcf9375640 1 --2- 172.21.15.43:0/1523090822 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbce00678c0 0x7fbce0069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbce40ae000 tx=0x7fbce40a7070 comp rx=0 tx=0).stop 2024-04-24T23:08:04.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.518+0000 7fbcf9375640 1 -- 172.21.15.43:0/1523090822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf4072f40 msgr2=0x7fbcf414df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:04.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.518+0000 7fbcf9375640 1 --2- 172.21.15.43:0/1523090822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf4072f40 0x7fbcf414df70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbce800c7f0 tx=0x7fbce800ccb0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.518+0000 7fbcf9375640 1 -- 172.21.15.43:0/1523090822 shutdown_connections 2024-04-24T23:08:04.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.518+0000 7fbcf9375640 1 --2- 172.21.15.43:0/1523090822 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbce00678c0 0x7fbce0069d80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.518+0000 7fbcf9375640 1 --2- 172.21.15.43:0/1523090822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf40b4ed0 0x7fbcf41458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.518+0000 7fbcf9375640 1 --2- 172.21.15.43:0/1523090822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf4072f40 0x7fbcf414df70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.518+0000 7fbcf9375640 1 --2- 172.21.15.43:0/1523090822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf406be60 0x7fbcf41e4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.518+0000 7fbcf9375640 1 -- 172.21.15.43:0/1523090822 >> 172.21.15.43:0/1523090822 conn(0x7fbcf406c300 msgr2=0x7fbcf4147f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:04.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.518+0000 7fbcf9375640 1 -- 172.21.15.43:0/1523090822 shutdown_connections 2024-04-24T23:08:04.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.518+0000 7fbcf9375640 1 -- 172.21.15.43:0/1523090822 wait complete. 2024-04-24T23:08:04.536 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-04-24T23:08:04.388321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":156743271,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":1258,"num_read_kb":1896,"num_write":71340,"num_write_kb":667177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66117,"ondisk_log_size":66117,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":909072,"kb_used_data":87952,"kb_used_omap":12,"kb_used_meta":821043,"kb_avail":754065648,"statfs":{"total":773094113280,"available":772163223552,"internally_reserved":0,"allocated":90062848,"data_stored":314410014,"data_compressed":57812372,"data_compressed_allocated":71720960,"data_compressed_original":297476096,"omap_allocated":12752,"internal_metadata":840748592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-31919483,"num_objects":-3738,"num_object_clones":0,"num_object_copies":-11190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3738,"num_whiteouts":0,"num_read":25,"num_read_kb":247,"num_write":3864,"num_write_kb":6356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003751"},"pg_stats":[{"pgid":"2.1f","version":"27'518","reported_seq":547,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:50.667654+0000","last_change":"2024-04-24T23:00:15.425241+0000","last_active":"2024-04-24T23:07:50.667654+0000","last_peered":"2024-04-24T23:07:50.667654+0000","last_clean":"2024-04-24T23:07:50.667654+0000","last_became_active":"2024-04-24T23:00:15.417152+0000","last_became_peered":"2024-04-24T23:00:15.417152+0000","last_unstale":"2024-04-24T23:07:50.667654+0000","last_undegraded":"2024-04-24T23:07:50.667654+0000","last_fullsized":"2024-04-24T23:07:50.667654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":574,"num_write_kb":8831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'309","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.055031+0000","last_change":"2024-04-24T23:00:16.450360+0000","last_active":"2024-04-24T23:07:55.055031+0000","last_peered":"2024-04-24T23:07:55.055031+0000","last_clean":"2024-04-24T23:07:55.055031+0000","last_became_active":"2024-04-24T23:00:16.449631+0000","last_became_peered":"2024-04-24T23:00:16.449631+0000","last_unstale":"2024-04-24T23:07:55.055031+0000","last_undegraded":"2024-04-24T23:07:55.055031+0000","last_fullsized":"2024-04-24T23:07:55.055031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:03:09.773642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'1014","reported_seq":1035,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.824046+0000","last_change":"2024-04-24T23:00:20.537107+0000","last_active":"2024-04-24T23:07:55.824046+0000","last_peered":"2024-04-24T23:07:55.824046+0000","last_clean":"2024-04-24T23:07:55.824046+0000","last_became_active":"2024-04-24T23:00:20.535916+0000","last_became_peered":"2024-04-24T23:00:20.535916+0000","last_unstale":"2024-04-24T23:07:55.824046+0000","last_undegraded":"2024-04-24T23:07:55.824046+0000","last_fullsized":"2024-04-24T23:07:55.824046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1014,"log_dups_size":0,"ondisk_log_size":1014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.364772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":7177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'578","reported_seq":607,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.796855+0000","last_change":"2024-04-24T23:00:15.418251+0000","last_active":"2024-04-24T23:07:54.796855+0000","last_peered":"2024-04-24T23:07:54.796855+0000","last_clean":"2024-04-24T23:07:54.796855+0000","last_became_active":"2024-04-24T23:00:15.417502+0000","last_became_peered":"2024-04-24T23:00:15.417502+0000","last_unstale":"2024-04-24T23:07:54.796855+0000","last_undegraded":"2024-04-24T23:07:54.796855+0000","last_fullsized":"2024-04-24T23:07:54.796855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:50:53.490837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":611,"num_write_kb":25054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'282","reported_seq":309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.912926+0000","last_change":"2024-04-24T23:00:16.452960+0000","last_active":"2024-04-24T23:07:54.912926+0000","last_peered":"2024-04-24T23:07:54.912926+0000","last_clean":"2024-04-24T23:07:54.912926+0000","last_became_active":"2024-04-24T23:00:16.452212+0000","last_became_peered":"2024-04-24T23:00:16.452212+0000","last_unstale":"2024-04-24T23:07:54.912926+0000","last_undegraded":"2024-04-24T23:07:54.912926+0000","last_fullsized":"2024-04-24T23:07:54.912926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:26.361607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'1050","reported_seq":1071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.855066+0000","last_change":"2024-04-24T23:00:20.518435+0000","last_active":"2024-04-24T23:07:55.855066+0000","last_peered":"2024-04-24T23:07:55.855066+0000","last_clean":"2024-04-24T23:07:55.855066+0000","last_became_active":"2024-04-24T23:00:20.517975+0000","last_became_peered":"2024-04-24T23:00:20.517975+0000","last_unstale":"2024-04-24T23:07:55.855066+0000","last_undegraded":"2024-04-24T23:07:55.855066+0000","last_fullsized":"2024-04-24T23:07:55.855066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1050,"log_dups_size":0,"ondisk_log_size":1050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:36.410688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":6799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1034","reported_seq":1063,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:46.942698+0000","last_change":"2024-04-24T23:00:15.401804+0000","last_active":"2024-04-24T23:07:46.942698+0000","last_peered":"2024-04-24T23:07:46.942698+0000","last_clean":"2024-04-24T23:07:46.942698+0000","last_became_active":"2024-04-24T23:00:15.400064+0000","last_became_peered":"2024-04-24T23:00:15.400064+0000","last_unstale":"2024-04-24T23:07:46.942698+0000","last_undegraded":"2024-04-24T23:07:46.942698+0000","last_fullsized":"2024-04-24T23:07:46.942698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1034,"log_dups_size":0,"ondisk_log_size":1034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:26.588514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":1068,"num_write_kb":29480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'289","reported_seq":316,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.473842+0000","last_change":"2024-04-24T23:00:16.451873+0000","last_active":"2024-04-24T23:08:02.473842+0000","last_peered":"2024-04-24T23:08:02.473842+0000","last_clean":"2024-04-24T23:08:02.473842+0000","last_became_active":"2024-04-24T23:00:16.451601+0000","last_became_peered":"2024-04-24T23:00:16.451601+0000","last_unstale":"2024-04-24T23:08:02.473842+0000","last_undegraded":"2024-04-24T23:08:02.473842+0000","last_fullsized":"2024-04-24T23:08:02.473842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:14.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'993","reported_seq":1014,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.901309+0000","last_change":"2024-04-24T23:00:20.518757+0000","last_active":"2024-04-24T23:07:55.901309+0000","last_peered":"2024-04-24T23:07:55.901309+0000","last_clean":"2024-04-24T23:07:55.901309+0000","last_became_active":"2024-04-24T23:00:20.518002+0000","last_became_peered":"2024-04-24T23:00:20.518002+0000","last_unstale":"2024-04-24T23:07:55.901309+0000","last_undegraded":"2024-04-24T23:07:55.901309+0000","last_fullsized":"2024-04-24T23:07:55.901309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":6590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'200","reported_seq":229,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.779438+0000","last_change":"2024-04-24T23:00:15.398338+0000","last_active":"2024-04-24T23:07:54.779438+0000","last_peered":"2024-04-24T23:07:54.779438+0000","last_clean":"2024-04-24T23:07:54.779438+0000","last_became_active":"2024-04-24T23:00:15.395766+0000","last_became_peered":"2024-04-24T23:00:15.395766+0000","last_unstale":"2024-04-24T23:07:54.779438+0000","last_undegraded":"2024-04-24T23:07:54.779438+0000","last_fullsized":"2024-04-24T23:07:54.779438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:30.228280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":248,"num_write_kb":4421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'299","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.474117+0000","last_change":"2024-04-24T23:00:16.458641+0000","last_active":"2024-04-24T23:08:02.474117+0000","last_peered":"2024-04-24T23:08:02.474117+0000","last_clean":"2024-04-24T23:08:02.474117+0000","last_became_active":"2024-04-24T23:00:16.458237+0000","last_became_peered":"2024-04-24T23:00:16.458237+0000","last_unstale":"2024-04-24T23:08:02.474117+0000","last_undegraded":"2024-04-24T23:08:02.474117+0000","last_fullsized":"2024-04-24T23:08:02.474117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:22:17.631542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'1016","reported_seq":1044,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.883278+0000","last_change":"2024-04-24T23:00:57.665634+0000","last_active":"2024-04-24T23:07:55.883278+0000","last_peered":"2024-04-24T23:07:55.883278+0000","last_clean":"2024-04-24T23:07:55.883278+0000","last_became_active":"2024-04-24T23:00:57.664750+0000","last_became_peered":"2024-04-24T23:00:57.664750+0000","last_unstale":"2024-04-24T23:07:55.883278+0000","last_undegraded":"2024-04-24T23:07:55.883278+0000","last_fullsized":"2024-04-24T23:07:55.883278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:13.007846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":6657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,4],"acting":[2,6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'326","reported_seq":352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.442553+0000","last_change":"2024-04-24T23:00:16.448014+0000","last_active":"2024-04-24T23:08:02.442553+0000","last_peered":"2024-04-24T23:08:02.442553+0000","last_clean":"2024-04-24T23:08:02.442553+0000","last_became_active":"2024-04-24T23:00:16.447488+0000","last_became_peered":"2024-04-24T23:00:16.447488+0000","last_unstale":"2024-04-24T23:08:02.442553+0000","last_undegraded":"2024-04-24T23:08:02.442553+0000","last_fullsized":"2024-04-24T23:08:02.442553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:29.852278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'770","reported_seq":798,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.111019+0000","last_change":"2024-04-24T23:00:15.408781+0000","last_active":"2024-04-24T23:07:55.111019+0000","last_peered":"2024-04-24T23:07:55.111019+0000","last_clean":"2024-04-24T23:07:55.111019+0000","last_became_active":"2024-04-24T23:00:15.408120+0000","last_became_peered":"2024-04-24T23:00:15.408120+0000","last_unstale":"2024-04-24T23:07:55.111019+0000","last_undegraded":"2024-04-24T23:07:55.111019+0000","last_fullsized":"2024-04-24T23:07:55.111019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:38.560562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":817,"num_write_kb":21262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'991","reported_seq":1012,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.825524+0000","last_change":"2024-04-24T23:00:20.503964+0000","last_active":"2024-04-24T23:07:55.825524+0000","last_peered":"2024-04-24T23:07:55.825524+0000","last_clean":"2024-04-24T23:07:55.825524+0000","last_became_active":"2024-04-24T23:00:20.501703+0000","last_became_peered":"2024-04-24T23:00:20.501703+0000","last_unstale":"2024-04-24T23:07:55.825524+0000","last_undegraded":"2024-04-24T23:07:55.825524+0000","last_fullsized":"2024-04-24T23:07:55.825524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:40.258673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":7022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'337","reported_seq":364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.456838+0000","last_change":"2024-04-24T23:00:16.472987+0000","last_active":"2024-04-24T23:08:02.456838+0000","last_peered":"2024-04-24T23:08:02.456838+0000","last_clean":"2024-04-24T23:08:02.456838+0000","last_became_active":"2024-04-24T23:00:16.472226+0000","last_became_peered":"2024-04-24T23:00:16.472226+0000","last_unstale":"2024-04-24T23:08:02.456838+0000","last_undegraded":"2024-04-24T23:08:02.456838+0000","last_fullsized":"2024-04-24T23:08:02.456838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":260,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'309","reported_seq":338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:49.727569+0000","last_change":"2024-04-24T23:00:15.422963+0000","last_active":"2024-04-24T23:07:49.727569+0000","last_peered":"2024-04-24T23:07:49.727569+0000","last_clean":"2024-04-24T23:07:49.727569+0000","last_became_active":"2024-04-24T23:00:15.422121+0000","last_became_peered":"2024-04-24T23:00:15.422121+0000","last_unstale":"2024-04-24T23:07:49.727569+0000","last_undegraded":"2024-04-24T23:07:49.727569+0000","last_fullsized":"2024-04-24T23:07:49.727569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":340,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'1105","reported_seq":1126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.852798+0000","last_change":"2024-04-24T23:00:20.540688+0000","last_active":"2024-04-24T23:07:55.852798+0000","last_peered":"2024-04-24T23:07:55.852798+0000","last_clean":"2024-04-24T23:07:55.852798+0000","last_became_active":"2024-04-24T23:00:20.540220+0000","last_became_peered":"2024-04-24T23:00:20.540220+0000","last_unstale":"2024-04-24T23:07:55.852798+0000","last_undegraded":"2024-04-24T23:07:55.852798+0000","last_fullsized":"2024-04-24T23:07:55.852798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:33.931661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1391,"num_write_kb":7499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'337","reported_seq":364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.468044+0000","last_change":"2024-04-24T23:00:16.488633+0000","last_active":"2024-04-24T23:08:02.468044+0000","last_peered":"2024-04-24T23:08:02.468044+0000","last_clean":"2024-04-24T23:08:02.468044+0000","last_became_active":"2024-04-24T23:00:16.487476+0000","last_became_peered":"2024-04-24T23:00:16.487476+0000","last_unstale":"2024-04-24T23:08:02.468044+0000","last_undegraded":"2024-04-24T23:08:02.468044+0000","last_fullsized":"2024-04-24T23:08:02.468044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:06.907656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'215","reported_seq":244,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.745513+0000","last_change":"2024-04-24T23:00:15.397973+0000","last_active":"2024-04-24T23:07:53.745513+0000","last_peered":"2024-04-24T23:07:53.745513+0000","last_clean":"2024-04-24T23:07:53.745513+0000","last_became_active":"2024-04-24T23:00:15.396600+0000","last_became_peered":"2024-04-24T23:00:15.396600+0000","last_unstale":"2024-04-24T23:07:53.745513+0000","last_undegraded":"2024-04-24T23:07:53.745513+0000","last_fullsized":"2024-04-24T23:07:53.745513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:22.932046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":224,"num_write_kb":12479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'989","reported_seq":1010,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.895864+0000","last_change":"2024-04-24T23:00:20.511547+0000","last_active":"2024-04-24T23:07:55.895864+0000","last_peered":"2024-04-24T23:07:55.895864+0000","last_clean":"2024-04-24T23:07:55.895864+0000","last_became_active":"2024-04-24T23:00:20.510602+0000","last_became_peered":"2024-04-24T23:00:20.510602+0000","last_unstale":"2024-04-24T23:07:55.895864+0000","last_undegraded":"2024-04-24T23:07:55.895864+0000","last_fullsized":"2024-04-24T23:07:55.895864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:17.847434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1239,"num_write_kb":6767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'349","reported_seq":375,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.407118+0000","last_change":"2024-04-24T23:00:16.483393+0000","last_active":"2024-04-24T23:08:02.407118+0000","last_peered":"2024-04-24T23:08:02.407118+0000","last_clean":"2024-04-24T23:08:02.407118+0000","last_became_active":"2024-04-24T23:00:16.483092+0000","last_became_peered":"2024-04-24T23:00:16.483092+0000","last_unstale":"2024-04-24T23:08:02.407118+0000","last_undegraded":"2024-04-24T23:08:02.407118+0000","last_fullsized":"2024-04-24T23:08:02.407118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:38.429072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'273","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.888601+0000","last_change":"2024-04-24T23:00:15.398005+0000","last_active":"2024-04-24T23:07:54.888601+0000","last_peered":"2024-04-24T23:07:54.888601+0000","last_clean":"2024-04-24T23:07:54.888601+0000","last_became_active":"2024-04-24T23:00:15.397638+0000","last_became_peered":"2024-04-24T23:00:15.397638+0000","last_unstale":"2024-04-24T23:07:54.888601+0000","last_undegraded":"2024-04-24T23:07:54.888601+0000","last_fullsized":"2024-04-24T23:07:54.888601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":320,"num_write_kb":4474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'934","reported_seq":955,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.854383+0000","last_change":"2024-04-24T23:00:20.505995+0000","last_active":"2024-04-24T23:07:55.854383+0000","last_peered":"2024-04-24T23:07:55.854383+0000","last_clean":"2024-04-24T23:07:55.854383+0000","last_became_active":"2024-04-24T23:00:20.505532+0000","last_became_peered":"2024-04-24T23:00:20.505532+0000","last_unstale":"2024-04-24T23:07:55.854383+0000","last_undegraded":"2024-04-24T23:07:55.854383+0000","last_fullsized":"2024-04-24T23:07:55.854383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:42.508455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":6588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'333","reported_seq":360,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.471926+0000","last_change":"2024-04-24T23:00:16.484306+0000","last_active":"2024-04-24T23:08:02.471926+0000","last_peered":"2024-04-24T23:08:02.471926+0000","last_clean":"2024-04-24T23:08:02.471926+0000","last_became_active":"2024-04-24T23:00:16.483585+0000","last_became_peered":"2024-04-24T23:00:16.483585+0000","last_unstale":"2024-04-24T23:08:02.471926+0000","last_undegraded":"2024-04-24T23:08:02.471926+0000","last_fullsized":"2024-04-24T23:08:02.471926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:53.051451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'156","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.717711+0000","last_change":"2024-04-24T23:00:15.421158+0000","last_active":"2024-04-24T23:07:53.717711+0000","last_peered":"2024-04-24T23:07:53.717711+0000","last_clean":"2024-04-24T23:07:53.717711+0000","last_became_active":"2024-04-24T23:00:15.420839+0000","last_became_peered":"2024-04-24T23:00:15.420839+0000","last_unstale":"2024-04-24T23:07:53.717711+0000","last_undegraded":"2024-04-24T23:07:53.717711+0000","last_fullsized":"2024-04-24T23:07:53.717711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:03.276247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":209,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'1029","reported_seq":1050,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.904843+0000","last_change":"2024-04-24T23:00:20.519755+0000","last_active":"2024-04-24T23:07:55.904843+0000","last_peered":"2024-04-24T23:07:55.904843+0000","last_clean":"2024-04-24T23:07:55.904843+0000","last_became_active":"2024-04-24T23:00:20.518470+0000","last_became_peered":"2024-04-24T23:00:20.518470+0000","last_unstale":"2024-04-24T23:07:55.904843+0000","last_undegraded":"2024-04-24T23:07:55.904843+0000","last_fullsized":"2024-04-24T23:07:55.904843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:14.639189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":7455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'291","reported_seq":318,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.471401+0000","last_change":"2024-04-24T23:00:16.464487+0000","last_active":"2024-04-24T23:08:02.471401+0000","last_peered":"2024-04-24T23:08:02.471401+0000","last_clean":"2024-04-24T23:08:02.471401+0000","last_became_active":"2024-04-24T23:00:16.463565+0000","last_became_peered":"2024-04-24T23:00:16.463565+0000","last_unstale":"2024-04-24T23:08:02.471401+0000","last_undegraded":"2024-04-24T23:08:02.471401+0000","last_fullsized":"2024-04-24T23:08:02.471401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'448","reported_seq":477,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.387574+0000","last_change":"2024-04-24T23:00:15.400228+0000","last_active":"2024-04-24T23:08:02.387574+0000","last_peered":"2024-04-24T23:08:02.387574+0000","last_clean":"2024-04-24T23:08:02.387574+0000","last_became_active":"2024-04-24T23:00:15.397465+0000","last_became_peered":"2024-04-24T23:00:15.397465+0000","last_unstale":"2024-04-24T23:08:02.387574+0000","last_undegraded":"2024-04-24T23:08:02.387574+0000","last_fullsized":"2024-04-24T23:08:02.387574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8008961,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1199,"num_write_kb":9322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'1049","reported_seq":1070,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.906567+0000","last_change":"2024-04-24T23:00:20.516766+0000","last_active":"2024-04-24T23:07:55.906567+0000","last_peered":"2024-04-24T23:07:55.906567+0000","last_clean":"2024-04-24T23:07:55.906567+0000","last_became_active":"2024-04-24T23:00:20.515972+0000","last_became_peered":"2024-04-24T23:00:20.515972+0000","last_unstale":"2024-04-24T23:07:55.906567+0000","last_undegraded":"2024-04-24T23:07:55.906567+0000","last_fullsized":"2024-04-24T23:07:55.906567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1319,"num_write_kb":7165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'291","reported_seq":318,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.817277+0000","last_change":"2024-04-24T23:00:16.480627+0000","last_active":"2024-04-24T23:07:55.817277+0000","last_peered":"2024-04-24T23:07:55.817277+0000","last_clean":"2024-04-24T23:07:55.817277+0000","last_became_active":"2024-04-24T23:00:16.480021+0000","last_became_peered":"2024-04-24T23:00:16.480021+0000","last_unstale":"2024-04-24T23:07:55.817277+0000","last_undegraded":"2024-04-24T23:07:55.817277+0000","last_fullsized":"2024-04-24T23:07:55.817277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:04.285389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'297","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:44.623630+0000","last_change":"2024-04-24T23:00:15.428375+0000","last_active":"2024-04-24T23:07:44.623630+0000","last_peered":"2024-04-24T23:07:44.623630+0000","last_clean":"2024-04-24T23:07:44.623630+0000","last_became_active":"2024-04-24T23:00:15.428016+0000","last_became_peered":"2024-04-24T23:00:15.428016+0000","last_unstale":"2024-04-24T23:07:44.623630+0000","last_undegraded":"2024-04-24T23:07:44.623630+0000","last_fullsized":"2024-04-24T23:07:44.623630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:24.759195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":311,"num_write_kb":16738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'1004","reported_seq":1025,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.826119+0000","last_change":"2024-04-24T23:00:20.535274+0000","last_active":"2024-04-24T23:07:55.826119+0000","last_peered":"2024-04-24T23:07:55.826119+0000","last_clean":"2024-04-24T23:07:55.826119+0000","last_became_active":"2024-04-24T23:00:20.524747+0000","last_became_peered":"2024-04-24T23:00:20.524747+0000","last_unstale":"2024-04-24T23:07:55.826119+0000","last_undegraded":"2024-04-24T23:07:55.826119+0000","last_fullsized":"2024-04-24T23:07:55.826119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.814128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1252,"num_write_kb":7166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'319","reported_seq":345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.449902+0000","last_change":"2024-04-24T23:00:16.456641+0000","last_active":"2024-04-24T23:08:02.449902+0000","last_peered":"2024-04-24T23:08:02.449902+0000","last_clean":"2024-04-24T23:08:02.449902+0000","last_became_active":"2024-04-24T23:00:16.456268+0000","last_became_peered":"2024-04-24T23:00:16.456268+0000","last_unstale":"2024-04-24T23:08:02.449902+0000","last_undegraded":"2024-04-24T23:08:02.449902+0000","last_fullsized":"2024-04-24T23:08:02.449902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'112","reported_seq":141,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.896251+0000","last_change":"2024-04-24T23:00:15.429119+0000","last_active":"2024-04-24T23:07:54.896251+0000","last_peered":"2024-04-24T23:07:54.896251+0000","last_clean":"2024-04-24T23:07:54.896251+0000","last_became_active":"2024-04-24T23:00:15.428374+0000","last_became_peered":"2024-04-24T23:00:15.428374+0000","last_unstale":"2024-04-24T23:07:54.896251+0000","last_undegraded":"2024-04-24T23:07:54.896251+0000","last_fullsized":"2024-04-24T23:07:54.896251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:13:30.412685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":161,"num_write_kb":4386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'1030","reported_seq":1051,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.864947+0000","last_change":"2024-04-24T23:00:20.535730+0000","last_active":"2024-04-24T23:07:55.864947+0000","last_peered":"2024-04-24T23:07:55.864947+0000","last_clean":"2024-04-24T23:07:55.864947+0000","last_became_active":"2024-04-24T23:00:20.534430+0000","last_became_peered":"2024-04-24T23:00:20.534430+0000","last_unstale":"2024-04-24T23:07:55.864947+0000","last_undegraded":"2024-04-24T23:07:55.864947+0000","last_fullsized":"2024-04-24T23:07:55.864947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:35.156511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1288,"num_write_kb":6636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'316","reported_seq":343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.470697+0000","last_change":"2024-04-24T23:00:16.444070+0000","last_active":"2024-04-24T23:08:02.470697+0000","last_peered":"2024-04-24T23:08:02.470697+0000","last_clean":"2024-04-24T23:08:02.470697+0000","last_became_active":"2024-04-24T23:00:16.443620+0000","last_became_peered":"2024-04-24T23:00:16.443620+0000","last_unstale":"2024-04-24T23:08:02.470697+0000","last_undegraded":"2024-04-24T23:08:02.470697+0000","last_fullsized":"2024-04-24T23:08:02.470697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:31.077128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'510","reported_seq":538,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:49.798261+0000","last_change":"2024-04-24T23:00:15.422571+0000","last_active":"2024-04-24T23:07:49.798261+0000","last_peered":"2024-04-24T23:07:49.798261+0000","last_clean":"2024-04-24T23:07:49.798261+0000","last_became_active":"2024-04-24T23:00:15.422167+0000","last_became_peered":"2024-04-24T23:00:15.422167+0000","last_unstale":"2024-04-24T23:07:49.798261+0000","last_undegraded":"2024-04-24T23:07:49.798261+0000","last_fullsized":"2024-04-24T23:07:49.798261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:29.417228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":552,"num_write_kb":25017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'943","reported_seq":964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.834843+0000","last_change":"2024-04-24T23:00:20.540587+0000","last_active":"2024-04-24T23:07:55.834843+0000","last_peered":"2024-04-24T23:07:55.834843+0000","last_clean":"2024-04-24T23:07:55.834843+0000","last_became_active":"2024-04-24T23:00:20.524719+0000","last_became_peered":"2024-04-24T23:00:20.524719+0000","last_unstale":"2024-04-24T23:07:55.834843+0000","last_undegraded":"2024-04-24T23:07:55.834843+0000","last_fullsized":"2024-04-24T23:07:55.834843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'312","reported_seq":339,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.900068+0000","last_change":"2024-04-24T23:00:16.471678+0000","last_active":"2024-04-24T23:07:55.900068+0000","last_peered":"2024-04-24T23:07:55.900068+0000","last_clean":"2024-04-24T23:07:55.900068+0000","last_became_active":"2024-04-24T23:00:16.469390+0000","last_became_peered":"2024-04-24T23:00:16.469390+0000","last_unstale":"2024-04-24T23:07:55.900068+0000","last_undegraded":"2024-04-24T23:07:55.900068+0000","last_fullsized":"2024-04-24T23:07:55.900068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:31:59.778549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'887","reported_seq":1585,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:56.723481+0000","last_change":"2024-04-24T23:00:15.423024+0000","last_active":"2024-04-24T23:07:56.723481+0000","last_peered":"2024-04-24T23:07:56.723481+0000","last_clean":"2024-04-24T23:07:56.723481+0000","last_became_active":"2024-04-24T23:00:15.422275+0000","last_became_peered":"2024-04-24T23:00:15.422275+0000","last_unstale":"2024-04-24T23:07:56.723481+0000","last_undegraded":"2024-04-24T23:07:56.723481+0000","last_fullsized":"2024-04-24T23:07:56.723481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9730440,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":691,"num_read_kb":1796,"num_write":947,"num_write_kb":14533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'1020","reported_seq":1041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.845109+0000","last_change":"2024-04-24T23:00:20.535131+0000","last_active":"2024-04-24T23:07:55.845109+0000","last_peered":"2024-04-24T23:07:55.845109+0000","last_clean":"2024-04-24T23:07:55.845109+0000","last_became_active":"2024-04-24T23:00:20.534325+0000","last_became_peered":"2024-04-24T23:00:20.534325+0000","last_unstale":"2024-04-24T23:07:55.845109+0000","last_undegraded":"2024-04-24T23:07:55.845109+0000","last_fullsized":"2024-04-24T23:07:55.845109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1281,"num_write_kb":6595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'298","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.827749+0000","last_change":"2024-04-24T23:00:16.451991+0000","last_active":"2024-04-24T23:07:55.827749+0000","last_peered":"2024-04-24T23:07:55.827749+0000","last_clean":"2024-04-24T23:07:55.827749+0000","last_became_active":"2024-04-24T23:00:16.451226+0000","last_became_peered":"2024-04-24T23:00:16.451226+0000","last_unstale":"2024-04-24T23:07:55.827749+0000","last_undegraded":"2024-04-24T23:07:55.827749+0000","last_fullsized":"2024-04-24T23:07:55.827749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:30.426371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'647","reported_seq":675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:51.887360+0000","last_change":"2024-04-24T23:00:15.414535+0000","last_active":"2024-04-24T23:07:51.887360+0000","last_peered":"2024-04-24T23:07:51.887360+0000","last_clean":"2024-04-24T23:07:51.887360+0000","last_became_active":"2024-04-24T23:00:15.414224+0000","last_became_peered":"2024-04-24T23:00:15.414224+0000","last_unstale":"2024-04-24T23:07:51.887360+0000","last_undegraded":"2024-04-24T23:07:51.887360+0000","last_fullsized":"2024-04-24T23:07:51.887360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:30.228280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":698,"num_write_kb":16967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'1115","reported_seq":1136,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.885451+0000","last_change":"2024-04-24T23:00:20.531159+0000","last_active":"2024-04-24T23:07:55.885451+0000","last_peered":"2024-04-24T23:07:55.885451+0000","last_clean":"2024-04-24T23:07:55.885451+0000","last_became_active":"2024-04-24T23:00:20.530682+0000","last_became_peered":"2024-04-24T23:00:20.530682+0000","last_unstale":"2024-04-24T23:07:55.885451+0000","last_undegraded":"2024-04-24T23:07:55.885451+0000","last_fullsized":"2024-04-24T23:07:55.885451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:45.629364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1380,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'294","reported_seq":321,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.468963+0000","last_change":"2024-04-24T23:00:16.481649+0000","last_active":"2024-04-24T23:08:02.468963+0000","last_peered":"2024-04-24T23:08:02.468963+0000","last_clean":"2024-04-24T23:08:02.468963+0000","last_became_active":"2024-04-24T23:00:16.477192+0000","last_became_peered":"2024-04-24T23:00:16.477192+0000","last_unstale":"2024-04-24T23:08:02.468963+0000","last_undegraded":"2024-04-24T23:08:02.468963+0000","last_fullsized":"2024-04-24T23:08:02.468963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:13.768051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'170","reported_seq":198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:38.824463+0000","last_change":"2024-04-24T23:00:15.407927+0000","last_active":"2024-04-24T23:07:38.824463+0000","last_peered":"2024-04-24T23:07:38.824463+0000","last_clean":"2024-04-24T23:07:38.824463+0000","last_became_active":"2024-04-24T23:00:15.407609+0000","last_became_peered":"2024-04-24T23:00:15.407609+0000","last_unstale":"2024-04-24T23:07:38.824463+0000","last_undegraded":"2024-04-24T23:07:38.824463+0000","last_fullsized":"2024-04-24T23:07:38.824463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:13.689340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":211,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:06:03.333569+0000","last_change":"2024-04-24T23:00:03.344529+0000","last_active":"2024-04-24T23:06:03.333569+0000","last_peered":"2024-04-24T23:06:03.333569+0000","last_clean":"2024-04-24T23:06:03.333569+0000","last_became_active":"2024-04-24T23:00:03.344074+0000","last_became_peered":"2024-04-24T23:00:03.344074+0000","last_unstale":"2024-04-24T23:06:03.333569+0000","last_undegraded":"2024-04-24T23:06:03.333569+0000","last_fullsized":"2024-04-24T23:06:03.333569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:02.322380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:02.322380+0000","last_clean_scrub_stamp":"2024-04-24T23:00:02.322380+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:40.550881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'994","reported_seq":1009,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.887079+0000","last_change":"2024-04-24T23:00:57.865441+0000","last_active":"2024-04-24T23:07:55.887079+0000","last_peered":"2024-04-24T23:07:55.887079+0000","last_clean":"2024-04-24T23:07:55.887079+0000","last_became_active":"2024-04-24T23:00:57.864235+0000","last_became_peered":"2024-04-24T23:00:57.864235+0000","last_unstale":"2024-04-24T23:07:55.887079+0000","last_undegraded":"2024-04-24T23:07:55.887079+0000","last_fullsized":"2024-04-24T23:07:55.887079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":994,"log_dups_size":0,"ondisk_log_size":994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:54.068285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1231,"num_write_kb":6895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2,0],"acting":[5,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"27'317","reported_seq":343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.425825+0000","last_change":"2024-04-24T23:00:16.448759+0000","last_active":"2024-04-24T23:08:02.425825+0000","last_peered":"2024-04-24T23:08:02.425825+0000","last_clean":"2024-04-24T23:08:02.425825+0000","last_became_active":"2024-04-24T23:00:16.448187+0000","last_became_peered":"2024-04-24T23:00:16.448187+0000","last_unstale":"2024-04-24T23:08:02.425825+0000","last_undegraded":"2024-04-24T23:08:02.425825+0000","last_fullsized":"2024-04-24T23:08:02.425825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:08:59.708506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'231","reported_seq":260,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:42.632794+0000","last_change":"2024-04-24T23:00:15.436270+0000","last_active":"2024-04-24T23:07:42.632794+0000","last_peered":"2024-04-24T23:07:42.632794+0000","last_clean":"2024-04-24T23:07:42.632794+0000","last_became_active":"2024-04-24T23:00:15.425134+0000","last_became_peered":"2024-04-24T23:00:15.425134+0000","last_unstale":"2024-04-24T23:07:42.632794+0000","last_undegraded":"2024-04-24T23:07:42.632794+0000","last_fullsized":"2024-04-24T23:07:42.632794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":252,"num_write_kb":12509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'1044","reported_seq":1065,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.887165+0000","last_change":"2024-04-24T23:00:20.500617+0000","last_active":"2024-04-24T23:07:55.887165+0000","last_peered":"2024-04-24T23:07:55.887165+0000","last_clean":"2024-04-24T23:07:55.887165+0000","last_became_active":"2024-04-24T23:00:20.500158+0000","last_became_peered":"2024-04-24T23:00:20.500158+0000","last_unstale":"2024-04-24T23:07:55.887165+0000","last_undegraded":"2024-04-24T23:07:55.887165+0000","last_fullsized":"2024-04-24T23:07:55.887165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1044,"log_dups_size":0,"ondisk_log_size":1044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.814128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1291,"num_write_kb":7061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'349","reported_seq":376,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.473019+0000","last_change":"2024-04-24T23:00:16.471754+0000","last_active":"2024-04-24T23:08:02.473019+0000","last_peered":"2024-04-24T23:08:02.473019+0000","last_clean":"2024-04-24T23:08:02.473019+0000","last_became_active":"2024-04-24T23:00:16.471497+0000","last_became_peered":"2024-04-24T23:00:16.471497+0000","last_unstale":"2024-04-24T23:08:02.473019+0000","last_undegraded":"2024-04-24T23:08:02.473019+0000","last_fullsized":"2024-04-24T23:08:02.473019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:27.760709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'523","reported_seq":552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:46.767969+0000","last_change":"2024-04-24T23:00:15.406401+0000","last_active":"2024-04-24T23:07:46.767969+0000","last_peered":"2024-04-24T23:07:46.767969+0000","last_clean":"2024-04-24T23:07:46.767969+0000","last_became_active":"2024-04-24T23:00:15.405636+0000","last_became_peered":"2024-04-24T23:00:15.405636+0000","last_unstale":"2024-04-24T23:07:46.767969+0000","last_undegraded":"2024-04-24T23:07:46.767969+0000","last_fullsized":"2024-04-24T23:07:46.767969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:02.654515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":558,"num_write_kb":25209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'1010","reported_seq":1031,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.846057+0000","last_change":"2024-04-24T23:00:20.502050+0000","last_active":"2024-04-24T23:07:55.846057+0000","last_peered":"2024-04-24T23:07:55.846057+0000","last_clean":"2024-04-24T23:07:55.846057+0000","last_became_active":"2024-04-24T23:00:20.500153+0000","last_became_peered":"2024-04-24T23:00:20.500153+0000","last_unstale":"2024-04-24T23:07:55.846057+0000","last_undegraded":"2024-04-24T23:07:55.846057+0000","last_fullsized":"2024-04-24T23:07:55.846057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:51.285256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":6978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'294","reported_seq":321,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.470904+0000","last_change":"2024-04-24T23:00:16.446762+0000","last_active":"2024-04-24T23:08:02.470904+0000","last_peered":"2024-04-24T23:08:02.470904+0000","last_clean":"2024-04-24T23:08:02.470904+0000","last_became_active":"2024-04-24T23:00:16.446170+0000","last_became_peered":"2024-04-24T23:00:16.446170+0000","last_unstale":"2024-04-24T23:08:02.470904+0000","last_undegraded":"2024-04-24T23:08:02.470904+0000","last_fullsized":"2024-04-24T23:08:02.470904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.801913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'342","reported_seq":371,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:48.758059+0000","last_change":"2024-04-24T23:00:15.423703+0000","last_active":"2024-04-24T23:07:48.758059+0000","last_peered":"2024-04-24T23:07:48.758059+0000","last_clean":"2024-04-24T23:07:48.758059+0000","last_became_active":"2024-04-24T23:00:15.414863+0000","last_became_peered":"2024-04-24T23:00:15.414863+0000","last_unstale":"2024-04-24T23:07:48.758059+0000","last_undegraded":"2024-04-24T23:07:48.758059+0000","last_fullsized":"2024-04-24T23:07:48.758059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:26.588514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":379,"num_write_kb":12861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'1068","reported_seq":1089,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.903097+0000","last_change":"2024-04-24T23:00:20.499277+0000","last_active":"2024-04-24T23:07:55.903097+0000","last_peered":"2024-04-24T23:07:55.903097+0000","last_clean":"2024-04-24T23:07:55.903097+0000","last_became_active":"2024-04-24T23:00:20.498802+0000","last_became_peered":"2024-04-24T23:00:20.498802+0000","last_unstale":"2024-04-24T23:07:55.903097+0000","last_undegraded":"2024-04-24T23:07:55.903097+0000","last_fullsized":"2024-04-24T23:07:55.903097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:32.166063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":7543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'288","reported_seq":314,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.483131+0000","last_change":"2024-04-24T23:00:16.448112+0000","last_active":"2024-04-24T23:08:02.483131+0000","last_peered":"2024-04-24T23:08:02.483131+0000","last_clean":"2024-04-24T23:08:02.483131+0000","last_became_active":"2024-04-24T23:00:16.447838+0000","last_became_peered":"2024-04-24T23:00:16.447838+0000","last_unstale":"2024-04-24T23:08:02.483131+0000","last_undegraded":"2024-04-24T23:08:02.483131+0000","last_fullsized":"2024-04-24T23:08:02.483131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:24.143678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'304","reported_seq":333,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.892329+0000","last_change":"2024-04-24T23:00:15.420914+0000","last_active":"2024-04-24T23:07:54.892329+0000","last_peered":"2024-04-24T23:07:54.892329+0000","last_clean":"2024-04-24T23:07:54.892329+0000","last_became_active":"2024-04-24T23:00:15.420590+0000","last_became_peered":"2024-04-24T23:00:15.420590+0000","last_unstale":"2024-04-24T23:07:54.892329+0000","last_undegraded":"2024-04-24T23:07:54.892329+0000","last_fullsized":"2024-04-24T23:07:54.892329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:53.443962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":356,"num_write_kb":8611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'1045","reported_seq":1066,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.831690+0000","last_change":"2024-04-24T23:00:20.494192+0000","last_active":"2024-04-24T23:07:55.831690+0000","last_peered":"2024-04-24T23:07:55.831690+0000","last_clean":"2024-04-24T23:07:55.831690+0000","last_became_active":"2024-04-24T23:00:20.493784+0000","last_became_peered":"2024-04-24T23:00:20.493784+0000","last_unstale":"2024-04-24T23:07:55.831690+0000","last_undegraded":"2024-04-24T23:07:55.831690+0000","last_fullsized":"2024-04-24T23:07:55.831690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1045,"log_dups_size":0,"ondisk_log_size":1045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:10.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1330,"num_write_kb":7257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'367","reported_seq":393,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.443580+0000","last_change":"2024-04-24T23:00:16.452682+0000","last_active":"2024-04-24T23:08:02.443580+0000","last_peered":"2024-04-24T23:08:02.443580+0000","last_clean":"2024-04-24T23:08:02.443580+0000","last_became_active":"2024-04-24T23:00:16.447742+0000","last_became_peered":"2024-04-24T23:00:16.447742+0000","last_unstale":"2024-04-24T23:08:02.443580+0000","last_undegraded":"2024-04-24T23:08:02.443580+0000","last_fullsized":"2024-04-24T23:08:02.443580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:55.801913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'267","reported_seq":296,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:49.712201+0000","last_change":"2024-04-24T23:00:15.416986+0000","last_active":"2024-04-24T23:07:49.712201+0000","last_peered":"2024-04-24T23:07:49.712201+0000","last_clean":"2024-04-24T23:07:49.712201+0000","last_became_active":"2024-04-24T23:00:15.416198+0000","last_became_peered":"2024-04-24T23:00:15.416198+0000","last_unstale":"2024-04-24T23:07:49.712201+0000","last_undegraded":"2024-04-24T23:07:49.712201+0000","last_fullsized":"2024-04-24T23:07:49.712201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:27.810443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":330,"num_write_kb":8690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'1004","reported_seq":1025,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.833315+0000","last_change":"2024-04-24T23:00:20.526621+0000","last_active":"2024-04-24T23:07:55.833315+0000","last_peered":"2024-04-24T23:07:55.833315+0000","last_clean":"2024-04-24T23:07:55.833315+0000","last_became_active":"2024-04-24T23:00:20.525782+0000","last_became_peered":"2024-04-24T23:00:20.525782+0000","last_unstale":"2024-04-24T23:07:55.833315+0000","last_undegraded":"2024-04-24T23:07:55.833315+0000","last_fullsized":"2024-04-24T23:07:55.833315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:38:28.209697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":7027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'336","reported_seq":363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.471292+0000","last_change":"2024-04-24T23:00:16.454748+0000","last_active":"2024-04-24T23:08:02.471292+0000","last_peered":"2024-04-24T23:08:02.471292+0000","last_clean":"2024-04-24T23:08:02.471292+0000","last_became_active":"2024-04-24T23:00:16.454031+0000","last_became_peered":"2024-04-24T23:00:16.454031+0000","last_unstale":"2024-04-24T23:08:02.471292+0000","last_undegraded":"2024-04-24T23:08:02.471292+0000","last_fullsized":"2024-04-24T23:08:02.471292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:31.237423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'68","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.719195+0000","last_change":"2024-04-24T23:00:15.420149+0000","last_active":"2024-04-24T23:07:53.719195+0000","last_peered":"2024-04-24T23:07:53.719195+0000","last_clean":"2024-04-24T23:07:53.719195+0000","last_became_active":"2024-04-24T23:00:15.416688+0000","last_became_peered":"2024-04-24T23:00:15.416688+0000","last_unstale":"2024-04-24T23:07:53.719195+0000","last_undegraded":"2024-04-24T23:07:53.719195+0000","last_fullsized":"2024-04-24T23:07:53.719195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:04:27.810443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":106,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'996","reported_seq":1017,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.798909+0000","last_change":"2024-04-24T23:00:20.517137+0000","last_active":"2024-04-24T23:07:55.798909+0000","last_peered":"2024-04-24T23:07:55.798909+0000","last_clean":"2024-04-24T23:07:55.798909+0000","last_became_active":"2024-04-24T23:00:20.516152+0000","last_became_peered":"2024-04-24T23:00:20.516152+0000","last_unstale":"2024-04-24T23:07:55.798909+0000","last_undegraded":"2024-04-24T23:07:55.798909+0000","last_fullsized":"2024-04-24T23:07:55.798909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:29.452352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":6136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'317","reported_seq":343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.472024+0000","last_change":"2024-04-24T23:00:16.458939+0000","last_active":"2024-04-24T23:08:02.472024+0000","last_peered":"2024-04-24T23:08:02.472024+0000","last_clean":"2024-04-24T23:08:02.472024+0000","last_became_active":"2024-04-24T23:00:16.458081+0000","last_became_peered":"2024-04-24T23:00:16.458081+0000","last_unstale":"2024-04-24T23:08:02.472024+0000","last_undegraded":"2024-04-24T23:08:02.472024+0000","last_fullsized":"2024-04-24T23:08:02.472024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:27.760709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'41","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:48.697005+0000","last_change":"2024-04-24T23:00:15.413409+0000","last_active":"2024-04-24T23:07:48.697005+0000","last_peered":"2024-04-24T23:07:48.697005+0000","last_clean":"2024-04-24T23:07:48.697005+0000","last_became_active":"2024-04-24T23:00:15.412847+0000","last_became_peered":"2024-04-24T23:00:15.412847+0000","last_unstale":"2024-04-24T23:07:48.697005+0000","last_undegraded":"2024-04-24T23:07:48.697005+0000","last_fullsized":"2024-04-24T23:07:48.697005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:35.114960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":81,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'915","reported_seq":936,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.796705+0000","last_change":"2024-04-24T23:00:20.536112+0000","last_active":"2024-04-24T23:07:55.796705+0000","last_peered":"2024-04-24T23:07:55.796705+0000","last_clean":"2024-04-24T23:07:55.796705+0000","last_became_active":"2024-04-24T23:00:20.529427+0000","last_became_peered":"2024-04-24T23:00:20.529427+0000","last_unstale":"2024-04-24T23:07:55.796705+0000","last_undegraded":"2024-04-24T23:07:55.796705+0000","last_fullsized":"2024-04-24T23:07:55.796705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:14.639189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":6219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'313","reported_seq":340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.826183+0000","last_change":"2024-04-24T23:00:16.465373+0000","last_active":"2024-04-24T23:07:55.826183+0000","last_peered":"2024-04-24T23:07:55.826183+0000","last_clean":"2024-04-24T23:07:55.826183+0000","last_became_active":"2024-04-24T23:00:16.464653+0000","last_became_peered":"2024-04-24T23:00:16.464653+0000","last_unstale":"2024-04-24T23:07:55.826183+0000","last_undegraded":"2024-04-24T23:07:55.826183+0000","last_fullsized":"2024-04-24T23:07:55.826183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:24.143678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'531","reported_seq":560,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:51.885087+0000","last_change":"2024-04-24T23:00:15.427483+0000","last_active":"2024-04-24T23:07:51.885087+0000","last_peered":"2024-04-24T23:07:51.885087+0000","last_clean":"2024-04-24T23:07:51.885087+0000","last_became_active":"2024-04-24T23:00:15.426641+0000","last_became_peered":"2024-04-24T23:00:15.426641+0000","last_unstale":"2024-04-24T23:07:51.885087+0000","last_undegraded":"2024-04-24T23:07:51.885087+0000","last_fullsized":"2024-04-24T23:07:51.885087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":566,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'952","reported_seq":973,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.846819+0000","last_change":"2024-04-24T23:00:20.518479+0000","last_active":"2024-04-24T23:07:55.846819+0000","last_peered":"2024-04-24T23:07:55.846819+0000","last_clean":"2024-04-24T23:07:55.846819+0000","last_became_active":"2024-04-24T23:00:20.517950+0000","last_became_peered":"2024-04-24T23:00:20.517950+0000","last_unstale":"2024-04-24T23:07:55.846819+0000","last_undegraded":"2024-04-24T23:07:55.846819+0000","last_fullsized":"2024-04-24T23:07:55.846819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:37:10.220625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":7094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'294","reported_seq":321,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.473336+0000","last_change":"2024-04-24T23:00:16.456931+0000","last_active":"2024-04-24T23:08:02.473336+0000","last_peered":"2024-04-24T23:08:02.473336+0000","last_clean":"2024-04-24T23:08:02.473336+0000","last_became_active":"2024-04-24T23:00:16.456636+0000","last_became_peered":"2024-04-24T23:00:16.456636+0000","last_unstale":"2024-04-24T23:08:02.473336+0000","last_undegraded":"2024-04-24T23:08:02.473336+0000","last_fullsized":"2024-04-24T23:08:02.473336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:10.559806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'568","reported_seq":596,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.112279+0000","last_change":"2024-04-24T23:00:15.428189+0000","last_active":"2024-04-24T23:07:55.112279+0000","last_peered":"2024-04-24T23:07:55.112279+0000","last_clean":"2024-04-24T23:07:55.112279+0000","last_became_active":"2024-04-24T23:00:15.427837+0000","last_became_peered":"2024-04-24T23:00:15.427837+0000","last_unstale":"2024-04-24T23:07:55.112279+0000","last_undegraded":"2024-04-24T23:07:55.112279+0000","last_fullsized":"2024-04-24T23:07:55.112279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":635,"num_write_kb":21119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'1015","reported_seq":1043,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.871904+0000","last_change":"2024-04-24T23:00:57.865502+0000","last_active":"2024-04-24T23:07:55.871904+0000","last_peered":"2024-04-24T23:07:55.871904+0000","last_clean":"2024-04-24T23:07:55.871904+0000","last_became_active":"2024-04-24T23:00:57.864156+0000","last_became_peered":"2024-04-24T23:00:57.864156+0000","last_unstale":"2024-04-24T23:07:55.871904+0000","last_undegraded":"2024-04-24T23:07:55.871904+0000","last_fullsized":"2024-04-24T23:07:55.871904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:23.399284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":6923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'298","reported_seq":324,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.443314+0000","last_change":"2024-04-24T23:00:16.453438+0000","last_active":"2024-04-24T23:08:02.443314+0000","last_peered":"2024-04-24T23:08:02.443314+0000","last_clean":"2024-04-24T23:08:02.443314+0000","last_became_active":"2024-04-24T23:00:16.453033+0000","last_became_peered":"2024-04-24T23:00:16.453033+0000","last_unstale":"2024-04-24T23:08:02.443314+0000","last_undegraded":"2024-04-24T23:08:02.443314+0000","last_fullsized":"2024-04-24T23:08:02.443314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:52:36.324979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'667","reported_seq":696,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.918276+0000","last_change":"2024-04-24T23:00:15.431369+0000","last_active":"2024-04-24T23:07:55.918276+0000","last_peered":"2024-04-24T23:07:55.918276+0000","last_clean":"2024-04-24T23:07:55.918276+0000","last_became_active":"2024-04-24T23:00:15.430254+0000","last_became_peered":"2024-04-24T23:00:15.430254+0000","last_unstale":"2024-04-24T23:07:55.918276+0000","last_undegraded":"2024-04-24T23:07:55.918276+0000","last_fullsized":"2024-04-24T23:07:55.918276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":729,"num_write_kb":21519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'963","reported_seq":984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.909844+0000","last_change":"2024-04-24T23:00:20.503369+0000","last_active":"2024-04-24T23:07:55.909844+0000","last_peered":"2024-04-24T23:07:55.909844+0000","last_clean":"2024-04-24T23:07:55.909844+0000","last_became_active":"2024-04-24T23:00:20.502285+0000","last_became_peered":"2024-04-24T23:00:20.502285+0000","last_unstale":"2024-04-24T23:07:55.909844+0000","last_undegraded":"2024-04-24T23:07:55.909844+0000","last_fullsized":"2024-04-24T23:07:55.909844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'290","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.744532+0000","last_change":"2024-04-24T23:00:16.452958+0000","last_active":"2024-04-24T23:07:55.744532+0000","last_peered":"2024-04-24T23:07:55.744532+0000","last_clean":"2024-04-24T23:07:55.744532+0000","last_became_active":"2024-04-24T23:00:16.451611+0000","last_became_peered":"2024-04-24T23:00:16.451611+0000","last_unstale":"2024-04-24T23:07:55.744532+0000","last_undegraded":"2024-04-24T23:07:55.744532+0000","last_fullsized":"2024-04-24T23:07:55.744532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:06.283705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'414","reported_seq":443,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.714346+0000","last_change":"2024-04-24T23:00:15.397614+0000","last_active":"2024-04-24T23:07:53.714346+0000","last_peered":"2024-04-24T23:07:53.714346+0000","last_clean":"2024-04-24T23:07:53.714346+0000","last_became_active":"2024-04-24T23:00:15.397253+0000","last_became_peered":"2024-04-24T23:00:15.397253+0000","last_unstale":"2024-04-24T23:07:53.714346+0000","last_undegraded":"2024-04-24T23:07:53.714346+0000","last_fullsized":"2024-04-24T23:07:53.714346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:38.560562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":486,"num_write_kb":21108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'1063","reported_seq":1084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.895876+0000","last_change":"2024-04-24T23:00:20.506736+0000","last_active":"2024-04-24T23:07:55.895876+0000","last_peered":"2024-04-24T23:07:55.895876+0000","last_clean":"2024-04-24T23:07:55.895876+0000","last_became_active":"2024-04-24T23:00:20.505504+0000","last_became_peered":"2024-04-24T23:00:20.505504+0000","last_unstale":"2024-04-24T23:07:55.895876+0000","last_undegraded":"2024-04-24T23:07:55.895876+0000","last_fullsized":"2024-04-24T23:07:55.895876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:10.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1319,"num_write_kb":7863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'344","reported_seq":370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.484470+0000","last_change":"2024-04-24T23:00:16.451217+0000","last_active":"2024-04-24T23:08:02.484470+0000","last_peered":"2024-04-24T23:08:02.484470+0000","last_clean":"2024-04-24T23:08:02.484470+0000","last_became_active":"2024-04-24T23:00:16.450149+0000","last_became_peered":"2024-04-24T23:00:16.450149+0000","last_unstale":"2024-04-24T23:08:02.484470+0000","last_undegraded":"2024-04-24T23:08:02.484470+0000","last_fullsized":"2024-04-24T23:08:02.484470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:36.124103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'68","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:52.715205+0000","last_change":"2024-04-24T23:00:15.428164+0000","last_active":"2024-04-24T23:07:52.715205+0000","last_peered":"2024-04-24T23:07:52.715205+0000","last_clean":"2024-04-24T23:07:52.715205+0000","last_became_active":"2024-04-24T23:00:15.427857+0000","last_became_peered":"2024-04-24T23:00:15.427857+0000","last_unstale":"2024-04-24T23:07:52.715205+0000","last_undegraded":"2024-04-24T23:07:52.715205+0000","last_fullsized":"2024-04-24T23:07:52.715205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":104,"num_write_kb":4310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'1074","reported_seq":1095,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.849955+0000","last_change":"2024-04-24T23:00:20.507135+0000","last_active":"2024-04-24T23:07:55.849955+0000","last_peered":"2024-04-24T23:07:55.849955+0000","last_clean":"2024-04-24T23:07:55.849955+0000","last_became_active":"2024-04-24T23:00:20.506257+0000","last_became_peered":"2024-04-24T23:00:20.506257+0000","last_unstale":"2024-04-24T23:07:55.849955+0000","last_undegraded":"2024-04-24T23:07:55.849955+0000","last_fullsized":"2024-04-24T23:07:55.849955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":7398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1072","reported_seq":1100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.819077+0000","last_change":"2024-04-24T23:00:57.867192+0000","last_active":"2024-04-24T23:07:55.819077+0000","last_peered":"2024-04-24T23:07:55.819077+0000","last_clean":"2024-04-24T23:07:55.819077+0000","last_became_active":"2024-04-24T23:00:57.865999+0000","last_became_peered":"2024-04-24T23:00:57.865999+0000","last_unstale":"2024-04-24T23:07:55.819077+0000","last_undegraded":"2024-04-24T23:07:55.819077+0000","last_fullsized":"2024-04-24T23:07:55.819077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1072,"log_dups_size":0,"ondisk_log_size":1072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:48.727897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1313,"num_write_kb":7137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'327","reported_seq":354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.471120+0000","last_change":"2024-04-24T23:00:16.478734+0000","last_active":"2024-04-24T23:08:02.471120+0000","last_peered":"2024-04-24T23:08:02.471120+0000","last_clean":"2024-04-24T23:08:02.471120+0000","last_became_active":"2024-04-24T23:00:16.477474+0000","last_became_peered":"2024-04-24T23:00:16.477474+0000","last_unstale":"2024-04-24T23:08:02.471120+0000","last_undegraded":"2024-04-24T23:08:02.471120+0000","last_fullsized":"2024-04-24T23:08:02.471120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.178504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'570","reported_seq":598,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:51.887527+0000","last_change":"2024-04-24T23:00:15.405948+0000","last_active":"2024-04-24T23:07:51.887527+0000","last_peered":"2024-04-24T23:07:51.887527+0000","last_clean":"2024-04-24T23:07:51.887527+0000","last_became_active":"2024-04-24T23:00:15.405608+0000","last_became_peered":"2024-04-24T23:00:15.405608+0000","last_unstale":"2024-04-24T23:07:51.887527+0000","last_undegraded":"2024-04-24T23:07:51.887527+0000","last_fullsized":"2024-04-24T23:07:51.887527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:16:37.751284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":627,"num_write_kb":21153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'936","reported_seq":957,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.888541+0000","last_change":"2024-04-24T23:00:20.493810+0000","last_active":"2024-04-24T23:07:55.888541+0000","last_peered":"2024-04-24T23:07:55.888541+0000","last_clean":"2024-04-24T23:07:55.888541+0000","last_became_active":"2024-04-24T23:00:20.492303+0000","last_became_peered":"2024-04-24T23:00:20.492303+0000","last_unstale":"2024-04-24T23:07:55.888541+0000","last_undegraded":"2024-04-24T23:07:55.888541+0000","last_fullsized":"2024-04-24T23:07:55.888541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:58:38.649805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":6525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'350","reported_seq":377,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.847429+0000","last_change":"2024-04-24T23:00:16.465460+0000","last_active":"2024-04-24T23:07:55.847429+0000","last_peered":"2024-04-24T23:07:55.847429+0000","last_clean":"2024-04-24T23:07:55.847429+0000","last_became_active":"2024-04-24T23:00:16.457311+0000","last_became_peered":"2024-04-24T23:00:16.457311+0000","last_unstale":"2024-04-24T23:07:55.847429+0000","last_undegraded":"2024-04-24T23:07:55.847429+0000","last_fullsized":"2024-04-24T23:07:55.847429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:43:08.876496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":274,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'151","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.731772+0000","last_change":"2024-04-24T23:00:15.436608+0000","last_active":"2024-04-24T23:07:55.731772+0000","last_peered":"2024-04-24T23:07:55.731772+0000","last_clean":"2024-04-24T23:07:55.731772+0000","last_became_active":"2024-04-24T23:00:15.435730+0000","last_became_peered":"2024-04-24T23:00:15.435730+0000","last_unstale":"2024-04-24T23:07:55.731772+0000","last_undegraded":"2024-04-24T23:07:55.731772+0000","last_fullsized":"2024-04-24T23:07:55.731772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":198,"num_write_kb":4560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'1083","reported_seq":1111,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.719094+0000","last_change":"2024-04-24T23:00:15.417533+0000","last_active":"2024-04-24T23:07:53.719094+0000","last_peered":"2024-04-24T23:07:53.719094+0000","last_clean":"2024-04-24T23:07:53.719094+0000","last_became_active":"2024-04-24T23:00:15.417226+0000","last_became_peered":"2024-04-24T23:00:15.417226+0000","last_unstale":"2024-04-24T23:07:53.719094+0000","last_undegraded":"2024-04-24T23:07:53.719094+0000","last_fullsized":"2024-04-24T23:07:53.719094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1083,"log_dups_size":0,"ondisk_log_size":1083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:05.898513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":1127,"num_write_kb":29507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'300","reported_seq":327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.474384+0000","last_change":"2024-04-24T23:00:16.483374+0000","last_active":"2024-04-24T23:08:02.474384+0000","last_peered":"2024-04-24T23:08:02.474384+0000","last_clean":"2024-04-24T23:08:02.474384+0000","last_became_active":"2024-04-24T23:00:16.482676+0000","last_became_peered":"2024-04-24T23:00:16.482676+0000","last_unstale":"2024-04-24T23:08:02.474384+0000","last_undegraded":"2024-04-24T23:08:02.474384+0000","last_fullsized":"2024-04-24T23:08:02.474384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:05.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'936","reported_seq":957,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.856157+0000","last_change":"2024-04-24T23:00:20.542916+0000","last_active":"2024-04-24T23:07:55.856157+0000","last_peered":"2024-04-24T23:07:55.856157+0000","last_clean":"2024-04-24T23:07:55.856157+0000","last_became_active":"2024-04-24T23:00:20.541822+0000","last_became_peered":"2024-04-24T23:00:20.541822+0000","last_unstale":"2024-04-24T23:07:55.856157+0000","last_undegraded":"2024-04-24T23:07:55.856157+0000","last_fullsized":"2024-04-24T23:07:55.856157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:31.840092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":5864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'464","reported_seq":493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:48.756371+0000","last_change":"2024-04-24T23:00:15.425495+0000","last_active":"2024-04-24T23:07:48.756371+0000","last_peered":"2024-04-24T23:07:48.756371+0000","last_clean":"2024-04-24T23:07:48.756371+0000","last_became_active":"2024-04-24T23:00:15.424739+0000","last_became_peered":"2024-04-24T23:00:15.424739+0000","last_unstale":"2024-04-24T23:07:48.756371+0000","last_undegraded":"2024-04-24T23:07:48.756371+0000","last_fullsized":"2024-04-24T23:07:48.756371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:49.740745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":495,"num_write_kb":8616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'329","reported_seq":356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.464915+0000","last_change":"2024-04-24T23:00:16.454250+0000","last_active":"2024-04-24T23:08:02.464915+0000","last_peered":"2024-04-24T23:08:02.464915+0000","last_clean":"2024-04-24T23:08:02.464915+0000","last_became_active":"2024-04-24T23:00:16.453965+0000","last_became_peered":"2024-04-24T23:00:16.453965+0000","last_unstale":"2024-04-24T23:08:02.464915+0000","last_undegraded":"2024-04-24T23:08:02.464915+0000","last_fullsized":"2024-04-24T23:08:02.464915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'945","reported_seq":966,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.864627+0000","last_change":"2024-04-24T23:00:20.510475+0000","last_active":"2024-04-24T23:07:55.864627+0000","last_peered":"2024-04-24T23:07:55.864627+0000","last_clean":"2024-04-24T23:07:55.864627+0000","last_became_active":"2024-04-24T23:00:20.509269+0000","last_became_peered":"2024-04-24T23:00:20.509269+0000","last_unstale":"2024-04-24T23:07:55.864627+0000","last_undegraded":"2024-04-24T23:07:55.864627+0000","last_fullsized":"2024-04-24T23:07:55.864627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:09.596902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":6611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'351","reported_seq":377,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.450594+0000","last_change":"2024-04-24T23:00:16.456976+0000","last_active":"2024-04-24T23:08:02.450594+0000","last_peered":"2024-04-24T23:08:02.450594+0000","last_clean":"2024-04-24T23:08:02.450594+0000","last_became_active":"2024-04-24T23:00:16.456289+0000","last_became_peered":"2024-04-24T23:00:16.456289+0000","last_unstale":"2024-04-24T23:08:02.450594+0000","last_undegraded":"2024-04-24T23:08:02.450594+0000","last_fullsized":"2024-04-24T23:08:02.450594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'354","reported_seq":381,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.461531+0000","last_change":"2024-04-24T23:00:16.471774+0000","last_active":"2024-04-24T23:08:02.461531+0000","last_peered":"2024-04-24T23:08:02.461531+0000","last_clean":"2024-04-24T23:08:02.461531+0000","last_became_active":"2024-04-24T23:00:16.466134+0000","last_became_peered":"2024-04-24T23:00:16.466134+0000","last_unstale":"2024-04-24T23:08:02.461531+0000","last_undegraded":"2024-04-24T23:08:02.461531+0000","last_fullsized":"2024-04-24T23:08:02.461531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:31.237423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'352","reported_seq":378,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.464605+0000","last_change":"2024-04-24T23:00:16.465926+0000","last_active":"2024-04-24T23:08:02.464605+0000","last_peered":"2024-04-24T23:08:02.464605+0000","last_clean":"2024-04-24T23:08:02.464605+0000","last_became_active":"2024-04-24T23:00:16.465659+0000","last_became_peered":"2024-04-24T23:00:16.465659+0000","last_unstale":"2024-04-24T23:08:02.464605+0000","last_undegraded":"2024-04-24T23:08:02.464605+0000","last_fullsized":"2024-04-24T23:08:02.464605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:09:47.001195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'312","reported_seq":339,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.787739+0000","last_change":"2024-04-24T23:00:16.474929+0000","last_active":"2024-04-24T23:07:55.787739+0000","last_peered":"2024-04-24T23:07:55.787739+0000","last_clean":"2024-04-24T23:07:55.787739+0000","last_became_active":"2024-04-24T23:00:16.474181+0000","last_became_peered":"2024-04-24T23:00:16.474181+0000","last_unstale":"2024-04-24T23:07:55.787739+0000","last_undegraded":"2024-04-24T23:07:55.787739+0000","last_fullsized":"2024-04-24T23:07:55.787739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:56.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'294","reported_seq":321,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.804693+0000","last_change":"2024-04-24T23:00:16.458411+0000","last_active":"2024-04-24T23:07:55.804693+0000","last_peered":"2024-04-24T23:07:55.804693+0000","last_clean":"2024-04-24T23:07:55.804693+0000","last_became_active":"2024-04-24T23:00:16.457641+0000","last_became_peered":"2024-04-24T23:00:16.457641+0000","last_unstale":"2024-04-24T23:07:55.804693+0000","last_undegraded":"2024-04-24T23:07:55.804693+0000","last_fullsized":"2024-04-24T23:07:55.804693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:06.907656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'296","reported_seq":323,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.877058+0000","last_change":"2024-04-24T23:00:16.470324+0000","last_active":"2024-04-24T23:07:55.877058+0000","last_peered":"2024-04-24T23:07:55.877058+0000","last_clean":"2024-04-24T23:07:55.877058+0000","last_became_active":"2024-04-24T23:00:16.469614+0000","last_became_peered":"2024-04-24T23:00:16.469614+0000","last_unstale":"2024-04-24T23:07:55.877058+0000","last_undegraded":"2024-04-24T23:07:55.877058+0000","last_fullsized":"2024-04-24T23:07:55.877058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:05.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'376","reported_seq":402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.483056+0000","last_change":"2024-04-24T23:00:16.450764+0000","last_active":"2024-04-24T23:08:02.483056+0000","last_peered":"2024-04-24T23:08:02.483056+0000","last_clean":"2024-04-24T23:08:02.483056+0000","last_became_active":"2024-04-24T23:00:16.450561+0000","last_became_peered":"2024-04-24T23:00:16.450561+0000","last_unstale":"2024-04-24T23:08:02.483056+0000","last_undegraded":"2024-04-24T23:08:02.483056+0000","last_fullsized":"2024-04-24T23:08:02.483056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:30.426371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'352","reported_seq":379,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.810269+0000","last_change":"2024-04-24T23:00:16.453953+0000","last_active":"2024-04-24T23:07:55.810269+0000","last_peered":"2024-04-24T23:07:55.810269+0000","last_clean":"2024-04-24T23:07:55.810269+0000","last_became_active":"2024-04-24T23:00:16.452345+0000","last_became_peered":"2024-04-24T23:00:16.452345+0000","last_unstale":"2024-04-24T23:07:55.810269+0000","last_undegraded":"2024-04-24T23:07:55.810269+0000","last_fullsized":"2024-04-24T23:07:55.810269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:58.273719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'336","reported_seq":362,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.465508+0000","last_change":"2024-04-24T23:00:16.459030+0000","last_active":"2024-04-24T23:08:02.465508+0000","last_peered":"2024-04-24T23:08:02.465508+0000","last_clean":"2024-04-24T23:08:02.465508+0000","last_became_active":"2024-04-24T23:00:16.458402+0000","last_became_peered":"2024-04-24T23:00:16.458402+0000","last_unstale":"2024-04-24T23:08:02.465508+0000","last_undegraded":"2024-04-24T23:08:02.465508+0000","last_fullsized":"2024-04-24T23:08:02.465508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:33.558529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'298","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.893126+0000","last_change":"2024-04-24T23:00:16.456818+0000","last_active":"2024-04-24T23:07:54.893126+0000","last_peered":"2024-04-24T23:07:54.893126+0000","last_clean":"2024-04-24T23:07:54.893126+0000","last_became_active":"2024-04-24T23:00:16.453065+0000","last_became_peered":"2024-04-24T23:00:16.453065+0000","last_unstale":"2024-04-24T23:07:54.893126+0000","last_undegraded":"2024-04-24T23:07:54.893126+0000","last_fullsized":"2024-04-24T23:07:54.893126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:02.728439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'329","reported_seq":361,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.460757+0000","last_change":"2024-04-24T23:00:57.866802+0000","last_active":"2024-04-24T23:08:02.460757+0000","last_peered":"2024-04-24T23:08:02.460757+0000","last_clean":"2024-04-24T23:08:02.460757+0000","last_became_active":"2024-04-24T23:00:57.865894+0000","last_became_peered":"2024-04-24T23:00:57.865894+0000","last_unstale":"2024-04-24T23:08:02.460757+0000","last_undegraded":"2024-04-24T23:08:02.460757+0000","last_fullsized":"2024-04-24T23:08:02.460757+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:31.077128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'309","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.468833+0000","last_change":"2024-04-24T23:00:16.478716+0000","last_active":"2024-04-24T23:08:02.468833+0000","last_peered":"2024-04-24T23:08:02.468833+0000","last_clean":"2024-04-24T23:08:02.468833+0000","last_became_active":"2024-04-24T23:00:16.477982+0000","last_became_peered":"2024-04-24T23:00:16.477982+0000","last_unstale":"2024-04-24T23:08:02.468833+0000","last_undegraded":"2024-04-24T23:08:02.468833+0000","last_fullsized":"2024-04-24T23:08:02.468833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:04.285389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'353","reported_seq":380,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.475166+0000","last_change":"2024-04-24T23:00:16.449265+0000","last_active":"2024-04-24T23:08:02.475166+0000","last_peered":"2024-04-24T23:08:02.475166+0000","last_clean":"2024-04-24T23:08:02.475166+0000","last_became_active":"2024-04-24T23:00:16.446583+0000","last_became_peered":"2024-04-24T23:00:16.446583+0000","last_unstale":"2024-04-24T23:08:02.475166+0000","last_undegraded":"2024-04-24T23:08:02.475166+0000","last_fullsized":"2024-04-24T23:08:02.475166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:38.429072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'307","reported_seq":333,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.466595+0000","last_change":"2024-04-24T23:00:16.483354+0000","last_active":"2024-04-24T23:08:02.466595+0000","last_peered":"2024-04-24T23:08:02.466595+0000","last_clean":"2024-04-24T23:08:02.466595+0000","last_became_active":"2024-04-24T23:00:16.483079+0000","last_became_peered":"2024-04-24T23:00:16.483079+0000","last_unstale":"2024-04-24T23:08:02.466595+0000","last_undegraded":"2024-04-24T23:08:02.466595+0000","last_fullsized":"2024-04-24T23:08:02.466595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:57:02.861698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'303","reported_seq":330,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.464863+0000","last_change":"2024-04-24T23:00:16.472605+0000","last_active":"2024-04-24T23:08:02.464863+0000","last_peered":"2024-04-24T23:08:02.464863+0000","last_clean":"2024-04-24T23:08:02.464863+0000","last_became_active":"2024-04-24T23:00:16.466076+0000","last_became_peered":"2024-04-24T23:00:16.466076+0000","last_unstale":"2024-04-24T23:08:02.464863+0000","last_undegraded":"2024-04-24T23:08:02.464863+0000","last_fullsized":"2024-04-24T23:08:02.464863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'324","reported_seq":350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.468914+0000","last_change":"2024-04-24T23:00:16.457737+0000","last_active":"2024-04-24T23:08:02.468914+0000","last_peered":"2024-04-24T23:08:02.468914+0000","last_clean":"2024-04-24T23:08:02.468914+0000","last_became_active":"2024-04-24T23:00:16.453949+0000","last_became_peered":"2024-04-24T23:00:16.453949+0000","last_unstale":"2024-04-24T23:08:02.468914+0000","last_undegraded":"2024-04-24T23:08:02.468914+0000","last_fullsized":"2024-04-24T23:08:02.468914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:08.928463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'334","reported_seq":360,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.443196+0000","last_change":"2024-04-24T23:00:16.452839+0000","last_active":"2024-04-24T23:08:02.443196+0000","last_peered":"2024-04-24T23:08:02.443196+0000","last_clean":"2024-04-24T23:08:02.443196+0000","last_became_active":"2024-04-24T23:00:16.445253+0000","last_became_peered":"2024-04-24T23:00:16.445253+0000","last_unstale":"2024-04-24T23:08:02.443196+0000","last_undegraded":"2024-04-24T23:08:02.443196+0000","last_fullsized":"2024-04-24T23:08:02.443196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:23.938299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'300","reported_seq":327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.837775+0000","last_change":"2024-04-24T23:00:16.455784+0000","last_active":"2024-04-24T23:07:55.837775+0000","last_peered":"2024-04-24T23:07:55.837775+0000","last_clean":"2024-04-24T23:07:55.837775+0000","last_became_active":"2024-04-24T23:00:16.454953+0000","last_became_peered":"2024-04-24T23:00:16.454953+0000","last_unstale":"2024-04-24T23:07:55.837775+0000","last_undegraded":"2024-04-24T23:07:55.837775+0000","last_fullsized":"2024-04-24T23:07:55.837775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:32.545524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'310","reported_seq":337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.982689+0000","last_change":"2024-04-24T23:00:16.468365+0000","last_active":"2024-04-24T23:07:54.982689+0000","last_peered":"2024-04-24T23:07:54.982689+0000","last_clean":"2024-04-24T23:07:54.982689+0000","last_became_active":"2024-04-24T23:00:16.467630+0000","last_became_peered":"2024-04-24T23:00:16.467630+0000","last_unstale":"2024-04-24T23:07:54.982689+0000","last_undegraded":"2024-04-24T23:07:54.982689+0000","last_fullsized":"2024-04-24T23:07:54.982689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'299","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.891514+0000","last_change":"2024-04-24T23:00:16.456188+0000","last_active":"2024-04-24T23:07:55.891514+0000","last_peered":"2024-04-24T23:07:55.891514+0000","last_clean":"2024-04-24T23:07:55.891514+0000","last_became_active":"2024-04-24T23:00:16.455114+0000","last_became_peered":"2024-04-24T23:00:16.455114+0000","last_unstale":"2024-04-24T23:07:55.891514+0000","last_undegraded":"2024-04-24T23:07:55.891514+0000","last_fullsized":"2024-04-24T23:07:55.891514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:36.124103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'287","reported_seq":314,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.475402+0000","last_change":"2024-04-24T23:00:16.450776+0000","last_active":"2024-04-24T23:08:02.475402+0000","last_peered":"2024-04-24T23:08:02.475402+0000","last_clean":"2024-04-24T23:08:02.475402+0000","last_became_active":"2024-04-24T23:00:16.450466+0000","last_became_peered":"2024-04-24T23:00:16.450466+0000","last_unstale":"2024-04-24T23:08:02.475402+0000","last_undegraded":"2024-04-24T23:08:02.475402+0000","last_fullsized":"2024-04-24T23:08:02.475402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:32.331306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'307","reported_seq":334,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.473606+0000","last_change":"2024-04-24T23:00:16.450743+0000","last_active":"2024-04-24T23:08:02.473606+0000","last_peered":"2024-04-24T23:08:02.473606+0000","last_clean":"2024-04-24T23:08:02.473606+0000","last_became_active":"2024-04-24T23:00:16.450279+0000","last_became_peered":"2024-04-24T23:00:16.450279+0000","last_unstale":"2024-04-24T23:08:02.473606+0000","last_undegraded":"2024-04-24T23:08:02.473606+0000","last_fullsized":"2024-04-24T23:08:02.473606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:52:00.869015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'298","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.473290+0000","last_change":"2024-04-24T23:00:16.446745+0000","last_active":"2024-04-24T23:08:02.473290+0000","last_peered":"2024-04-24T23:08:02.473290+0000","last_clean":"2024-04-24T23:08:02.473290+0000","last_became_active":"2024-04-24T23:00:16.446317+0000","last_became_peered":"2024-04-24T23:00:16.446317+0000","last_unstale":"2024-04-24T23:08:02.473290+0000","last_undegraded":"2024-04-24T23:08:02.473290+0000","last_fullsized":"2024-04-24T23:08:02.473290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:47.110869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'337","reported_seq":364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.440927+0000","last_change":"2024-04-24T23:00:16.446352+0000","last_active":"2024-04-24T23:08:02.440927+0000","last_peered":"2024-04-24T23:08:02.440927+0000","last_clean":"2024-04-24T23:08:02.440927+0000","last_became_active":"2024-04-24T23:00:16.445839+0000","last_became_peered":"2024-04-24T23:00:16.445839+0000","last_unstale":"2024-04-24T23:08:02.440927+0000","last_undegraded":"2024-04-24T23:08:02.440927+0000","last_fullsized":"2024-04-24T23:08:02.440927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'264","reported_seq":291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.864112+0000","last_change":"2024-04-24T23:00:16.451439+0000","last_active":"2024-04-24T23:07:53.864112+0000","last_peered":"2024-04-24T23:07:53.864112+0000","last_clean":"2024-04-24T23:07:53.864112+0000","last_became_active":"2024-04-24T23:00:16.450293+0000","last_became_peered":"2024-04-24T23:00:16.450293+0000","last_unstale":"2024-04-24T23:07:53.864112+0000","last_undegraded":"2024-04-24T23:07:53.864112+0000","last_fullsized":"2024-04-24T23:07:53.864112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:19.586817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'314","reported_seq":341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.467752+0000","last_change":"2024-04-24T23:00:16.482222+0000","last_active":"2024-04-24T23:08:02.467752+0000","last_peered":"2024-04-24T23:08:02.467752+0000","last_clean":"2024-04-24T23:08:02.467752+0000","last_became_active":"2024-04-24T23:00:16.481897+0000","last_became_peered":"2024-04-24T23:00:16.481897+0000","last_unstale":"2024-04-24T23:08:02.467752+0000","last_undegraded":"2024-04-24T23:08:02.467752+0000","last_fullsized":"2024-04-24T23:08:02.467752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'318","reported_seq":344,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.468141+0000","last_change":"2024-04-24T23:00:16.482100+0000","last_active":"2024-04-24T23:08:02.468141+0000","last_peered":"2024-04-24T23:08:02.468141+0000","last_clean":"2024-04-24T23:08:02.468141+0000","last_became_active":"2024-04-24T23:00:16.481832+0000","last_became_peered":"2024-04-24T23:00:16.481832+0000","last_unstale":"2024-04-24T23:08:02.468141+0000","last_undegraded":"2024-04-24T23:08:02.468141+0000","last_fullsized":"2024-04-24T23:08:02.468141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'323","reported_seq":350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.473103+0000","last_change":"2024-04-24T23:00:16.466121+0000","last_active":"2024-04-24T23:08:02.473103+0000","last_peered":"2024-04-24T23:08:02.473103+0000","last_clean":"2024-04-24T23:08:02.473103+0000","last_became_active":"2024-04-24T23:00:16.465749+0000","last_became_peered":"2024-04-24T23:00:16.465749+0000","last_unstale":"2024-04-24T23:08:02.473103+0000","last_undegraded":"2024-04-24T23:08:02.473103+0000","last_fullsized":"2024-04-24T23:08:02.473103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:05.734745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'308","reported_seq":334,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.469788+0000","last_change":"2024-04-24T23:00:16.481682+0000","last_active":"2024-04-24T23:08:02.469788+0000","last_peered":"2024-04-24T23:08:02.469788+0000","last_clean":"2024-04-24T23:08:02.469788+0000","last_became_active":"2024-04-24T23:00:16.481381+0000","last_became_peered":"2024-04-24T23:00:16.481381+0000","last_unstale":"2024-04-24T23:08:02.469788+0000","last_undegraded":"2024-04-24T23:08:02.469788+0000","last_fullsized":"2024-04-24T23:08:02.469788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:37:14.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'298","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.837116+0000","last_change":"2024-04-24T23:00:16.461984+0000","last_active":"2024-04-24T23:07:55.837116+0000","last_peered":"2024-04-24T23:07:55.837116+0000","last_clean":"2024-04-24T23:07:55.837116+0000","last_became_active":"2024-04-24T23:00:16.461267+0000","last_became_peered":"2024-04-24T23:00:16.461267+0000","last_unstale":"2024-04-24T23:07:55.837116+0000","last_undegraded":"2024-04-24T23:07:55.837116+0000","last_fullsized":"2024-04-24T23:07:55.837116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:53:00.776972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'322","reported_seq":349,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.055917+0000","last_change":"2024-04-24T23:00:16.460191+0000","last_active":"2024-04-24T23:07:55.055917+0000","last_peered":"2024-04-24T23:07:55.055917+0000","last_clean":"2024-04-24T23:07:55.055917+0000","last_became_active":"2024-04-24T23:00:16.459445+0000","last_became_peered":"2024-04-24T23:00:16.459445+0000","last_unstale":"2024-04-24T23:07:55.055917+0000","last_undegraded":"2024-04-24T23:07:55.055917+0000","last_fullsized":"2024-04-24T23:07:55.055917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:12.313822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'310","reported_seq":337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.470627+0000","last_change":"2024-04-24T23:00:16.450409+0000","last_active":"2024-04-24T23:08:02.470627+0000","last_peered":"2024-04-24T23:08:02.470627+0000","last_clean":"2024-04-24T23:08:02.470627+0000","last_became_active":"2024-04-24T23:00:16.450061+0000","last_became_peered":"2024-04-24T23:00:16.450061+0000","last_unstale":"2024-04-24T23:08:02.470627+0000","last_undegraded":"2024-04-24T23:08:02.470627+0000","last_fullsized":"2024-04-24T23:08:02.470627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:23.938299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40344,"num_write_kb":220872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32314,"ondisk_log_size":32314,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15318,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20270,"ondisk_log_size":20270,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":156152903,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":1142,"num_read_kb":1796,"num_write":15519,"num_write_kb":443889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87670784,"data_stored":312305806,"data_compressed":57745618,"data_compressed_allocated":71630848,"data_compressed_original":296329216,"omap_allocated":0,"internal_metadata":0},"log_size":13416,"ondisk_log_size":13416,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509538,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116732,"kb_used_data":9204,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94255108,"statfs":{"total":96636764160,"available":96517230592,"internally_reserved":0,"allocated":9424896,"data_stored":30817518,"data_compressed":5693383,"data_compressed_allocated":7151616,"data_compressed_original":28721152,"omap_allocated":1590,"internal_metadata":110098890},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509538,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112928,"kb_used_data":9624,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94258912,"statfs":{"total":96636764160,"available":96521125888,"internally_reserved":0,"allocated":9854976,"data_stored":37485867,"data_compressed":6753749,"data_compressed_allocated":8212480,"data_compressed_original":36028416,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509539,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133964,"kb_used_data":12612,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94237876,"statfs":{"total":96636764160,"available":96499585024,"internally_reserved":0,"allocated":12914688,"data_stored":46253360,"data_compressed":8519580,"data_compressed_allocated":10514432,"data_compressed_original":44023808,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509539,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89148,"kb_used_data":3828,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94282692,"statfs":{"total":96636764160,"available":96545476608,"internally_reserved":0,"allocated":3919872,"data_stored":12699018,"data_compressed":2449723,"data_compressed_allocated":3092480,"data_compressed_original":12046336,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509539,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113264,"kb_used_data":9896,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94258576,"statfs":{"total":96636764160,"available":96520781824,"internally_reserved":0,"allocated":10133504,"data_stored":34260304,"data_compressed":6393594,"data_compressed_allocated":7995392,"data_compressed_original":32296960,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509538,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131964,"kb_used_data":16180,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94239876,"statfs":{"total":96636764160,"available":96501633024,"internally_reserved":0,"allocated":16568320,"data_stored":58456099,"data_compressed":10542411,"data_compressed_allocated":13033472,"data_compressed_original":55099392,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542243,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91380,"kb_used_data":10220,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94280460,"statfs":{"total":96636764160,"available":96543191040,"internally_reserved":0,"allocated":10465280,"data_stored":37864170,"data_compressed":6877701,"data_compressed_allocated":8454144,"data_compressed_original":36020224,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119692,"kb_used_data":16388,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94252148,"statfs":{"total":96636764160,"available":96514199552,"internally_reserved":0,"allocated":16781312,"data_stored":56573678,"data_compressed":10582231,"data_compressed_allocated":13266944,"data_compressed_original":53239808,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16285696,"data_stored":58340665,"data_compressed":10542411,"data_compressed_allocated":13033472,"data_compressed_original":55099392,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9785344,"data_stored":33554502,"data_compressed":6360217,"data_compressed_allocated":7950336,"data_compressed_original":31723520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3637248,"data_stored":12583584,"data_compressed":2449723,"data_compressed_allocated":3092480,"data_compressed_original":12046336,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":46137926,"data_compressed":8519580,"data_compressed_allocated":10514432,"data_compressed_original":44023808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9572352,"data_stored":37370433,"data_compressed":6753749,"data_compressed_allocated":8212480,"data_compressed_original":36028416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16433152,"data_stored":55867876,"data_compressed":10548854,"data_compressed_allocated":13221888,"data_compressed_original":52666368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10182656,"data_stored":37748736,"data_compressed":6877701,"data_compressed_allocated":8454144,"data_compressed_original":36020224,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9142272,"data_stored":30702084,"data_compressed":5693383,"data_compressed_allocated":7151616,"data_compressed_original":28721152,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:08:04.541 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:08:04.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.686+0000 7fb535fba640 1 Processor -- start 2024-04-24T23:08:04.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb535fba640 1 -- start start 2024-04-24T23:08:04.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb535fba640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb530070ea0 0x7fb53013e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:04.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb535fba640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5300b6de0 con 0x7fb5300b6a00 2024-04-24T23:08:04.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb535fba640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5300721c0 con 0x7fb53013e7b0 2024-04-24T23:08:04.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb535fba640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb5300716e0 con 0x7fb530070ea0 2024-04-24T23:08:04.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52f7fe640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb5300b6a00 0x7fb530147940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33840/0 (socket says 172.21.15.43:33840) 2024-04-24T23:08:04.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52f7fe640 1 -- 172.21.15.43:0/858642225 learned_addr learned my addr 172.21.15.43:0/858642225 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:04.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52effd640 1 --2- 172.21.15.43:0/858642225 >> v2:172.21.15.162:3300/0 conn(0x7fb530070ea0 0x7fb53013e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:04.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52e7fc640 1 -- 172.21.15.43:0/858642225 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2894513219 0 0) 0x7fb5300b6de0 con 0x7fb5300b6a00 2024-04-24T23:08:04.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52e7fc640 1 -- 172.21.15.43:0/858642225 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb518005740 con 0x7fb5300b6a00 2024-04-24T23:08:04.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52e7fc640 1 -- 172.21.15.43:0/858642225 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2149835371 0 0) 0x7fb518005740 con 0x7fb5300b6a00 2024-04-24T23:08:04.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52e7fc640 1 -- 172.21.15.43:0/858642225 >> v2:172.21.15.162:3300/0 conn(0x7fb530070ea0 msgr2=0x7fb53013e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:04.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52e7fc640 1 --2- 172.21.15.43:0/858642225 >> v2:172.21.15.162:3300/0 conn(0x7fb530070ea0 0x7fb53013e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52e7fc640 1 -- 172.21.15.43:0/858642225 >> v1:172.21.15.162:6789/0 conn(0x7fb53013e7b0 legacy=0x7fb53014ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:04.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52e7fc640 1 -- 172.21.15.43:0/858642225 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5300719c0 con 0x7fb5300b6a00 2024-04-24T23:08:04.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52e7fc640 1 -- 172.21.15.43:0/858642225 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7fb524001680 con 0x7fb5300b6a00 2024-04-24T23:08:04.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52e7fc640 1 -- 172.21.15.43:0/858642225 >> v1:172.21.15.43:6789/0 conn(0x7fb5300b6a00 legacy=0x7fb530147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:04.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52e7fc640 1 --2- 172.21.15.43:0/858642225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb518005bd0 0x7fb518005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:04.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52e7fc640 1 --2- 172.21.15.43:0/858642225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb518006a20 0x7fb518006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:04.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52e7fc640 1 --2- 172.21.15.43:0/858642225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb518007500 0x7fb51800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:04.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52e7fc640 1 -- 172.21.15.43:0/858642225 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb5300716e0 con 0x7fb518005bd0 2024-04-24T23:08:04.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52e7fc640 1 -- 172.21.15.43:0/858642225 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb51800e3d0 con 0x7fb518006a20 2024-04-24T23:08:04.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52e7fc640 1 -- 172.21.15.43:0/858642225 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb51800e5d0 con 0x7fb518007500 2024-04-24T23:08:04.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52f7fe640 1 --2- 172.21.15.43:0/858642225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb518005bd0 0x7fb518005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:04.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52ffff640 1 --2- 172.21.15.43:0/858642225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb518007500 0x7fb51800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:04.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52effd640 1 --2- 172.21.15.43:0/858642225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb518006a20 0x7fb518006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:04.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52f7fe640 1 -- 172.21.15.43:0/858642225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb518007500 msgr2=0x7fb51800dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:04.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52f7fe640 1 --2- 172.21.15.43:0/858642225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb518007500 0x7fb51800dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52f7fe640 1 -- 172.21.15.43:0/858642225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb518006a20 msgr2=0x7fb518006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:04.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52f7fe640 1 --2- 172.21.15.43:0/858642225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb518006a20 0x7fb518006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52f7fe640 1 -- 172.21.15.43:0/858642225 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb518005740 con 0x7fb518005bd0 2024-04-24T23:08:04.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52ffff640 1 -- 172.21.15.43:0/858642225 reap_dead start 2024-04-24T23:08:04.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.690+0000 7fb52effd640 1 --2- 172.21.15.43:0/858642225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb518006a20 0x7fb518006ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:04.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb52f7fe640 1 --2- 172.21.15.43:0/858642225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb518005bd0 0x7fb518005ff0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb52400c210 tx=0x7fb52401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de7bf235bcd1d26 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:04.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb52e7fc640 1 -- 172.21.15.43:0/858642225 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524007d20 con 0x7fb518005bd0 2024-04-24T23:08:04.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb52e7fc640 1 -- 172.21.15.43:0/858642225 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5240a9070 con 0x7fb518005bd0 2024-04-24T23:08:04.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb52e7fc640 1 -- 172.21.15.43:0/858642225 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524005da0 con 0x7fb518005bd0 2024-04-24T23:08:04.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 -- 172.21.15.43:0/858642225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb518005bd0 msgr2=0x7fb518005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:04.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 --2- 172.21.15.43:0/858642225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb518005bd0 0x7fb518005ff0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb52400c210 tx=0x7fb52401cc40 comp rx=0 tx=0).stop 2024-04-24T23:08:04.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 -- 172.21.15.43:0/858642225 shutdown_connections 2024-04-24T23:08:04.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 --2- 172.21.15.43:0/858642225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb518005bd0 0x7fb518005ff0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 -- 172.21.15.43:0/858642225 >> 172.21.15.43:0/858642225 conn(0x7fb53006c300 msgr2=0x7fb53006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:04.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 -- 172.21.15.43:0/858642225 shutdown_connections 2024-04-24T23:08:04.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 -- 172.21.15.43:0/858642225 wait complete. 2024-04-24T23:08:04.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 Processor -- start 2024-04-24T23:08:04.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 -- start start 2024-04-24T23:08:04.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb518005bd0 0x7fb5301393a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:04.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5300ad8e0 0x7fb5301e4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:04.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5301e0960 0x7fb5301e0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:04.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb5300b4630 con 0x7fb5301e0960 2024-04-24T23:08:04.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb5300b0e30 con 0x7fb5300ad8e0 2024-04-24T23:08:04.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb5300b47b0 con 0x7fb518005bd0 2024-04-24T23:08:04.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb52ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5301e0960 0x7fb5301e0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:04.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb52ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5301e0960 0x7fb5301e0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54732/0 (socket says 172.21.15.43:54732) 2024-04-24T23:08:04.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb52ffff640 1 -- 172.21.15.43:0/3302300040 learned_addr learned my addr 172.21.15.43:0/3302300040 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:04.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb52ffff640 1 -- 172.21.15.43:0/3302300040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb518005bd0 msgr2=0x7fb5301393a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:04.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb52ffff640 1 --2- 172.21.15.43:0/3302300040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb518005bd0 0x7fb5301393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb52ffff640 1 -- 172.21.15.43:0/3302300040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5300ad8e0 msgr2=0x7fb5301e4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:04.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb52effd640 1 --2- 172.21.15.43:0/3302300040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5300ad8e0 0x7fb5301e4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:04.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb52ffff640 1 --2- 172.21.15.43:0/3302300040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5300ad8e0 0x7fb5301e4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb52ffff640 1 -- 172.21.15.43:0/3302300040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5301e1330 con 0x7fb5301e0960 2024-04-24T23:08:04.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb52ffff640 1 --2- 172.21.15.43:0/3302300040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5301e0960 0x7fb5301e0df0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb530141fe0 tx=0x7fb52800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:04.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb517fff640 1 -- 172.21.15.43:0/3302300040 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528018070 con 0x7fb5301e0960 2024-04-24T23:08:04.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb517fff640 1 -- 172.21.15.43:0/3302300040 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb528003ba0 con 0x7fb5301e0960 2024-04-24T23:08:04.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb517fff640 1 -- 172.21.15.43:0/3302300040 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528005070 con 0x7fb5301e0960 2024-04-24T23:08:04.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 -- 172.21.15.43:0/3302300040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53013c8b0 con 0x7fb5301e0960 2024-04-24T23:08:04.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.694+0000 7fb535fba640 1 -- 172.21.15.43:0/3302300040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5301e3970 con 0x7fb5301e0960 2024-04-24T23:08:04.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.698+0000 7fb535fba640 1 -- 172.21.15.43:0/3302300040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb53004f580 con 0x7fb5301e0960 2024-04-24T23:08:04.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.698+0000 7fb517fff640 1 -- 172.21.15.43:0/3302300040 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb528005210 con 0x7fb5301e0960 2024-04-24T23:08:04.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.698+0000 7fb517fff640 1 --2- 172.21.15.43:0/3302300040 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb51c0678f0 0x7fb51c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:04.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.698+0000 7fb52f7fe640 1 --2- 172.21.15.43:0/3302300040 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb51c0678f0 0x7fb51c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:04.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.698+0000 7fb517fff640 1 -- 172.21.15.43:0/3302300040 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fb528085680 con 0x7fb5301e0960 2024-04-24T23:08:04.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.698+0000 7fb52f7fe640 1 --2- 172.21.15.43:0/3302300040 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb51c0678f0 0x7fb51c069db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb5240ab000 tx=0x7fb5301443d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:04.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.706+0000 7fb517fff640 1 -- 172.21.15.43:0/3302300040 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fb528055e80 con 0x7fb5301e0960 2024-04-24T23:08:04.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.870+0000 7fb535fba640 1 -- 172.21.15.43:0/3302300040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb530143180 con 0x7fb5301e0960 2024-04-24T23:08:04.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.870+0000 7fb517fff640 1 -- 172.21.15.43:0/3302300040 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18754 (secure 0 0 0) 0x7fb528055780 con 0x7fb5301e0960 2024-04-24T23:08:04.874 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:08:04.874 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:57.637496+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":5}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.1a","mappings":[{"from":7,"to":4}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:08:04.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.874+0000 7fb535fba640 1 -- 172.21.15.43:0/3302300040 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb51c0678f0 msgr2=0x7fb51c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:04.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.874+0000 7fb535fba640 1 --2- 172.21.15.43:0/3302300040 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb51c0678f0 0x7fb51c069db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb5240ab000 tx=0x7fb5301443d0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.874+0000 7fb535fba640 1 -- 172.21.15.43:0/3302300040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5301e0960 msgr2=0x7fb5301e0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:04.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.874+0000 7fb535fba640 1 --2- 172.21.15.43:0/3302300040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5301e0960 0x7fb5301e0df0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb530141fe0 tx=0x7fb52800dc00 comp rx=0 tx=0).stop 2024-04-24T23:08:04.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.874+0000 7fb535fba640 1 -- 172.21.15.43:0/3302300040 shutdown_connections 2024-04-24T23:08:04.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.874+0000 7fb535fba640 1 --2- 172.21.15.43:0/3302300040 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fb51c0678f0 0x7fb51c069db0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.874+0000 7fb535fba640 1 --2- 172.21.15.43:0/3302300040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5301e0960 0x7fb5301e0df0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.874+0000 7fb535fba640 1 --2- 172.21.15.43:0/3302300040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5300ad8e0 0x7fb5301e4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.874+0000 7fb535fba640 1 --2- 172.21.15.43:0/3302300040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb518005bd0 0x7fb5301393a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:04.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.874+0000 7fb535fba640 1 -- 172.21.15.43:0/3302300040 >> 172.21.15.43:0/3302300040 conn(0x7fb53006c300 msgr2=0x7fb530139dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:04.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.874+0000 7fb535fba640 1 -- 172.21.15.43:0/3302300040 shutdown_connections 2024-04-24T23:08:04.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:04.874+0000 7fb535fba640 1 -- 172.21.15.43:0/3302300040 wait complete. 2024-04-24T23:08:05.894 INFO:tasks.ceph:Scrubbing osd.0 2024-04-24T23:08:05.894 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:08:06.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.014+0000 7f13fc27e640 1 Processor -- start 2024-04-24T23:08:06.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.014+0000 7f13fc27e640 1 -- start start 2024-04-24T23:08:06.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.014+0000 7f13fc27e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f13f40b60a0 0x7f13f40b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.014+0000 7f13fc27e640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13f40b6480 con 0x7f13f4070eb0 2024-04-24T23:08:06.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.014+0000 7f13fc27e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13f40b6dc0 con 0x7f13f40b56a0 2024-04-24T23:08:06.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.014+0000 7f13fc27e640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f13f40b5210 con 0x7f13f40b60a0 2024-04-24T23:08:06.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.014+0000 7f13fa01a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f13f40b60a0 0x7f13f40b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.014+0000 7f13f9819640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f13f4070eb0 0x7f13f41414d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33852/0 (socket says 172.21.15.43:33852) 2024-04-24T23:08:06.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.014+0000 7f13f9819640 1 -- 172.21.15.43:0/1659758527 learned_addr learned my addr 172.21.15.43:0/1659758527 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:06.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.014+0000 7f13fa01a640 1 -- 172.21.15.43:0/1659758527 >> v1:172.21.15.162:6789/0 conn(0x7f13f40b56a0 legacy=0x7f13f4151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:06.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.014+0000 7f13f9018640 1 -- 172.21.15.43:0/1659758527 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777218608 0 0) 0x7f13f40b6480 con 0x7f13f4070eb0 2024-04-24T23:08:06.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.014+0000 7f13fa01a640 1 -- 172.21.15.43:0/1659758527 >> v1:172.21.15.43:6789/0 conn(0x7f13f4070eb0 legacy=0x7f13f41414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.014+0000 7f13fa01a640 1 -- 172.21.15.43:0/1659758527 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f40b4ea0 con 0x7f13f40b60a0 2024-04-24T23:08:06.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.018+0000 7f13fa01a640 1 --2- 172.21.15.43:0/1659758527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13f40b60a0 0x7f13f40b67a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f13ec009d90 tx=0x7f13ec01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c0f3c474861244 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.018+0000 7f13f9018640 1 -- 172.21.15.43:0/1659758527 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec0b2070 con 0x7f13f40b60a0 2024-04-24T23:08:06.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.018+0000 7f13f9018640 1 -- 172.21.15.43:0/1659758527 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13ec0a58c0 con 0x7f13f40b60a0 2024-04-24T23:08:06.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.018+0000 7f13f9018640 1 -- 172.21.15.43:0/1659758527 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec0a5c90 con 0x7f13f40b60a0 2024-04-24T23:08:06.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.018+0000 7f13fc27e640 1 -- 172.21.15.43:0/1659758527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13f40b60a0 msgr2=0x7f13f40b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.018+0000 7f13fc27e640 1 --2- 172.21.15.43:0/1659758527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13f40b60a0 0x7f13f40b67a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f13ec009d90 tx=0x7f13ec01c930 comp rx=0 tx=0).stop 2024-04-24T23:08:06.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.018+0000 7f13fc27e640 1 -- 172.21.15.43:0/1659758527 shutdown_connections 2024-04-24T23:08:06.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.018+0000 7f13fc27e640 1 --2- 172.21.15.43:0/1659758527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13f40b60a0 0x7f13f40b67a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.018+0000 7f13fc27e640 1 -- 172.21.15.43:0/1659758527 >> 172.21.15.43:0/1659758527 conn(0x7f13f406c300 msgr2=0x7f13f406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:06.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.018+0000 7f13fc27e640 1 -- 172.21.15.43:0/1659758527 shutdown_connections 2024-04-24T23:08:06.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.018+0000 7f13fc27e640 1 -- 172.21.15.43:0/1659758527 wait complete. 2024-04-24T23:08:06.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.018+0000 7f13fc27e640 1 Processor -- start 2024-04-24T23:08:06.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.018+0000 7f13fc27e640 1 -- start start 2024-04-24T23:08:06.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fc27e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13f4070eb0 0x7f13f40ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fc27e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f40b56a0 0x7f13f40b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fc27e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13f40b60a0 0x7f13f41e3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fc27e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f13f4156120 con 0x7f13f4070eb0 2024-04-24T23:08:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fc27e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13f4155fa0 con 0x7f13f40b56a0 2024-04-24T23:08:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fc27e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f13f41562a0 con 0x7f13f40b60a0 2024-04-24T23:08:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fa01a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13f4070eb0 0x7f13f40ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fa01a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13f4070eb0 0x7f13f40ad9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54742/0 (socket says 172.21.15.43:54742) 2024-04-24T23:08:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fa01a640 1 -- 172.21.15.43:0/2107356305 learned_addr learned my addr 172.21.15.43:0/2107356305 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fa81b640 1 --2- 172.21.15.43:0/2107356305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13f40b60a0 0x7f13f41e3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13f9819640 1 --2- 172.21.15.43:0/2107356305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f40b56a0 0x7f13f40b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fa01a640 1 -- 172.21.15.43:0/2107356305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13f40b60a0 msgr2=0x7f13f41e3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fa01a640 1 --2- 172.21.15.43:0/2107356305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13f40b60a0 0x7f13f41e3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fa01a640 1 -- 172.21.15.43:0/2107356305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f40b56a0 msgr2=0x7f13f40b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fa01a640 1 --2- 172.21.15.43:0/2107356305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f40b56a0 0x7f13f40b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fa01a640 1 -- 172.21.15.43:0/2107356305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f40aeb70 con 0x7f13f4070eb0 2024-04-24T23:08:06.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13f9819640 1 --2- 172.21.15.43:0/2107356305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f40b56a0 0x7f13f40b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:06.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fa01a640 1 --2- 172.21.15.43:0/2107356305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13f4070eb0 0x7f13f40ad9e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f13ec019540 tx=0x7f13ec0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13eaffd640 1 -- 172.21.15.43:0/2107356305 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec0bd020 con 0x7f13f4070eb0 2024-04-24T23:08:06.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fc27e640 1 -- 172.21.15.43:0/2107356305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f40aee50 con 0x7f13f4070eb0 2024-04-24T23:08:06.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fc27e640 1 -- 172.21.15.43:0/2107356305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f40ae140 con 0x7f13f4070eb0 2024-04-24T23:08:06.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13eaffd640 1 -- 172.21.15.43:0/2107356305 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13ec0b8670 con 0x7f13f4070eb0 2024-04-24T23:08:06.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13eaffd640 1 -- 172.21.15.43:0/2107356305 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec0b2040 con 0x7f13f4070eb0 2024-04-24T23:08:06.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fc27e640 1 -- 172.21.15.43:0/2107356305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f13f4144e80 con 0x7f13f4070eb0 2024-04-24T23:08:06.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13eaffd640 1 -- 172.21.15.43:0/2107356305 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f13ec0c0020 con 0x7f13f4070eb0 2024-04-24T23:08:06.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13eaffd640 1 --2- 172.21.15.43:0/2107356305 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f13d80678c0 0x7f13d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13eaffd640 1 -- 172.21.15.43:0/2107356305 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f13ec121690 con 0x7f13f4070eb0 2024-04-24T23:08:06.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13f9819640 1 --2- 172.21.15.43:0/2107356305 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f13d80678c0 0x7f13d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13eaffd640 1 --2- 172.21.15.43:0/2107356305 >> [v2:172.21.15.43:6800/4282580106,v1:172.21.15.43:6801/4282580106] conn(0x7f13d80711e0 0x7f13d8073680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13eaffd640 1 -- 172.21.15.43:0/2107356305 --> [v2:172.21.15.43:6800/4282580106,v1:172.21.15.43:6801/4282580106] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13ec0b6e50 con 0x7f13d80711e0 2024-04-24T23:08:06.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13eaffd640 1 -- 172.21.15.43:0/2107356305 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f13ec121a40 con 0x7f13f4070eb0 2024-04-24T23:08:06.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fa81b640 1 --2- 172.21.15.43:0/2107356305 >> [v2:172.21.15.43:6800/4282580106,v1:172.21.15.43:6801/4282580106] conn(0x7f13d80711e0 0x7f13d8073680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13f9819640 1 --2- 172.21.15.43:0/2107356305 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f13d80678c0 0x7f13d8069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13f406c830 tx=0x7f13e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.022+0000 7f13fa81b640 1 --2- 172.21.15.43:0/2107356305 >> [v2:172.21.15.43:6800/4282580106,v1:172.21.15.43:6801/4282580106] conn(0x7f13d80711e0 0x7f13d8073680 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.026+0000 7f13eaffd640 1 -- 172.21.15.43:0/2107356305 <== osd.0 v2:172.21.15.43:6800/4282580106 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f13ec0b6e50 con 0x7f13d80711e0 2024-04-24T23:08:06.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.038+0000 7f13fc27e640 1 -- 172.21.15.43:0/2107356305 --> [v2:172.21.15.43:6800/4282580106,v1:172.21.15.43:6801/4282580106] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f13f404f580 con 0x7f13d80711e0 2024-04-24T23:08:06.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.038+0000 7f13eaffd640 1 -- 172.21.15.43:0/2107356305 <== osd.0 v2:172.21.15.43:6800/4282580106 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f13f404f580 con 0x7f13d80711e0 2024-04-24T23:08:06.040 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-24T23:08:06.040 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:08:06.040 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-24T23:08:06.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.038+0000 7f13fc27e640 1 -- 172.21.15.43:0/2107356305 >> [v2:172.21.15.43:6800/4282580106,v1:172.21.15.43:6801/4282580106] conn(0x7f13d80711e0 msgr2=0x7f13d8073680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.038+0000 7f13fc27e640 1 --2- 172.21.15.43:0/2107356305 >> [v2:172.21.15.43:6800/4282580106,v1:172.21.15.43:6801/4282580106] conn(0x7f13d80711e0 0x7f13d8073680 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.038+0000 7f13fc27e640 1 -- 172.21.15.43:0/2107356305 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f13d80678c0 msgr2=0x7f13d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.038+0000 7f13fc27e640 1 --2- 172.21.15.43:0/2107356305 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f13d80678c0 0x7f13d8069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13f406c830 tx=0x7f13e4009040 comp rx=0 tx=0).stop 2024-04-24T23:08:06.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.038+0000 7f13fc27e640 1 -- 172.21.15.43:0/2107356305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13f4070eb0 msgr2=0x7f13f40ad9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.038+0000 7f13fc27e640 1 --2- 172.21.15.43:0/2107356305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13f4070eb0 0x7f13f40ad9e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f13ec019540 tx=0x7f13ec0196d0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.038+0000 7f13fa81b640 1 -- 172.21.15.43:0/2107356305 reap_dead start 2024-04-24T23:08:06.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.038+0000 7f13fc27e640 1 -- 172.21.15.43:0/2107356305 shutdown_connections 2024-04-24T23:08:06.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.038+0000 7f13fc27e640 1 -- 172.21.15.43:0/2107356305 >> 172.21.15.43:0/2107356305 conn(0x7f13f406c300 msgr2=0x7f13f4072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:06.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.038+0000 7f13fc27e640 1 -- 172.21.15.43:0/2107356305 shutdown_connections 2024-04-24T23:08:06.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.038+0000 7f13fc27e640 1 -- 172.21.15.43:0/2107356305 wait complete. 2024-04-24T23:08:06.055 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-24T23:08:06.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea1dfb1640 1 Processor -- start 2024-04-24T23:08:06.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea1dfb1640 1 -- start start 2024-04-24T23:08:06.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea1dfb1640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fea1813f890 0x7fea180b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea1dfb1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fea180b5140 0x7fea18072ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea1dfb1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea18148930 0x7fea1806b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea1dfb1640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fea180b7530 con 0x7fea1813f890 2024-04-24T23:08:06.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea1dfb1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fea180b5730 con 0x7fea180b5140 2024-04-24T23:08:06.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea1dfb1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fea180b4bc0 con 0x7fea18148930 2024-04-24T23:08:06.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea177fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fea1813f890 0x7fea180b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea177fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fea1813f890 0x7fea180b61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54754/0 (socket says 172.21.15.43:54754) 2024-04-24T23:08:06.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea177fe640 1 -- 172.21.15.43:0/4174057702 learned_addr learned my addr 172.21.15.43:0/4174057702 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:06.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea0ffff640 1 --2- 172.21.15.43:0/4174057702 >> v2:172.21.15.162:3300/0 conn(0x7fea180b5140 0x7fea18072ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea17fff640 1 --2- 172.21.15.43:0/4174057702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea18148930 0x7fea1806b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea177fe640 1 -- 172.21.15.43:0/4174057702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea18148930 msgr2=0x7fea1806b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:06.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea177fe640 1 --2- 172.21.15.43:0/4174057702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea18148930 0x7fea1806b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea177fe640 1 -- 172.21.15.43:0/4174057702 >> v2:172.21.15.162:3300/0 conn(0x7fea180b5140 msgr2=0x7fea18072ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:06.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea177fe640 1 --2- 172.21.15.43:0/4174057702 >> v2:172.21.15.162:3300/0 conn(0x7fea180b5140 0x7fea18072ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea177fe640 1 -- 172.21.15.43:0/4174057702 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea180b4ea0 con 0x7fea1813f890 2024-04-24T23:08:06.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.162+0000 7fea17fff640 1 --2- 172.21.15.43:0/4174057702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea18148930 0x7fea1806b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:06.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.166+0000 7fea177fe640 1 --2- 172.21.15.43:0/4174057702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea1813f890 0x7fea180b61c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fea1806c230 tx=0x7fea0001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5ffbbd47917d7b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.166+0000 7fea16ffd640 1 -- 172.21.15.43:0/4174057702 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea000b0070 con 0x7fea1813f890 2024-04-24T23:08:06.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.166+0000 7fea16ffd640 1 -- 172.21.15.43:0/4174057702 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea000ab600 con 0x7fea1813f890 2024-04-24T23:08:06.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.166+0000 7fea16ffd640 1 -- 172.21.15.43:0/4174057702 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea000ab9d0 con 0x7fea1813f890 2024-04-24T23:08:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.166+0000 7fea1dfb1640 1 -- 172.21.15.43:0/4174057702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea1813f890 msgr2=0x7fea180b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.166+0000 7fea1dfb1640 1 --2- 172.21.15.43:0/4174057702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea1813f890 0x7fea180b61c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fea1806c230 tx=0x7fea0001c490 comp rx=0 tx=0).stop 2024-04-24T23:08:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.166+0000 7fea1dfb1640 1 -- 172.21.15.43:0/4174057702 shutdown_connections 2024-04-24T23:08:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.166+0000 7fea1dfb1640 1 --2- 172.21.15.43:0/4174057702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea18148930 0x7fea1806b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.166+0000 7fea1dfb1640 1 --2- 172.21.15.43:0/4174057702 >> v2:172.21.15.162:3300/0 conn(0x7fea180b5140 0x7fea18072ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.166+0000 7fea1dfb1640 1 --2- 172.21.15.43:0/4174057702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea1813f890 0x7fea180b61c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.166+0000 7fea1dfb1640 1 -- 172.21.15.43:0/4174057702 >> 172.21.15.43:0/4174057702 conn(0x7fea180b9b50 msgr2=0x7fea180b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.166+0000 7fea1dfb1640 1 -- 172.21.15.43:0/4174057702 shutdown_connections 2024-04-24T23:08:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.166+0000 7fea1dfb1640 1 -- 172.21.15.43:0/4174057702 wait complete. 2024-04-24T23:08:06.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.166+0000 7fea1dfb1640 1 Processor -- start 2024-04-24T23:08:06.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.166+0000 7fea1dfb1640 1 -- start start 2024-04-24T23:08:06.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea1dfb1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea180b5140 0x7fea180b8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea1dfb1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea1813f890 0x7fea180710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea1dfb1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea18148930 0x7fea181420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea1dfb1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fea18151ee0 con 0x7fea18148930 2024-04-24T23:08:06.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea1dfb1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fea18152060 con 0x7fea180b5140 2024-04-24T23:08:06.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea1dfb1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fea181521e0 con 0x7fea1813f890 2024-04-24T23:08:06.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea17fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea18148930 0x7fea181420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea17fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea18148930 0x7fea181420b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54756/0 (socket says 172.21.15.43:54756) 2024-04-24T23:08:06.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea17fff640 1 -- 172.21.15.43:0/3105884461 learned_addr learned my addr 172.21.15.43:0/3105884461 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:06.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea0ffff640 1 --2- 172.21.15.43:0/3105884461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea1813f890 0x7fea180710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea177fe640 1 --2- 172.21.15.43:0/3105884461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea180b5140 0x7fea180b8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea17fff640 1 -- 172.21.15.43:0/3105884461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea1813f890 msgr2=0x7fea180710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea17fff640 1 --2- 172.21.15.43:0/3105884461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea1813f890 0x7fea180710c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea17fff640 1 -- 172.21.15.43:0/3105884461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea180b5140 msgr2=0x7fea180b8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea17fff640 1 --2- 172.21.15.43:0/3105884461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea180b5140 0x7fea180b8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea17fff640 1 -- 172.21.15.43:0/3105884461 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea18145cd0 con 0x7fea18148930 2024-04-24T23:08:06.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea17fff640 1 --2- 172.21.15.43:0/3105884461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea18148930 0x7fea181420b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fea1000cd80 tx=0x7fea1000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea14ff9640 1 -- 172.21.15.43:0/3105884461 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1000f680 con 0x7fea18148930 2024-04-24T23:08:06.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea14ff9640 1 -- 172.21.15.43:0/3105884461 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea1000f840 con 0x7fea18148930 2024-04-24T23:08:06.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea1dfb1640 1 -- 172.21.15.43:0/3105884461 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea18070ba0 con 0x7fea18148930 2024-04-24T23:08:06.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea14ff9640 1 -- 172.21.15.43:0/3105884461 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1000fc30 con 0x7fea18148930 2024-04-24T23:08:06.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea1dfb1640 1 -- 172.21.15.43:0/3105884461 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea1809f210 con 0x7fea18148930 2024-04-24T23:08:06.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea1dfb1640 1 -- 172.21.15.43:0/3105884461 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea18070990 con 0x7fea18148930 2024-04-24T23:08:06.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea14ff9640 1 -- 172.21.15.43:0/3105884461 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fea100213f0 con 0x7fea18148930 2024-04-24T23:08:06.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea14ff9640 1 --2- 172.21.15.43:0/3105884461 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe9f80678c0 0x7fe9f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea14ff9640 1 -- 172.21.15.43:0/3105884461 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fea10086da0 con 0x7fea18148930 2024-04-24T23:08:06.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.170+0000 7fea177fe640 1 --2- 172.21.15.43:0/3105884461 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe9f80678c0 0x7fe9f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.174+0000 7fea177fe640 1 --2- 172.21.15.43:0/3105884461 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe9f80678c0 0x7fe9f8069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fea000ad000 tx=0x7fea000a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.174+0000 7fea14ff9640 1 -- 172.21.15.43:0/3105884461 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fea10014030 con 0x7fea18148930 2024-04-24T23:08:06.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.334+0000 7fea1dfb1640 1 -- 172.21.15.43:0/3105884461 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fea1804f580 con 0x7fe9f80678c0 2024-04-24T23:08:06.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.338+0000 7fea14ff9640 1 -- 172.21.15.43:0/3105884461 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fea1804f580 con 0x7fe9f80678c0 2024-04-24T23:08:06.338 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 0 to deep-scrub 2024-04-24T23:08:06.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.338+0000 7fea1dfb1640 1 -- 172.21.15.43:0/3105884461 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe9f80678c0 msgr2=0x7fe9f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.338+0000 7fea1dfb1640 1 --2- 172.21.15.43:0/3105884461 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe9f80678c0 0x7fe9f8069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fea000ad000 tx=0x7fea000a6000 comp rx=0 tx=0).stop 2024-04-24T23:08:06.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.338+0000 7fea1dfb1640 1 -- 172.21.15.43:0/3105884461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea18148930 msgr2=0x7fea181420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.338+0000 7fea1dfb1640 1 --2- 172.21.15.43:0/3105884461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea18148930 0x7fea181420b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fea1000cd80 tx=0x7fea1000a650 comp rx=0 tx=0).stop 2024-04-24T23:08:06.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.338+0000 7fea1dfb1640 1 -- 172.21.15.43:0/3105884461 shutdown_connections 2024-04-24T23:08:06.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.338+0000 7fea1dfb1640 1 --2- 172.21.15.43:0/3105884461 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe9f80678c0 0x7fe9f8069d80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.338+0000 7fea1dfb1640 1 --2- 172.21.15.43:0/3105884461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea18148930 0x7fea181420b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.338+0000 7fea1dfb1640 1 --2- 172.21.15.43:0/3105884461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea1813f890 0x7fea180710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.338+0000 7fea1dfb1640 1 --2- 172.21.15.43:0/3105884461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea180b5140 0x7fea180b8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.338+0000 7fea1dfb1640 1 -- 172.21.15.43:0/3105884461 >> 172.21.15.43:0/3105884461 conn(0x7fea180b9b50 msgr2=0x7fea1806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:06.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.338+0000 7fea1dfb1640 1 -- 172.21.15.43:0/3105884461 shutdown_connections 2024-04-24T23:08:06.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.338+0000 7fea1dfb1640 1 -- 172.21.15.43:0/3105884461 wait complete. 2024-04-24T23:08:06.356 INFO:tasks.ceph:Scrubbing osd.1 2024-04-24T23:08:06.357 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:08:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad1a77f640 1 Processor -- start 2024-04-24T23:08:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad1a77f640 1 -- start start 2024-04-24T23:08:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad1a77f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad14141bd0 0x7fad14152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad1a77f640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad140b5ab0 con 0x7fad14072c30 2024-04-24T23:08:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad1a77f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad14071110 con 0x7fad14070d30 2024-04-24T23:08:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad1a77f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fad140b4fd0 con 0x7fad14141bd0 2024-04-24T23:08:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad137fe640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fad14072c30 0x7fad141414c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33860/0 (socket says 172.21.15.43:33860) 2024-04-24T23:08:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad137fe640 1 -- 172.21.15.43:0/3824949969 learned_addr learned my addr 172.21.15.43:0/3824949969 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad18d1c640 1 --2- 172.21.15.43:0/3824949969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad14141bd0 0x7fad14152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad12ffd640 1 -- 172.21.15.43:0/3824949969 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186374287 0 0) 0x7fad04001120 con 0x7fad14072c30 2024-04-24T23:08:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad12ffd640 1 -- 172.21.15.43:0/3824949969 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facfc003530 con 0x7fad14072c30 2024-04-24T23:08:06.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad12ffd640 1 -- 172.21.15.43:0/3824949969 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3002195059 0 0) 0x7facfc003530 con 0x7fad14072c30 2024-04-24T23:08:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad12ffd640 1 -- 172.21.15.43:0/3824949969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad14141bd0 msgr2=0x7fad14152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad12ffd640 1 --2- 172.21.15.43:0/3824949969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad14141bd0 0x7fad14152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad12ffd640 1 -- 172.21.15.43:0/3824949969 >> v1:172.21.15.162:6789/0 conn(0x7fad14070d30 legacy=0x7fad140b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad12ffd640 1 -- 172.21.15.43:0/3824949969 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad140b52b0 con 0x7fad14072c30 2024-04-24T23:08:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad12ffd640 1 -- 172.21.15.43:0/3824949969 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7fad04001850 con 0x7fad14072c30 2024-04-24T23:08:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad12ffd640 1 -- 172.21.15.43:0/3824949969 >> v1:172.21.15.43:6789/0 conn(0x7fad14072c30 legacy=0x7fad141414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad12ffd640 1 --2- 172.21.15.43:0/3824949969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facfc0039f0 0x7facfc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad12ffd640 1 --2- 172.21.15.43:0/3824949969 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7facfc004810 0x7facfc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad12ffd640 1 --2- 172.21.15.43:0/3824949969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad14141bd0 0x7facfc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad12ffd640 1 -- 172.21.15.43:0/3824949969 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fad140b4fd0 con 0x7facfc004810 2024-04-24T23:08:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad12ffd640 1 -- 172.21.15.43:0/3824949969 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7facfc00bab0 con 0x7facfc0039f0 2024-04-24T23:08:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad12ffd640 1 -- 172.21.15.43:0/3824949969 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7facfc00bcb0 con 0x7fad14141bd0 2024-04-24T23:08:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad137fe640 1 --2- 172.21.15.43:0/3824949969 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7facfc004810 0x7facfc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad13fff640 1 --2- 172.21.15.43:0/3824949969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facfc0039f0 0x7facfc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad18d1c640 1 --2- 172.21.15.43:0/3824949969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad14141bd0 0x7facfc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad137fe640 1 -- 172.21.15.43:0/3824949969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad14141bd0 msgr2=0x7facfc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad137fe640 1 --2- 172.21.15.43:0/3824949969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad14141bd0 0x7facfc0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad137fe640 1 -- 172.21.15.43:0/3824949969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facfc0039f0 msgr2=0x7facfc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad137fe640 1 --2- 172.21.15.43:0/3824949969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facfc0039f0 0x7facfc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.474+0000 7fad137fe640 1 -- 172.21.15.43:0/3824949969 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc003530 con 0x7facfc004810 2024-04-24T23:08:06.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad137fe640 1 --2- 172.21.15.43:0/3824949969 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7facfc004810 0x7facfc004c90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fad0400c490 tx=0x7fad0401f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f2b8b982b10bbb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad12ffd640 1 -- 172.21.15.43:0/3824949969 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0400c0e0 con 0x7facfc004810 2024-04-24T23:08:06.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad12ffd640 1 -- 172.21.15.43:0/3824949969 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad04005b00 con 0x7facfc004810 2024-04-24T23:08:06.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad12ffd640 1 -- 172.21.15.43:0/3824949969 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04007070 con 0x7facfc004810 2024-04-24T23:08:06.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad1a77f640 1 -- 172.21.15.43:0/3824949969 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7facfc004810 msgr2=0x7facfc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad1a77f640 1 --2- 172.21.15.43:0/3824949969 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7facfc004810 0x7facfc004c90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fad0400c490 tx=0x7fad0401f370 comp rx=0 tx=0).stop 2024-04-24T23:08:06.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad18d1c640 1 -- 172.21.15.43:0/3824949969 reap_dead start 2024-04-24T23:08:06.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad1a77f640 1 -- 172.21.15.43:0/3824949969 shutdown_connections 2024-04-24T23:08:06.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad1a77f640 1 -- 172.21.15.43:0/3824949969 >> 172.21.15.43:0/3824949969 conn(0x7fad1406c300 msgr2=0x7fad1406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:06.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad1a77f640 1 -- 172.21.15.43:0/3824949969 shutdown_connections 2024-04-24T23:08:06.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad1a77f640 1 -- 172.21.15.43:0/3824949969 wait complete. 2024-04-24T23:08:06.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad1a77f640 1 Processor -- start 2024-04-24T23:08:06.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad1a77f640 1 -- start start 2024-04-24T23:08:06.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad1a77f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad14148a60 0x7fad141e0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad1a77f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad141dd0d0 0x7fad141e0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad1a77f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad14149860 0x7fad141e10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad1a77f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fad140b67a0 con 0x7fad14149860 2024-04-24T23:08:06.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad1a77f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fad140730a0 con 0x7fad141dd0d0 2024-04-24T23:08:06.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad1a77f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fad141de0b0 con 0x7fad14148a60 2024-04-24T23:08:06.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad18d1c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad14149860 0x7fad141e10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad18d1c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad14149860 0x7fad141e10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54774/0 (socket says 172.21.15.43:54774) 2024-04-24T23:08:06.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad18d1c640 1 -- 172.21.15.43:0/499040281 learned_addr learned my addr 172.21.15.43:0/499040281 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:06.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad137fe640 1 --2- 172.21.15.43:0/499040281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad141dd0d0 0x7fad141e0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad18d1c640 1 -- 172.21.15.43:0/499040281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad14148a60 msgr2=0x7fad141e0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad18d1c640 1 --2- 172.21.15.43:0/499040281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad14148a60 0x7fad141e0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad18d1c640 1 -- 172.21.15.43:0/499040281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad141dd0d0 msgr2=0x7fad141e0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad18d1c640 1 --2- 172.21.15.43:0/499040281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad141dd0d0 0x7fad141e0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad18d1c640 1 -- 172.21.15.43:0/499040281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad14148e40 con 0x7fad14149860 2024-04-24T23:08:06.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad18d1c640 1 --2- 172.21.15.43:0/499040281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad14149860 0x7fad141e10c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fad14141fe0 tx=0x7fad0c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad10ff9640 1 -- 172.21.15.43:0/499040281 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c01c070 con 0x7fad14149860 2024-04-24T23:08:06.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.478+0000 7fad10ff9640 1 -- 172.21.15.43:0/499040281 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0c017400 con 0x7fad14149860 2024-04-24T23:08:06.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.482+0000 7fad1a77f640 1 -- 172.21.15.43:0/499040281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad14149d90 con 0x7fad14149860 2024-04-24T23:08:06.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.482+0000 7fad10ff9640 1 -- 172.21.15.43:0/499040281 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c0177f0 con 0x7fad14149860 2024-04-24T23:08:06.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.482+0000 7fad1a77f640 1 -- 172.21.15.43:0/499040281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad141dd8b0 con 0x7fad14149860 2024-04-24T23:08:06.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.482+0000 7fad1a77f640 1 -- 172.21.15.43:0/499040281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad1404f580 con 0x7fad14149860 2024-04-24T23:08:06.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.482+0000 7fad10ff9640 1 -- 172.21.15.43:0/499040281 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fad0c01f070 con 0x7fad14149860 2024-04-24T23:08:06.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.482+0000 7fad10ff9640 1 --2- 172.21.15.43:0/499040281 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fad000678f0 0x7fad00069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.482+0000 7fad10ff9640 1 -- 172.21.15.43:0/499040281 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fad0c0863b0 con 0x7fad14149860 2024-04-24T23:08:06.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.482+0000 7fad13fff640 1 --2- 172.21.15.43:0/499040281 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fad000678f0 0x7fad00069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.482+0000 7fad10ff9640 1 --2- 172.21.15.43:0/499040281 >> [v2:172.21.15.43:6808/3690422661,v1:172.21.15.43:6809/3690422661] conn(0x7fad00071200 0x7fad000736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.482+0000 7fad10ff9640 1 -- 172.21.15.43:0/499040281 --> [v2:172.21.15.43:6808/3690422661,v1:172.21.15.43:6809/3690422661] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad00073d70 con 0x7fad00071200 2024-04-24T23:08:06.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.482+0000 7fad10ff9640 1 -- 172.21.15.43:0/499040281 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fad0c086840 con 0x7fad14149860 2024-04-24T23:08:06.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.482+0000 7fad137fe640 1 --2- 172.21.15.43:0/499040281 >> [v2:172.21.15.43:6808/3690422661,v1:172.21.15.43:6809/3690422661] conn(0x7fad00071200 0x7fad000736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.482+0000 7fad13fff640 1 --2- 172.21.15.43:0/499040281 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fad000678f0 0x7fad00069db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad08001060 tx=0x7fad08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.482+0000 7fad137fe640 1 --2- 172.21.15.43:0/499040281 >> [v2:172.21.15.43:6808/3690422661,v1:172.21.15.43:6809/3690422661] conn(0x7fad00071200 0x7fad000736a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.482+0000 7fad10ff9640 1 -- 172.21.15.43:0/499040281 <== osd.1 v2:172.21.15.43:6808/3690422661 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad00073d70 con 0x7fad00071200 2024-04-24T23:08:06.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.498+0000 7fad1a77f640 1 -- 172.21.15.43:0/499040281 --> [v2:172.21.15.43:6808/3690422661,v1:172.21.15.43:6809/3690422661] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fad140ba1a0 con 0x7fad00071200 2024-04-24T23:08:06.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.498+0000 7fad10ff9640 1 -- 172.21.15.43:0/499040281 <== osd.1 v2:172.21.15.43:6808/3690422661 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fad140ba1a0 con 0x7fad00071200 2024-04-24T23:08:06.499 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-24T23:08:06.499 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:08:06.499 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-24T23:08:06.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.498+0000 7fad1a77f640 1 -- 172.21.15.43:0/499040281 >> [v2:172.21.15.43:6808/3690422661,v1:172.21.15.43:6809/3690422661] conn(0x7fad00071200 msgr2=0x7fad000736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.498+0000 7fad1a77f640 1 --2- 172.21.15.43:0/499040281 >> [v2:172.21.15.43:6808/3690422661,v1:172.21.15.43:6809/3690422661] conn(0x7fad00071200 0x7fad000736a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.498+0000 7fad1a77f640 1 -- 172.21.15.43:0/499040281 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fad000678f0 msgr2=0x7fad00069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.498+0000 7fad1a77f640 1 --2- 172.21.15.43:0/499040281 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fad000678f0 0x7fad00069db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad08001060 tx=0x7fad08009040 comp rx=0 tx=0).stop 2024-04-24T23:08:06.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.498+0000 7fad1a77f640 1 -- 172.21.15.43:0/499040281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad14149860 msgr2=0x7fad141e10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.498+0000 7fad1a77f640 1 --2- 172.21.15.43:0/499040281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad14149860 0x7fad141e10c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fad14141fe0 tx=0x7fad0c00f4a0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.498+0000 7fad18d1c640 1 -- 172.21.15.43:0/499040281 reap_dead start 2024-04-24T23:08:06.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.498+0000 7fad1a77f640 1 -- 172.21.15.43:0/499040281 shutdown_connections 2024-04-24T23:08:06.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.498+0000 7fad1a77f640 1 -- 172.21.15.43:0/499040281 >> 172.21.15.43:0/499040281 conn(0x7fad1406c300 msgr2=0x7fad1413f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:06.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.498+0000 7fad1a77f640 1 -- 172.21.15.43:0/499040281 shutdown_connections 2024-04-24T23:08:06.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.498+0000 7fad1a77f640 1 -- 172.21.15.43:0/499040281 wait complete. 2024-04-24T23:08:06.515 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-24T23:08:06.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.622+0000 7f6399ba8640 1 Processor -- start 2024-04-24T23:08:06.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.622+0000 7f6399ba8640 1 -- start start 2024-04-24T23:08:06.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.622+0000 7f6399ba8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6394073080 0x7f6394145540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.622+0000 7f6399ba8640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6394145a80 0x7f639414fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.622+0000 7f6399ba8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63940705f0 con 0x7f639406f430 2024-04-24T23:08:06.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.622+0000 7f6399ba8640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f63940b68b0 con 0x7f6394145a80 2024-04-24T23:08:06.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.622+0000 7f6399ba8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f63940b6b00 con 0x7f6394073080 2024-04-24T23:08:06.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.622+0000 7f6393fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6394145a80 0x7f639414fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.622+0000 7f6393fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6394145a80 0x7f639414fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54780/0 (socket says 172.21.15.43:54780) 2024-04-24T23:08:06.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.622+0000 7f6393fff640 1 -- 172.21.15.43:0/2848325587 learned_addr learned my addr 172.21.15.43:0/2848325587 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:06.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.622+0000 7f6392ffd640 1 --2- 172.21.15.43:0/2848325587 >> v2:172.21.15.162:3300/0 conn(0x7f6394073080 0x7f6394145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.622+0000 7f6393fff640 1 -- 172.21.15.43:0/2848325587 >> v2:172.21.15.162:3300/0 conn(0x7f6394073080 msgr2=0x7f6394145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:06.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.622+0000 7f6393fff640 1 --2- 172.21.15.43:0/2848325587 >> v2:172.21.15.162:3300/0 conn(0x7f6394073080 0x7f6394145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.622+0000 7f6393fff640 1 -- 172.21.15.43:0/2848325587 >> v1:172.21.15.162:6789/0 conn(0x7f639406f430 legacy=0x7f63940b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:06.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.622+0000 7f6393fff640 1 -- 172.21.15.43:0/2848325587 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63940b6de0 con 0x7f6394145a80 2024-04-24T23:08:06.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6393fff640 1 --2- 172.21.15.43:0/2848325587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6394145a80 0x7f639414fcd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6394074da0 tx=0x7f638c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f08e6b866c817b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f63927fc640 1 -- 172.21.15.43:0/2848325587 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c0a5770 con 0x7f6394145a80 2024-04-24T23:08:06.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f63927fc640 1 -- 172.21.15.43:0/2848325587 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f638c0a5910 con 0x7f6394145a80 2024-04-24T23:08:06.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f63927fc640 1 -- 172.21.15.43:0/2848325587 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c0a5ce0 con 0x7f6394145a80 2024-04-24T23:08:06.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 -- 172.21.15.43:0/2848325587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6394145a80 msgr2=0x7f639414fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 --2- 172.21.15.43:0/2848325587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6394145a80 0x7f639414fcd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6394074da0 tx=0x7f638c01c850 comp rx=0 tx=0).stop 2024-04-24T23:08:06.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 -- 172.21.15.43:0/2848325587 shutdown_connections 2024-04-24T23:08:06.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 --2- 172.21.15.43:0/2848325587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6394145a80 0x7f639414fcd0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 --2- 172.21.15.43:0/2848325587 >> v2:172.21.15.162:3300/0 conn(0x7f6394073080 0x7f6394145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 -- 172.21.15.43:0/2848325587 >> 172.21.15.43:0/2848325587 conn(0x7f63940b7880 msgr2=0x7f63940b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:06.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 -- 172.21.15.43:0/2848325587 shutdown_connections 2024-04-24T23:08:06.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 -- 172.21.15.43:0/2848325587 wait complete. 2024-04-24T23:08:06.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 Processor -- start 2024-04-24T23:08:06.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 -- start start 2024-04-24T23:08:06.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639406f430 0x7f639413dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6394073080 0x7f63941dfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6394145a80 0x7f63941e01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f63940b7390 con 0x7f639406f430 2024-04-24T23:08:06.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f63940b7210 con 0x7f6394145a80 2024-04-24T23:08:06.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f63940701c0 con 0x7f6394073080 2024-04-24T23:08:06.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f63937fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639406f430 0x7f639413dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f63937fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639406f430 0x7f639413dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54786/0 (socket says 172.21.15.43:54786) 2024-04-24T23:08:06.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f63937fe640 1 -- 172.21.15.43:0/2514382909 learned_addr learned my addr 172.21.15.43:0/2514382909 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:06.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6392ffd640 1 --2- 172.21.15.43:0/2514382909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6394073080 0x7f63941dfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6393fff640 1 --2- 172.21.15.43:0/2514382909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6394145a80 0x7f63941e01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f63937fe640 1 -- 172.21.15.43:0/2514382909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6394073080 msgr2=0x7f63941dfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f63937fe640 1 --2- 172.21.15.43:0/2514382909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6394073080 0x7f63941dfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f63937fe640 1 -- 172.21.15.43:0/2514382909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6394145a80 msgr2=0x7f63941e01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f63937fe640 1 --2- 172.21.15.43:0/2514382909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6394145a80 0x7f63941e01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f63937fe640 1 -- 172.21.15.43:0/2514382909 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639413f3c0 con 0x7f639406f430 2024-04-24T23:08:06.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6392ffd640 1 --2- 172.21.15.43:0/2514382909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6394073080 0x7f63941dfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:06.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f63937fe640 1 --2- 172.21.15.43:0/2514382909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639406f430 0x7f639413dca0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f638800c480 tx=0x7f638800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f637bfff640 1 -- 172.21.15.43:0/2514382909 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388012830 con 0x7f639406f430 2024-04-24T23:08:06.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f637bfff640 1 -- 172.21.15.43:0/2514382909 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6388017070 con 0x7f639406f430 2024-04-24T23:08:06.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f6399ba8640 1 -- 172.21.15.43:0/2514382909 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639414f8f0 con 0x7f639406f430 2024-04-24T23:08:06.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.626+0000 7f637bfff640 1 -- 172.21.15.43:0/2514382909 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388012c30 con 0x7f639406f430 2024-04-24T23:08:06.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.630+0000 7f6399ba8640 1 -- 172.21.15.43:0/2514382909 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f639413ebc0 con 0x7f639406f430 2024-04-24T23:08:06.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.630+0000 7f6399ba8640 1 -- 172.21.15.43:0/2514382909 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f639404f580 con 0x7f639406f430 2024-04-24T23:08:06.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.630+0000 7f637bfff640 1 -- 172.21.15.43:0/2514382909 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f638801c460 con 0x7f639406f430 2024-04-24T23:08:06.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.630+0000 7f637bfff640 1 --2- 172.21.15.43:0/2514382909 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f63800678c0 0x7f6380069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.630+0000 7f637bfff640 1 -- 172.21.15.43:0/2514382909 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f6388085ed0 con 0x7f639406f430 2024-04-24T23:08:06.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.630+0000 7f6392ffd640 1 --2- 172.21.15.43:0/2514382909 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f63800678c0 0x7f6380069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.630+0000 7f6392ffd640 1 --2- 172.21.15.43:0/2514382909 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f63800678c0 0x7f6380069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6394138480 tx=0x7f6384008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.634+0000 7f637bfff640 1 -- 172.21.15.43:0/2514382909 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f6388056630 con 0x7f639406f430 2024-04-24T23:08:06.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.806+0000 7f6399ba8640 1 -- 172.21.15.43:0/2514382909 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f63940b0370 con 0x7f63800678c0 2024-04-24T23:08:06.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.810+0000 7f637bfff640 1 -- 172.21.15.43:0/2514382909 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f63940b0370 con 0x7f63800678c0 2024-04-24T23:08:06.811 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 1 to deep-scrub 2024-04-24T23:08:06.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.810+0000 7f6399ba8640 1 -- 172.21.15.43:0/2514382909 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f63800678c0 msgr2=0x7f6380069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.810+0000 7f6399ba8640 1 --2- 172.21.15.43:0/2514382909 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f63800678c0 0x7f6380069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6394138480 tx=0x7f6384008040 comp rx=0 tx=0).stop 2024-04-24T23:08:06.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.810+0000 7f6399ba8640 1 -- 172.21.15.43:0/2514382909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639406f430 msgr2=0x7f639413dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.810+0000 7f6399ba8640 1 --2- 172.21.15.43:0/2514382909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639406f430 0x7f639413dca0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f638800c480 tx=0x7f638800c940 comp rx=0 tx=0).stop 2024-04-24T23:08:06.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.810+0000 7f6399ba8640 1 -- 172.21.15.43:0/2514382909 shutdown_connections 2024-04-24T23:08:06.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.810+0000 7f6399ba8640 1 --2- 172.21.15.43:0/2514382909 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f63800678c0 0x7f6380069d80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.810+0000 7f6399ba8640 1 --2- 172.21.15.43:0/2514382909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6394145a80 0x7f63941e01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.810+0000 7f6399ba8640 1 --2- 172.21.15.43:0/2514382909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6394073080 0x7f63941dfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.810+0000 7f6399ba8640 1 --2- 172.21.15.43:0/2514382909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639406f430 0x7f639413dca0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.810+0000 7f6399ba8640 1 -- 172.21.15.43:0/2514382909 >> 172.21.15.43:0/2514382909 conn(0x7f63940b7880 msgr2=0x7f63940ba410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:06.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.810+0000 7f6399ba8640 1 -- 172.21.15.43:0/2514382909 shutdown_connections 2024-04-24T23:08:06.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.810+0000 7f6399ba8640 1 -- 172.21.15.43:0/2514382909 wait complete. 2024-04-24T23:08:06.829 INFO:tasks.ceph:Scrubbing osd.2 2024-04-24T23:08:06.829 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:08:06.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c708f7640 1 Processor -- start 2024-04-24T23:08:06.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c708f7640 1 -- start start 2024-04-24T23:08:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c708f7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4c6c145c50 0x7f4c6c150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c708f7640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c6c0705f0 con 0x7f4c6c073080 2024-04-24T23:08:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c708f7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c6c0b6b00 con 0x7f4c6c06f430 2024-04-24T23:08:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c708f7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4c6c0b68b0 con 0x7f4c6c145c50 2024-04-24T23:08:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c69d9b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4c6c073080 0x7f4c6c145540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33874/0 (socket says 172.21.15.43:33874) 2024-04-24T23:08:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c69d9b640 1 -- 172.21.15.43:0/615559492 learned_addr learned my addr 172.21.15.43:0/615559492 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6ad9d640 1 --2- 172.21.15.43:0/615559492 >> v2:172.21.15.162:3300/0 conn(0x7f4c6c145c50 0x7f4c6c150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6959a640 1 -- 172.21.15.43:0/615559492 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508328963 0 0) 0x7f4c6c0705f0 con 0x7f4c6c073080 2024-04-24T23:08:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6959a640 1 -- 172.21.15.43:0/615559492 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c54003530 con 0x7f4c6c073080 2024-04-24T23:08:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6959a640 1 -- 172.21.15.43:0/615559492 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 670312882 0 0) 0x7f4c54003530 con 0x7f4c6c073080 2024-04-24T23:08:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6959a640 1 -- 172.21.15.43:0/615559492 >> v2:172.21.15.162:3300/0 conn(0x7f4c6c145c50 msgr2=0x7f4c6c150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6959a640 1 --2- 172.21.15.43:0/615559492 >> v2:172.21.15.162:3300/0 conn(0x7f4c6c145c50 0x7f4c6c150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6959a640 1 -- 172.21.15.43:0/615559492 >> v1:172.21.15.162:6789/0 conn(0x7f4c6c06f430 legacy=0x7f4c6c0b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6959a640 1 -- 172.21.15.43:0/615559492 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6c0b6de0 con 0x7f4c6c073080 2024-04-24T23:08:06.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6959a640 1 -- 172.21.15.43:0/615559492 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f4c60001680 con 0x7f4c6c073080 2024-04-24T23:08:06.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6959a640 1 -- 172.21.15.43:0/615559492 >> v1:172.21.15.43:6789/0 conn(0x7f4c6c073080 legacy=0x7f4c6c145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6959a640 1 --2- 172.21.15.43:0/615559492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c540039c0 0x7f4c54003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6959a640 1 --2- 172.21.15.43:0/615559492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c54004810 0x7f4c54004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6959a640 1 --2- 172.21.15.43:0/615559492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c540052f0 0x7f4c5400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6959a640 1 -- 172.21.15.43:0/615559492 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c0b68b0 con 0x7f4c54004810 2024-04-24T23:08:06.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6959a640 1 -- 172.21.15.43:0/615559492 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5400c1c0 con 0x7f4c540039c0 2024-04-24T23:08:06.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.962+0000 7f4c6959a640 1 -- 172.21.15.43:0/615559492 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5400c3c0 con 0x7f4c540052f0 2024-04-24T23:08:06.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c69d9b640 1 --2- 172.21.15.43:0/615559492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c54004810 0x7f4c54004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c6a59c640 1 --2- 172.21.15.43:0/615559492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c540039c0 0x7f4c54003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c6ad9d640 1 --2- 172.21.15.43:0/615559492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c540052f0 0x7f4c5400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c69d9b640 1 -- 172.21.15.43:0/615559492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c540052f0 msgr2=0x7f4c5400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:06.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c69d9b640 1 --2- 172.21.15.43:0/615559492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c540052f0 0x7f4c5400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c69d9b640 1 -- 172.21.15.43:0/615559492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c540039c0 msgr2=0x7f4c54003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:06.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c69d9b640 1 --2- 172.21.15.43:0/615559492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c540039c0 0x7f4c54003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c69d9b640 1 -- 172.21.15.43:0/615559492 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c54003530 con 0x7f4c54004810 2024-04-24T23:08:06.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c6ad9d640 1 -- 172.21.15.43:0/615559492 reap_dead start 2024-04-24T23:08:06.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c69d9b640 1 --2- 172.21.15.43:0/615559492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c54004810 0x7f4c54004c90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c073480 tx=0x7f4c6001cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65131321fa88cd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c6959a640 1 -- 172.21.15.43:0/615559492 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c60007d00 con 0x7f4c54004810 2024-04-24T23:08:06.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c6959a640 1 -- 172.21.15.43:0/615559492 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c600a9020 con 0x7f4c54004810 2024-04-24T23:08:06.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c6959a640 1 -- 172.21.15.43:0/615559492 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c0b1fe0 con 0x7f4c54004810 2024-04-24T23:08:06.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c708f7640 1 -- 172.21.15.43:0/615559492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c54004810 msgr2=0x7f4c54004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c708f7640 1 --2- 172.21.15.43:0/615559492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c54004810 0x7f4c54004c90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c073480 tx=0x7f4c6001cad0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c708f7640 1 -- 172.21.15.43:0/615559492 shutdown_connections 2024-04-24T23:08:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c708f7640 1 --2- 172.21.15.43:0/615559492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c54004810 0x7f4c54004c90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c708f7640 1 -- 172.21.15.43:0/615559492 >> 172.21.15.43:0/615559492 conn(0x7f4c6c0b7880 msgr2=0x7f4c6c0b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c708f7640 1 -- 172.21.15.43:0/615559492 shutdown_connections 2024-04-24T23:08:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.966+0000 7f4c708f7640 1 -- 172.21.15.43:0/615559492 wait complete. 2024-04-24T23:08:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c708f7640 1 Processor -- start 2024-04-24T23:08:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c708f7640 1 -- start start 2024-04-24T23:08:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c708f7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c54004810 0x7f4c6c142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c708f7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c6c140880 0x7f4c6c142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c708f7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c6c1ddb90 0x7f4c6c0b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c708f7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c070340 con 0x7f4c6c1ddb90 2024-04-24T23:08:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c708f7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c0701c0 con 0x7f4c6c140880 2024-04-24T23:08:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c708f7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4c6c0b5780 con 0x7f4c54004810 2024-04-24T23:08:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c6ad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c6c1ddb90 0x7f4c6c0b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c6ad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c6c1ddb90 0x7f4c6c0b3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54804/0 (socket says 172.21.15.43:54804) 2024-04-24T23:08:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c6ad9d640 1 -- 172.21.15.43:0/2085662823 learned_addr learned my addr 172.21.15.43:0/2085662823 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c69d9b640 1 --2- 172.21.15.43:0/2085662823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c6c140880 0x7f4c6c142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c6a59c640 1 --2- 172.21.15.43:0/2085662823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c54004810 0x7f4c6c142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c6ad9d640 1 -- 172.21.15.43:0/2085662823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c54004810 msgr2=0x7f4c6c142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c6ad9d640 1 --2- 172.21.15.43:0/2085662823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c54004810 0x7f4c6c142060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c6ad9d640 1 -- 172.21.15.43:0/2085662823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c6c140880 msgr2=0x7f4c6c142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c6ad9d640 1 --2- 172.21.15.43:0/2085662823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c6c140880 0x7f4c6c142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c6ad9d640 1 -- 172.21.15.43:0/2085662823 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6c0b2160 con 0x7f4c6c1ddb90 2024-04-24T23:08:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c6ad9d640 1 --2- 172.21.15.43:0/2085662823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c6c1ddb90 0x7f4c6c0b3970 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c073ee0 tx=0x7f4c6400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c5affd640 1 -- 172.21.15.43:0/2085662823 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64016620 con 0x7f4c6c1ddb90 2024-04-24T23:08:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c5affd640 1 -- 172.21.15.43:0/2085662823 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6401b070 con 0x7f4c6c1ddb90 2024-04-24T23:08:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c5affd640 1 -- 172.21.15.43:0/2085662823 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64016a20 con 0x7f4c6c1ddb90 2024-04-24T23:08:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c708f7640 1 -- 172.21.15.43:0/2085662823 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6c149630 con 0x7f4c6c1ddb90 2024-04-24T23:08:06.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c708f7640 1 -- 172.21.15.43:0/2085662823 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c6c0b4d20 con 0x7f4c6c1ddb90 2024-04-24T23:08:06.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c708f7640 1 -- 172.21.15.43:0/2085662823 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4c6c04f580 con 0x7f4c6c1ddb90 2024-04-24T23:08:06.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c5affd640 1 -- 172.21.15.43:0/2085662823 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4c64016bc0 con 0x7f4c6c1ddb90 2024-04-24T23:08:06.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c5affd640 1 --2- 172.21.15.43:0/2085662823 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4c4c0678c0 0x7f4c4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c5affd640 1 -- 172.21.15.43:0/2085662823 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f4c640877d0 con 0x7f4c6c1ddb90 2024-04-24T23:08:06.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c6a59c640 1 --2- 172.21.15.43:0/2085662823 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4c4c0678c0 0x7f4c4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c5affd640 1 --2- 172.21.15.43:0/2085662823 >> [v2:172.21.15.43:6816/1769132304,v1:172.21.15.43:6817/1769132304] conn(0x7f4c4c0711d0 0x7f4c4c073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:06.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c5affd640 1 -- 172.21.15.43:0/2085662823 --> [v2:172.21.15.43:6816/1769132304,v1:172.21.15.43:6817/1769132304] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c64009200 con 0x7f4c4c0711d0 2024-04-24T23:08:06.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c5affd640 1 -- 172.21.15.43:0/2085662823 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4c64087b80 con 0x7f4c6c1ddb90 2024-04-24T23:08:06.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c69d9b640 1 --2- 172.21.15.43:0/2085662823 >> [v2:172.21.15.43:6816/1769132304,v1:172.21.15.43:6817/1769132304] conn(0x7f4c4c0711d0 0x7f4c4c073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:06.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.970+0000 7f4c6a59c640 1 --2- 172.21.15.43:0/2085662823 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4c4c0678c0 0x7f4c4c069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c005490 tx=0x7f4c5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.974+0000 7f4c69d9b640 1 --2- 172.21.15.43:0/2085662823 >> [v2:172.21.15.43:6816/1769132304,v1:172.21.15.43:6817/1769132304] conn(0x7f4c4c0711d0 0x7f4c4c073670 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:06.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.974+0000 7f4c5affd640 1 -- 172.21.15.43:0/2085662823 <== osd.2 v2:172.21.15.43:6816/1769132304 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c64009200 con 0x7f4c4c0711d0 2024-04-24T23:08:06.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.986+0000 7f4c708f7640 1 -- 172.21.15.43:0/2085662823 --> [v2:172.21.15.43:6816/1769132304,v1:172.21.15.43:6817/1769132304] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4c6c1de020 con 0x7f4c4c0711d0 2024-04-24T23:08:06.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.986+0000 7f4c5affd640 1 -- 172.21.15.43:0/2085662823 <== osd.2 v2:172.21.15.43:6816/1769132304 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4c6c1de020 con 0x7f4c4c0711d0 2024-04-24T23:08:06.988 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-24T23:08:06.988 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:08:06.988 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-24T23:08:06.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.986+0000 7f4c708f7640 1 -- 172.21.15.43:0/2085662823 >> [v2:172.21.15.43:6816/1769132304,v1:172.21.15.43:6817/1769132304] conn(0x7f4c4c0711d0 msgr2=0x7f4c4c073670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.986+0000 7f4c708f7640 1 --2- 172.21.15.43:0/2085662823 >> [v2:172.21.15.43:6816/1769132304,v1:172.21.15.43:6817/1769132304] conn(0x7f4c4c0711d0 0x7f4c4c073670 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:06.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.986+0000 7f4c708f7640 1 -- 172.21.15.43:0/2085662823 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4c4c0678c0 msgr2=0x7f4c4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.986+0000 7f4c708f7640 1 --2- 172.21.15.43:0/2085662823 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f4c4c0678c0 0x7f4c4c069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c005490 tx=0x7f4c5c009040 comp rx=0 tx=0).stop 2024-04-24T23:08:06.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.986+0000 7f4c708f7640 1 -- 172.21.15.43:0/2085662823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c6c1ddb90 msgr2=0x7f4c6c0b3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:06.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.986+0000 7f4c708f7640 1 --2- 172.21.15.43:0/2085662823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c6c1ddb90 0x7f4c6c0b3970 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c073ee0 tx=0x7f4c6400f520 comp rx=0 tx=0).stop 2024-04-24T23:08:06.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.986+0000 7f4c6ad9d640 1 -- 172.21.15.43:0/2085662823 reap_dead start 2024-04-24T23:08:06.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.986+0000 7f4c708f7640 1 -- 172.21.15.43:0/2085662823 shutdown_connections 2024-04-24T23:08:06.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.986+0000 7f4c708f7640 1 -- 172.21.15.43:0/2085662823 >> 172.21.15.43:0/2085662823 conn(0x7f4c6c0b7880 msgr2=0x7f4c6c0b9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:06.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.986+0000 7f4c708f7640 1 -- 172.21.15.43:0/2085662823 shutdown_connections 2024-04-24T23:08:06.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:06.986+0000 7f4c708f7640 1 -- 172.21.15.43:0/2085662823 wait complete. 2024-04-24T23:08:07.003 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-24T23:08:07.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1cf165640 1 Processor -- start 2024-04-24T23:08:07.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1cf165640 1 -- start start 2024-04-24T23:08:07.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1cf165640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1c806be60 0x7fe1c80b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1cf165640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1c80b5720 con 0x7fe1c8145c10 2024-04-24T23:08:07.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1cf165640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1c8073320 con 0x7fe1c8072f40 2024-04-24T23:08:07.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1cf165640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c80b61c0 con 0x7fe1c806be60 2024-04-24T23:08:07.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1cd702640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe1c8145c10 0x7fe1c814fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33890/0 (socket says 172.21.15.43:33890) 2024-04-24T23:08:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1cd702640 1 -- 172.21.15.43:0/1862773878 learned_addr learned my addr 172.21.15.43:0/1862773878 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c7fff640 1 --2- 172.21.15.43:0/1862773878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1c806be60 0x7fe1c80b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c77fe640 1 -- 172.21.15.43:0/1862773878 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2343677813 0 0) 0x7fe1c80b5720 con 0x7fe1c8145c10 2024-04-24T23:08:07.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c77fe640 1 -- 172.21.15.43:0/1862773878 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b0003530 con 0x7fe1c8145c10 2024-04-24T23:08:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c77fe640 1 -- 172.21.15.43:0/1862773878 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3197575837 0 0) 0x7fe1b0003530 con 0x7fe1c8145c10 2024-04-24T23:08:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c77fe640 1 -- 172.21.15.43:0/1862773878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1c806be60 msgr2=0x7fe1c80b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c77fe640 1 --2- 172.21.15.43:0/1862773878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1c806be60 0x7fe1c80b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c77fe640 1 -- 172.21.15.43:0/1862773878 >> v1:172.21.15.162:6789/0 conn(0x7fe1c8072f40 legacy=0x7fe1c8145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c77fe640 1 -- 172.21.15.43:0/1862773878 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c80b59c0 con 0x7fe1c8145c10 2024-04-24T23:08:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c77fe640 1 -- 172.21.15.43:0/1862773878 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7fe1c0001a00 con 0x7fe1c8145c10 2024-04-24T23:08:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c77fe640 1 -- 172.21.15.43:0/1862773878 >> v1:172.21.15.43:6789/0 conn(0x7fe1c8145c10 legacy=0x7fe1c814fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c77fe640 1 --2- 172.21.15.43:0/1862773878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1b00039f0 0x7fe1b0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c77fe640 1 --2- 172.21.15.43:0/1862773878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b0004810 0x7fe1b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c77fe640 1 --2- 172.21.15.43:0/1862773878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1c806be60 0x7fe1b0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c77fe640 1 -- 172.21.15.43:0/1862773878 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c80b61c0 con 0x7fe1b0004810 2024-04-24T23:08:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c77fe640 1 -- 172.21.15.43:0/1862773878 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b000bb90 con 0x7fe1b00039f0 2024-04-24T23:08:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c77fe640 1 -- 172.21.15.43:0/1862773878 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1b000bd90 con 0x7fe1c806be60 2024-04-24T23:08:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c7fff640 1 --2- 172.21.15.43:0/1862773878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b0004810 0x7fe1b0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1cd702640 1 --2- 172.21.15.43:0/1862773878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1c806be60 0x7fe1b0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1ccf01640 1 --2- 172.21.15.43:0/1862773878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1b00039f0 0x7fe1b0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c7fff640 1 -- 172.21.15.43:0/1862773878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1c806be60 msgr2=0x7fe1b0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:07.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c7fff640 1 --2- 172.21.15.43:0/1862773878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1c806be60 0x7fe1b0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c7fff640 1 -- 172.21.15.43:0/1862773878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1b00039f0 msgr2=0x7fe1b0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:07.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c7fff640 1 --2- 172.21.15.43:0/1862773878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1b00039f0 0x7fe1b0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.110+0000 7fe1c7fff640 1 -- 172.21.15.43:0/1862773878 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b0003530 con 0x7fe1b0004810 2024-04-24T23:08:07.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.114+0000 7fe1c7fff640 1 --2- 172.21.15.43:0/1862773878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b0004810 0x7fe1b0004c90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009ae0 tx=0x7fe1bc01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e89c4b953a211f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:07.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.114+0000 7fe1c77fe640 1 -- 172.21.15.43:0/1862773878 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc0b2070 con 0x7fe1b0004810 2024-04-24T23:08:07.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.114+0000 7fe1c77fe640 1 -- 172.21.15.43:0/1862773878 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1bc0a5550 con 0x7fe1b0004810 2024-04-24T23:08:07.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.114+0000 7fe1c77fe640 1 -- 172.21.15.43:0/1862773878 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc0096b0 con 0x7fe1b0004810 2024-04-24T23:08:07.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.114+0000 7fe1cf165640 1 -- 172.21.15.43:0/1862773878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b0004810 msgr2=0x7fe1b0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.114+0000 7fe1cf165640 1 --2- 172.21.15.43:0/1862773878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b0004810 0x7fe1b0004c90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009ae0 tx=0x7fe1bc01ca70 comp rx=0 tx=0).stop 2024-04-24T23:08:07.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.114+0000 7fe1cd702640 1 -- 172.21.15.43:0/1862773878 reap_dead start 2024-04-24T23:08:07.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.114+0000 7fe1cf165640 1 -- 172.21.15.43:0/1862773878 shutdown_connections 2024-04-24T23:08:07.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.114+0000 7fe1cf165640 1 -- 172.21.15.43:0/1862773878 >> 172.21.15.43:0/1862773878 conn(0x7fe1c806c300 msgr2=0x7fe1c806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:07.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.114+0000 7fe1cf165640 1 -- 172.21.15.43:0/1862773878 shutdown_connections 2024-04-24T23:08:07.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.114+0000 7fe1cf165640 1 -- 172.21.15.43:0/1862773878 wait complete. 2024-04-24T23:08:07.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.114+0000 7fe1cf165640 1 Processor -- start 2024-04-24T23:08:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1cf165640 1 -- start start 2024-04-24T23:08:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1cf165640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1b0004810 0x7fe1c814fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1cf165640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1c8146660 0x7fe1c81de240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1cf165640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1c81de780 0x7fe1c8148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1cf165640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c8151870 con 0x7fe1c8146660 2024-04-24T23:08:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1cf165640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c81516f0 con 0x7fe1c81de780 2024-04-24T23:08:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1cf165640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c81519f0 con 0x7fe1b0004810 2024-04-24T23:08:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1c7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1c8146660 0x7fe1c81de240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1c7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1c8146660 0x7fe1c81de240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54814/0 (socket says 172.21.15.43:54814) 2024-04-24T23:08:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1c7fff640 1 -- 172.21.15.43:0/2138604999 learned_addr learned my addr 172.21.15.43:0/2138604999 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1ccf01640 1 --2- 172.21.15.43:0/2138604999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1b0004810 0x7fe1c814fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1cd702640 1 --2- 172.21.15.43:0/2138604999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1c81de780 0x7fe1c8148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1c7fff640 1 -- 172.21.15.43:0/2138604999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1b0004810 msgr2=0x7fe1c814fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1c7fff640 1 --2- 172.21.15.43:0/2138604999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1b0004810 0x7fe1c814fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1c7fff640 1 -- 172.21.15.43:0/2138604999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1c81de780 msgr2=0x7fe1c8148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1c7fff640 1 --2- 172.21.15.43:0/2138604999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1c81de780 0x7fe1c8148bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1c7fff640 1 -- 172.21.15.43:0/2138604999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c81dec00 con 0x7fe1c8146660 2024-04-24T23:08:07.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1cd702640 1 --2- 172.21.15.43:0/2138604999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1c81de780 0x7fe1c8148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:07.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1c7fff640 1 --2- 172.21.15.43:0/2138604999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1c8146660 0x7fe1c81de240 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009ae0 tx=0x7fe1b0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:07.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1c57fa640 1 -- 172.21.15.43:0/2138604999 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc0bc020 con 0x7fe1c8146660 2024-04-24T23:08:07.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1c57fa640 1 -- 172.21.15.43:0/2138604999 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1bc0a5d80 con 0x7fe1c8146660 2024-04-24T23:08:07.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1cf165640 1 -- 172.21.15.43:0/2138604999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c814f1c0 con 0x7fe1c8146660 2024-04-24T23:08:07.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1cf165640 1 -- 172.21.15.43:0/2138604999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c814e220 con 0x7fe1c8146660 2024-04-24T23:08:07.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1c57fa640 1 -- 172.21.15.43:0/2138604999 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc0b2040 con 0x7fe1c8146660 2024-04-24T23:08:07.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1cf165640 1 -- 172.21.15.43:0/2138604999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a80052a0 con 0x7fe1c8146660 2024-04-24T23:08:07.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1c57fa640 1 -- 172.21.15.43:0/2138604999 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe1bc004220 con 0x7fe1c8146660 2024-04-24T23:08:07.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1c57fa640 1 --2- 172.21.15.43:0/2138604999 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe1b40678c0 0x7fe1b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1c57fa640 1 -- 172.21.15.43:0/2138604999 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fe1bc1202b0 con 0x7fe1c8146660 2024-04-24T23:08:07.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1ccf01640 1 --2- 172.21.15.43:0/2138604999 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe1b40678c0 0x7fe1b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.118+0000 7fe1ccf01640 1 --2- 172.21.15.43:0/2138604999 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe1b40678c0 0x7fe1b4069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe1c81dbd00 tx=0x7fe1b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:07.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.126+0000 7fe1c57fa640 1 -- 172.21.15.43:0/2138604999 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe1bc0c6020 con 0x7fe1c8146660 2024-04-24T23:08:07.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.290+0000 7fe1cf165640 1 -- 172.21.15.43:0/2138604999 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fe1a8000bd0 con 0x7fe1b40678c0 2024-04-24T23:08:07.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.290+0000 7fe1c57fa640 1 -- 172.21.15.43:0/2138604999 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe1a8000bd0 con 0x7fe1b40678c0 2024-04-24T23:08:07.291 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 2 to deep-scrub 2024-04-24T23:08:07.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.290+0000 7fe1cf165640 1 -- 172.21.15.43:0/2138604999 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe1b40678c0 msgr2=0x7fe1b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.290+0000 7fe1cf165640 1 --2- 172.21.15.43:0/2138604999 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe1b40678c0 0x7fe1b4069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe1c81dbd00 tx=0x7fe1b8009040 comp rx=0 tx=0).stop 2024-04-24T23:08:07.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.290+0000 7fe1cf165640 1 -- 172.21.15.43:0/2138604999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1c8146660 msgr2=0x7fe1c81de240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.290+0000 7fe1cf165640 1 --2- 172.21.15.43:0/2138604999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1c8146660 0x7fe1c81de240 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009ae0 tx=0x7fe1b0005840 comp rx=0 tx=0).stop 2024-04-24T23:08:07.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.290+0000 7fe1cf165640 1 -- 172.21.15.43:0/2138604999 shutdown_connections 2024-04-24T23:08:07.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.290+0000 7fe1cf165640 1 --2- 172.21.15.43:0/2138604999 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fe1b40678c0 0x7fe1b4069d80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.290+0000 7fe1cf165640 1 --2- 172.21.15.43:0/2138604999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1c81de780 0x7fe1c8148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.290+0000 7fe1cf165640 1 --2- 172.21.15.43:0/2138604999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1c8146660 0x7fe1c81de240 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.290+0000 7fe1cf165640 1 --2- 172.21.15.43:0/2138604999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1b0004810 0x7fe1c814fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.290+0000 7fe1cf165640 1 -- 172.21.15.43:0/2138604999 >> 172.21.15.43:0/2138604999 conn(0x7fe1c806c300 msgr2=0x7fe1c80b6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:07.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.290+0000 7fe1cf165640 1 -- 172.21.15.43:0/2138604999 shutdown_connections 2024-04-24T23:08:07.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.290+0000 7fe1cf165640 1 -- 172.21.15.43:0/2138604999 wait complete. 2024-04-24T23:08:07.310 INFO:tasks.ceph:Scrubbing osd.3 2024-04-24T23:08:07.310 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:08:07.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.438+0000 7f56ad907640 1 Processor -- start 2024-04-24T23:08:07.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.438+0000 7f56ad907640 1 -- start start 2024-04-24T23:08:07.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56ad907640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56a80716b0 0x7f56a8144e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56ad907640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f56a814cbd0 0x7f56a814efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56ad907640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56a81449a0 con 0x7f56a80b4630 2024-04-24T23:08:07.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56ad907640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f56a8072dd0 con 0x7f56a814cbd0 2024-04-24T23:08:07.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56ad907640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f56a80b4a90 con 0x7f56a80716b0 2024-04-24T23:08:07.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56a6ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56a80716b0 0x7f56a8144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56a77fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f56a814cbd0 0x7f56a814efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56a6ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56a80716b0 0x7f56a8144e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.43:55628/0 (socket says 172.21.15.43:55628) 2024-04-24T23:08:07.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56a6ffd640 1 -- 172.21.15.43:0/2215846760 learned_addr learned my addr 172.21.15.43:0/2215846760 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:07.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56a67fc640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f56a80b4630 0x7f56a813e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.43:40234/0 (socket says 172.21.15.43:40234) 2024-04-24T23:08:07.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56a6ffd640 1 -- 172.21.15.43:0/2215846760 >> v2:172.21.15.162:3300/0 conn(0x7f56a814cbd0 msgr2=0x7f56a814efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:07.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56a6ffd640 1 --2- 172.21.15.43:0/2215846760 >> v2:172.21.15.162:3300/0 conn(0x7f56a814cbd0 0x7f56a814efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56a6ffd640 1 -- 172.21.15.43:0/2215846760 >> v1:172.21.15.162:6789/0 conn(0x7f56a80b4630 legacy=0x7f56a813e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56a6ffd640 1 -- 172.21.15.43:0/2215846760 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a8071a90 con 0x7f56a80716b0 2024-04-24T23:08:07.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56a77fe640 1 --2- 172.21.15.43:0/2215846760 >> v2:172.21.15.162:3300/0 conn(0x7f56a814cbd0 0x7f56a814efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-24T23:08:07.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.442+0000 7f56a6ffd640 1 --2- 172.21.15.43:0/2215846760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56a80716b0 0x7f56a8144e80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5698009e50 tx=0x7f569801c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67664f143e0bca16 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:07.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56a5ffb640 1 -- 172.21.15.43:0/2215846760 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56980a5750 con 0x7f56a80716b0 2024-04-24T23:08:07.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56a5ffb640 1 -- 172.21.15.43:0/2215846760 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56980a58f0 con 0x7f56a80716b0 2024-04-24T23:08:07.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56a5ffb640 1 -- 172.21.15.43:0/2215846760 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56980a5cc0 con 0x7f56a80716b0 2024-04-24T23:08:07.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 -- 172.21.15.43:0/2215846760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56a80716b0 msgr2=0x7f56a8144e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 --2- 172.21.15.43:0/2215846760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56a80716b0 0x7f56a8144e80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5698009e50 tx=0x7f569801c9a0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 -- 172.21.15.43:0/2215846760 shutdown_connections 2024-04-24T23:08:07.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 --2- 172.21.15.43:0/2215846760 >> v2:172.21.15.162:3300/0 conn(0x7f56a814cbd0 0x7f56a814efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 --2- 172.21.15.43:0/2215846760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56a80716b0 0x7f56a8144e80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 -- 172.21.15.43:0/2215846760 >> 172.21.15.43:0/2215846760 conn(0x7f56a80b6730 msgr2=0x7f56a80b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:07.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 -- 172.21.15.43:0/2215846760 shutdown_connections 2024-04-24T23:08:07.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 -- 172.21.15.43:0/2215846760 wait complete. 2024-04-24T23:08:07.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 Processor -- start 2024-04-24T23:08:07.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 -- start start 2024-04-24T23:08:07.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56a80716b0 0x7f56a814ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56a80b4630 0x7f56a814b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56a814cbd0 0x7f56a814bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f56a8071220 con 0x7f56a814cbd0 2024-04-24T23:08:07.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56a80710a0 con 0x7f56a80716b0 2024-04-24T23:08:07.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f56a80b7250 con 0x7f56a80b4630 2024-04-24T23:08:07.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56a77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56a814cbd0 0x7f56a814bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56a77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56a814cbd0 0x7f56a814bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54816/0 (socket says 172.21.15.43:54816) 2024-04-24T23:08:07.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56a77fe640 1 -- 172.21.15.43:0/3774856422 learned_addr learned my addr 172.21.15.43:0/3774856422 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:07.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56a6ffd640 1 --2- 172.21.15.43:0/3774856422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56a80716b0 0x7f56a814ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56a67fc640 1 --2- 172.21.15.43:0/3774856422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56a80b4630 0x7f56a814b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56a77fe640 1 -- 172.21.15.43:0/3774856422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56a80b4630 msgr2=0x7f56a814b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56a77fe640 1 --2- 172.21.15.43:0/3774856422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56a80b4630 0x7f56a814b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56a77fe640 1 -- 172.21.15.43:0/3774856422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56a80716b0 msgr2=0x7f56a814ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56a77fe640 1 --2- 172.21.15.43:0/3774856422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56a80716b0 0x7f56a814ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56a77fe640 1 -- 172.21.15.43:0/3774856422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a814ad10 con 0x7f56a814cbd0 2024-04-24T23:08:07.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56a77fe640 1 --2- 172.21.15.43:0/3774856422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56a814cbd0 0x7f56a814bc90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f56a000e840 tx=0x7f56a000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:07.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f569ffff640 1 -- 172.21.15.43:0/3774856422 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0017070 con 0x7f56a814cbd0 2024-04-24T23:08:07.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f569ffff640 1 -- 172.21.15.43:0/3774856422 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a000c940 con 0x7f56a814cbd0 2024-04-24T23:08:07.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 -- 172.21.15.43:0/3774856422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a814aff0 con 0x7f56a814cbd0 2024-04-24T23:08:07.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f569ffff640 1 -- 172.21.15.43:0/3774856422 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a000cd50 con 0x7f56a814cbd0 2024-04-24T23:08:07.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.446+0000 7f56ad907640 1 -- 172.21.15.43:0/3774856422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a8149ae0 con 0x7f56a814cbd0 2024-04-24T23:08:07.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.450+0000 7f56ad907640 1 -- 172.21.15.43:0/3774856422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f56a804f510 con 0x7f56a814cbd0 2024-04-24T23:08:07.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.450+0000 7f569ffff640 1 -- 172.21.15.43:0/3774856422 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f56a001a070 con 0x7f56a814cbd0 2024-04-24T23:08:07.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.450+0000 7f569ffff640 1 --2- 172.21.15.43:0/3774856422 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f56880678c0 0x7f5688069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.450+0000 7f569ffff640 1 -- 172.21.15.43:0/3774856422 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f56a00861a0 con 0x7f56a814cbd0 2024-04-24T23:08:07.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.450+0000 7f56a6ffd640 1 --2- 172.21.15.43:0/3774856422 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f56880678c0 0x7f5688069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.450+0000 7f569ffff640 1 --2- 172.21.15.43:0/3774856422 >> [v2:172.21.15.43:6818/451290605,v1:172.21.15.43:6821/451290605] conn(0x7f56880711d0 0x7f5688073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.450+0000 7f569ffff640 1 -- 172.21.15.43:0/3774856422 --> [v2:172.21.15.43:6818/451290605,v1:172.21.15.43:6821/451290605] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5688073d40 con 0x7f56880711d0 2024-04-24T23:08:07.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.450+0000 7f569ffff640 1 -- 172.21.15.43:0/3774856422 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f56a0086630 con 0x7f56a814cbd0 2024-04-24T23:08:07.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.450+0000 7f56a67fc640 1 --2- 172.21.15.43:0/3774856422 >> [v2:172.21.15.43:6818/451290605,v1:172.21.15.43:6821/451290605] conn(0x7f56880711d0 0x7f5688073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.450+0000 7f56a6ffd640 1 --2- 172.21.15.43:0/3774856422 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f56880678c0 0x7f5688069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f56980ae000 tx=0x7f56980a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:07.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.450+0000 7f56a67fc640 1 --2- 172.21.15.43:0/3774856422 >> [v2:172.21.15.43:6818/451290605,v1:172.21.15.43:6821/451290605] conn(0x7f56880711d0 0x7f5688073670 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:07.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.450+0000 7f569ffff640 1 -- 172.21.15.43:0/3774856422 <== osd.3 v2:172.21.15.43:6818/451290605 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5688073d40 con 0x7f56880711d0 2024-04-24T23:08:07.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.466+0000 7f56ad907640 1 -- 172.21.15.43:0/3774856422 --> [v2:172.21.15.43:6818/451290605,v1:172.21.15.43:6821/451290605] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f56a806d310 con 0x7f56880711d0 2024-04-24T23:08:07.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.466+0000 7f569ffff640 1 -- 172.21.15.43:0/3774856422 <== osd.3 v2:172.21.15.43:6818/451290605 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f56a806d310 con 0x7f56880711d0 2024-04-24T23:08:07.467 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-24T23:08:07.467 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:08:07.467 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-24T23:08:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.466+0000 7f56ad907640 1 -- 172.21.15.43:0/3774856422 >> [v2:172.21.15.43:6818/451290605,v1:172.21.15.43:6821/451290605] conn(0x7f56880711d0 msgr2=0x7f5688073670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.466+0000 7f56ad907640 1 --2- 172.21.15.43:0/3774856422 >> [v2:172.21.15.43:6818/451290605,v1:172.21.15.43:6821/451290605] conn(0x7f56880711d0 0x7f5688073670 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.466+0000 7f56ad907640 1 -- 172.21.15.43:0/3774856422 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f56880678c0 msgr2=0x7f5688069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.466+0000 7f56ad907640 1 --2- 172.21.15.43:0/3774856422 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f56880678c0 0x7f5688069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f56980ae000 tx=0x7f56980a7070 comp rx=0 tx=0).stop 2024-04-24T23:08:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.466+0000 7f56ad907640 1 -- 172.21.15.43:0/3774856422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56a814cbd0 msgr2=0x7f56a814bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.466+0000 7f56ad907640 1 --2- 172.21.15.43:0/3774856422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56a814cbd0 0x7f56a814bc90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f56a000e840 tx=0x7f56a000ed00 comp rx=0 tx=0).stop 2024-04-24T23:08:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.466+0000 7f56a77fe640 1 -- 172.21.15.43:0/3774856422 reap_dead start 2024-04-24T23:08:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.466+0000 7f56ad907640 1 -- 172.21.15.43:0/3774856422 shutdown_connections 2024-04-24T23:08:07.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.466+0000 7f56ad907640 1 -- 172.21.15.43:0/3774856422 >> 172.21.15.43:0/3774856422 conn(0x7f56a80b6730 msgr2=0x7f56a81351f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:07.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.466+0000 7f56ad907640 1 -- 172.21.15.43:0/3774856422 shutdown_connections 2024-04-24T23:08:07.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.466+0000 7f56ad907640 1 -- 172.21.15.43:0/3774856422 wait complete. 2024-04-24T23:08:07.482 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-24T23:08:07.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.602+0000 7f15f4f5a640 1 Processor -- start 2024-04-24T23:08:07.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.602+0000 7f15f4f5a640 1 -- start start 2024-04-24T23:08:07.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.602+0000 7f15f4f5a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15f0061e90 0x7f15f0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.602+0000 7f15f4f5a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f15f013f570 0x7f15f014fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.602+0000 7f15f4f5a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f00717a0 con 0x7f15f00723e0 2024-04-24T23:08:07.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.602+0000 7f15f4f5a640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f15f0071a10 con 0x7f15f013f570 2024-04-24T23:08:07.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.602+0000 7f15f4f5a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f15f0062270 con 0x7f15f0061e90 2024-04-24T23:08:07.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.602+0000 7f15eed9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f15f013f570 0x7f15f014fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.602+0000 7f15eed9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f15f013f570 0x7f15f014fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54826/0 (socket says 172.21.15.43:54826) 2024-04-24T23:08:07.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.602+0000 7f15eed9d640 1 -- 172.21.15.43:0/643415090 learned_addr learned my addr 172.21.15.43:0/643415090 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:07.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.602+0000 7f15ee59c640 1 --2- 172.21.15.43:0/643415090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15f0061e90 0x7f15f0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.602+0000 7f15eed9d640 1 -- 172.21.15.43:0/643415090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15f0061e90 msgr2=0x7f15f0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:07.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.602+0000 7f15eed9d640 1 --2- 172.21.15.43:0/643415090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15f0061e90 0x7f15f0071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.602+0000 7f15eed9d640 1 -- 172.21.15.43:0/643415090 >> v1:172.21.15.162:6789/0 conn(0x7f15f00723e0 legacy=0x7f15f013ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:07.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.602+0000 7f15eed9d640 1 -- 172.21.15.43:0/643415090 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f00b3860 con 0x7f15f013f570 2024-04-24T23:08:07.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15eed9d640 1 --2- 172.21.15.43:0/643415090 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f013f570 0x7f15f014fcb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009e50 tx=0x7f15e801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b944dcc3cb03baf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:07.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15edd9b640 1 -- 172.21.15.43:0/643415090 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e80a56d0 con 0x7f15f013f570 2024-04-24T23:08:07.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15edd9b640 1 -- 172.21.15.43:0/643415090 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e80a5870 con 0x7f15f013f570 2024-04-24T23:08:07.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15edd9b640 1 -- 172.21.15.43:0/643415090 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e80a5c40 con 0x7f15f013f570 2024-04-24T23:08:07.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 -- 172.21.15.43:0/643415090 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f013f570 msgr2=0x7f15f014fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 --2- 172.21.15.43:0/643415090 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f013f570 0x7f15f014fcb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009e50 tx=0x7f15e801c960 comp rx=0 tx=0).stop 2024-04-24T23:08:07.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 -- 172.21.15.43:0/643415090 shutdown_connections 2024-04-24T23:08:07.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 --2- 172.21.15.43:0/643415090 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f013f570 0x7f15f014fcb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 --2- 172.21.15.43:0/643415090 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15f0061e90 0x7f15f0071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 -- 172.21.15.43:0/643415090 >> 172.21.15.43:0/643415090 conn(0x7f15f006b9f0 msgr2=0x7f15f00b93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:07.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 -- 172.21.15.43:0/643415090 shutdown_connections 2024-04-24T23:08:07.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 -- 172.21.15.43:0/643415090 wait complete. 2024-04-24T23:08:07.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 Processor -- start 2024-04-24T23:08:07.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 -- start start 2024-04-24T23:08:07.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f0061e90 0x7f15f00b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15f00723e0 0x7f15f01dfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15f013f570 0x7f15f01e0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15f00707b0 con 0x7f15f0061e90 2024-04-24T23:08:07.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f15f0146260 con 0x7f15f013f570 2024-04-24T23:08:07.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15f4f5a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f15f0070930 con 0x7f15f00723e0 2024-04-24T23:08:07.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15ee59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f0061e90 0x7f15f00b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15ee59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f0061e90 0x7f15f00b56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54840/0 (socket says 172.21.15.43:54840) 2024-04-24T23:08:07.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.606+0000 7f15ee59c640 1 -- 172.21.15.43:0/1743754155 learned_addr learned my addr 172.21.15.43:0/1743754155 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:07.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15eed9d640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15f013f570 0x7f15f01e0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15e5d9b640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15f00723e0 0x7f15f01dfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15ee59c640 1 -- 172.21.15.43:0/1743754155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15f00723e0 msgr2=0x7f15f01dfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15ee59c640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15f00723e0 0x7f15f01dfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15ee59c640 1 -- 172.21.15.43:0/1743754155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15f013f570 msgr2=0x7f15f01e0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15ee59c640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15f013f570 0x7f15f01e0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15ee59c640 1 -- 172.21.15.43:0/1743754155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f013fc90 con 0x7f15f0061e90 2024-04-24T23:08:07.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15e5d9b640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15f00723e0 0x7f15f01dfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:07.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15eed9d640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15f013f570 0x7f15f01e0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:07.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15ee59c640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f0061e90 0x7f15f00b56b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f15e000d800 tx=0x7f15e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:07.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15e77fe640 1 -- 172.21.15.43:0/1743754155 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e000b6c0 con 0x7f15f0061e90 2024-04-24T23:08:07.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15e77fe640 1 -- 172.21.15.43:0/1743754155 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e0019070 con 0x7f15f0061e90 2024-04-24T23:08:07.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15e77fe640 1 -- 172.21.15.43:0/1743754155 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e000ba60 con 0x7f15f0061e90 2024-04-24T23:08:07.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15f4f5a640 1 -- 172.21.15.43:0/1743754155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f00b5f00 con 0x7f15f0061e90 2024-04-24T23:08:07.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15f4f5a640 1 -- 172.21.15.43:0/1743754155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f013ff00 con 0x7f15f0061e90 2024-04-24T23:08:07.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15f4f5a640 1 -- 172.21.15.43:0/1743754155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f004f580 con 0x7f15f0061e90 2024-04-24T23:08:07.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15e77fe640 1 -- 172.21.15.43:0/1743754155 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f15e000bc00 con 0x7f15f0061e90 2024-04-24T23:08:07.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15e77fe640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f15d00678c0 0x7f15d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15e77fe640 1 -- 172.21.15.43:0/1743754155 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f15e0086470 con 0x7f15f0061e90 2024-04-24T23:08:07.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15e5d9b640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f15d00678c0 0x7f15d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.610+0000 7f15e5d9b640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f15d00678c0 0x7f15d0069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f15f0149940 tx=0x7f15d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:07.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.614+0000 7f15e77fe640 1 -- 172.21.15.43:0/1743754155 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f15e0056c70 con 0x7f15f0061e90 2024-04-24T23:08:07.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.782+0000 7f15f4f5a640 1 -- 172.21.15.43:0/1743754155 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f15f013d680 con 0x7f15d00678c0 2024-04-24T23:08:07.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.782+0000 7f15e77fe640 1 -- 172.21.15.43:0/1743754155 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f15f013d680 con 0x7f15d00678c0 2024-04-24T23:08:07.785 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 3 to deep-scrub 2024-04-24T23:08:07.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.786+0000 7f15f4f5a640 1 -- 172.21.15.43:0/1743754155 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f15d00678c0 msgr2=0x7f15d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.786+0000 7f15f4f5a640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f15d00678c0 0x7f15d0069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f15f0149940 tx=0x7f15d8009040 comp rx=0 tx=0).stop 2024-04-24T23:08:07.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.786+0000 7f15f4f5a640 1 -- 172.21.15.43:0/1743754155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f0061e90 msgr2=0x7f15f00b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.786+0000 7f15f4f5a640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f0061e90 0x7f15f00b56b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f15e000d800 tx=0x7f15e000dcc0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.786+0000 7f15f4f5a640 1 -- 172.21.15.43:0/1743754155 shutdown_connections 2024-04-24T23:08:07.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.786+0000 7f15f4f5a640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f15d00678c0 0x7f15d0069d80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.786+0000 7f15f4f5a640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15f013f570 0x7f15f01e0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.786+0000 7f15f4f5a640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15f00723e0 0x7f15f01dfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.786+0000 7f15f4f5a640 1 --2- 172.21.15.43:0/1743754155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15f0061e90 0x7f15f00b56b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.786+0000 7f15f4f5a640 1 -- 172.21.15.43:0/1743754155 >> 172.21.15.43:0/1743754155 conn(0x7f15f006b9f0 msgr2=0x7f15f0072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:07.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.786+0000 7f15f4f5a640 1 -- 172.21.15.43:0/1743754155 shutdown_connections 2024-04-24T23:08:07.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.786+0000 7f15f4f5a640 1 -- 172.21.15.43:0/1743754155 wait complete. 2024-04-24T23:08:07.805 INFO:tasks.ceph:Scrubbing osd.4 2024-04-24T23:08:07.806 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:08:07.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f4616c79640 1 Processor -- start 2024-04-24T23:08:07.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f4616c79640 1 -- start start 2024-04-24T23:08:07.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f4616c79640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f461006f430 0x7f46100b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f4616c79640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46100705f0 con 0x7f4610073080 2024-04-24T23:08:07.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f4616c79640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46100b6b00 con 0x7f46100b1d10 2024-04-24T23:08:07.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f4616c79640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f46100b68b0 con 0x7f461006f430 2024-04-24T23:08:07.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460ffff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4610073080 0x7f4610145540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33896/0 (socket says 172.21.15.43:33896) 2024-04-24T23:08:07.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460ffff640 1 -- 172.21.15.43:0/1624108327 learned_addr learned my addr 172.21.15.43:0/1624108327 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:07.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f4614a15640 1 --2- 172.21.15.43:0/1624108327 >> v2:172.21.15.162:3300/0 conn(0x7f461006f430 0x7f46100b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460f7fe640 1 -- 172.21.15.43:0/1624108327 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564805060 0 0) 0x7f46100705f0 con 0x7f4610073080 2024-04-24T23:08:07.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460f7fe640 1 -- 172.21.15.43:0/1624108327 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45f8003530 con 0x7f4610073080 2024-04-24T23:08:07.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460f7fe640 1 -- 172.21.15.43:0/1624108327 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 459416208 0 0) 0x7f45f8003530 con 0x7f4610073080 2024-04-24T23:08:07.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460f7fe640 1 -- 172.21.15.43:0/1624108327 >> v2:172.21.15.162:3300/0 conn(0x7f461006f430 msgr2=0x7f46100b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:07.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460f7fe640 1 --2- 172.21.15.43:0/1624108327 >> v2:172.21.15.162:3300/0 conn(0x7f461006f430 0x7f46100b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460f7fe640 1 -- 172.21.15.43:0/1624108327 >> v1:172.21.15.162:6789/0 conn(0x7f46100b1d10 legacy=0x7f461014fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460f7fe640 1 -- 172.21.15.43:0/1624108327 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46100b6de0 con 0x7f4610073080 2024-04-24T23:08:07.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460f7fe640 1 -- 172.21.15.43:0/1624108327 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f4604001680 con 0x7f4610073080 2024-04-24T23:08:07.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460f7fe640 1 -- 172.21.15.43:0/1624108327 >> v1:172.21.15.43:6789/0 conn(0x7f4610073080 legacy=0x7f4610145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460f7fe640 1 --2- 172.21.15.43:0/1624108327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45f80039c0 0x7f45f8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460f7fe640 1 --2- 172.21.15.43:0/1624108327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f8004810 0x7f45f8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460f7fe640 1 --2- 172.21.15.43:0/1624108327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45f80052f0 0x7f45f800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460f7fe640 1 -- 172.21.15.43:0/1624108327 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f46100b68b0 con 0x7f45f8004810 2024-04-24T23:08:07.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460f7fe640 1 -- 172.21.15.43:0/1624108327 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f45f800c1c0 con 0x7f45f80052f0 2024-04-24T23:08:07.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460f7fe640 1 -- 172.21.15.43:0/1624108327 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f45f800c3c0 con 0x7f45f80039c0 2024-04-24T23:08:07.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460ffff640 1 --2- 172.21.15.43:0/1624108327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f8004810 0x7f45f8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460ffff640 1 -- 172.21.15.43:0/1624108327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45f80039c0 msgr2=0x7f45f8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:07.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460ffff640 1 --2- 172.21.15.43:0/1624108327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45f80039c0 0x7f45f8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460ffff640 1 -- 172.21.15.43:0/1624108327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45f80052f0 msgr2=0x7f45f800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:07.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460ffff640 1 --2- 172.21.15.43:0/1624108327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45f80052f0 0x7f45f800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f460ffff640 1 -- 172.21.15.43:0/1624108327 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f8003530 con 0x7f45f8004810 2024-04-24T23:08:07.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.926+0000 7f4615216640 1 -- 172.21.15.43:0/1624108327 reap_dead start 2024-04-24T23:08:07.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f460ffff640 1 --2- 172.21.15.43:0/1624108327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f8004810 0x7f45f8004c90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f460400c190 tx=0x7f460401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9950eaa4bd15a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:07.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f460f7fe640 1 -- 172.21.15.43:0/1624108327 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604007d00 con 0x7f45f8004810 2024-04-24T23:08:07.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f460f7fe640 1 -- 172.21.15.43:0/1624108327 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46040a9020 con 0x7f45f8004810 2024-04-24T23:08:07.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f460f7fe640 1 -- 172.21.15.43:0/1624108327 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604005ae0 con 0x7f45f8004810 2024-04-24T23:08:07.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4616c79640 1 -- 172.21.15.43:0/1624108327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f8004810 msgr2=0x7f45f8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4616c79640 1 --2- 172.21.15.43:0/1624108327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f8004810 0x7f45f8004c90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f460400c190 tx=0x7f460401cbf0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4616c79640 1 -- 172.21.15.43:0/1624108327 shutdown_connections 2024-04-24T23:08:07.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4616c79640 1 --2- 172.21.15.43:0/1624108327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f8004810 0x7f45f8004c90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4616c79640 1 -- 172.21.15.43:0/1624108327 >> 172.21.15.43:0/1624108327 conn(0x7f46100b7880 msgr2=0x7f46100b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:07.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4616c79640 1 -- 172.21.15.43:0/1624108327 shutdown_connections 2024-04-24T23:08:07.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4616c79640 1 -- 172.21.15.43:0/1624108327 wait complete. 2024-04-24T23:08:07.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4616c79640 1 Processor -- start 2024-04-24T23:08:07.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4616c79640 1 -- start start 2024-04-24T23:08:07.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4616c79640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f8004810 0x7f46101e3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4616c79640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f461006c850 0x7f461009eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4616c79640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46101e0b90 0x7f46101e1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4616c79640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f46100b5900 con 0x7f45f8004810 2024-04-24T23:08:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4616c79640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46100b5780 con 0x7f46101e0b90 2024-04-24T23:08:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4616c79640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f46100b5a80 con 0x7f461006c850 2024-04-24T23:08:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4614a15640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f8004810 0x7f46101e3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4614a15640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f8004810 0x7f46101e3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54868/0 (socket says 172.21.15.43:54868) 2024-04-24T23:08:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4614a15640 1 -- 172.21.15.43:0/3083046532 learned_addr learned my addr 172.21.15.43:0/3083046532 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f460ffff640 1 --2- 172.21.15.43:0/3083046532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f461006c850 0x7f461009eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.930+0000 7f4615216640 1 --2- 172.21.15.43:0/3083046532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46101e0b90 0x7f46101e1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f4614a15640 1 -- 172.21.15.43:0/3083046532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f461006c850 msgr2=0x7f461009eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f4614a15640 1 --2- 172.21.15.43:0/3083046532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f461006c850 0x7f461009eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f4614a15640 1 -- 172.21.15.43:0/3083046532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46101e0b90 msgr2=0x7f46101e1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f4614a15640 1 --2- 172.21.15.43:0/3083046532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46101e0b90 0x7f46101e1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f4614a15640 1 -- 172.21.15.43:0/3083046532 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46101e1550 con 0x7f45f8004810 2024-04-24T23:08:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f4614a15640 1 --2- 172.21.15.43:0/3083046532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f8004810 0x7f46101e3db0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f460000e7d0 tx=0x7f460000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:07.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f460d7fa640 1 -- 172.21.15.43:0/3083046532 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600017070 con 0x7f45f8004810 2024-04-24T23:08:07.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f460d7fa640 1 -- 172.21.15.43:0/3083046532 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460000c860 con 0x7f45f8004810 2024-04-24T23:08:07.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f4616c79640 1 -- 172.21.15.43:0/3083046532 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46101e4610 con 0x7f45f8004810 2024-04-24T23:08:07.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f460d7fa640 1 -- 172.21.15.43:0/3083046532 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460000cc30 con 0x7f45f8004810 2024-04-24T23:08:07.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f4616c79640 1 -- 172.21.15.43:0/3083046532 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46101e42f0 con 0x7f45f8004810 2024-04-24T23:08:07.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f4616c79640 1 -- 172.21.15.43:0/3083046532 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f461004f580 con 0x7f45f8004810 2024-04-24T23:08:07.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f460d7fa640 1 -- 172.21.15.43:0/3083046532 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f460001a070 con 0x7f45f8004810 2024-04-24T23:08:07.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f460d7fa640 1 --2- 172.21.15.43:0/3083046532 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f45fc0678c0 0x7f45fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f460d7fa640 1 -- 172.21.15.43:0/3083046532 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f46000861e0 con 0x7f45f8004810 2024-04-24T23:08:07.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f460ffff640 1 --2- 172.21.15.43:0/3083046532 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f45fc0678c0 0x7f45fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f460d7fa640 1 --2- 172.21.15.43:0/3083046532 >> [v2:172.21.15.162:6800/2854620223,v1:172.21.15.162:6801/2854620223] conn(0x7f45fc0711d0 0x7f45fc073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:07.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f460d7fa640 1 -- 172.21.15.43:0/3083046532 --> [v2:172.21.15.162:6800/2854620223,v1:172.21.15.162:6801/2854620223] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4600013e50 con 0x7f45fc0711d0 2024-04-24T23:08:07.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f460d7fa640 1 -- 172.21.15.43:0/3083046532 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f460008d050 con 0x7f45f8004810 2024-04-24T23:08:07.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f460ffff640 1 --2- 172.21.15.43:0/3083046532 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f45fc0678c0 0x7f45fc069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f46040aa000 tx=0x7f46100707c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:07.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f4615216640 1 --2- 172.21.15.43:0/3083046532 >> [v2:172.21.15.162:6800/2854620223,v1:172.21.15.162:6801/2854620223] conn(0x7f45fc0711d0 0x7f45fc073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:07.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.934+0000 7f4615216640 1 --2- 172.21.15.43:0/3083046532 >> [v2:172.21.15.162:6800/2854620223,v1:172.21.15.162:6801/2854620223] conn(0x7f45fc0711d0 0x7f45fc073670 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:07.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.938+0000 7f460d7fa640 1 -- 172.21.15.43:0/3083046532 <== osd.4 v2:172.21.15.162:6800/2854620223 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4600013e50 con 0x7f45fc0711d0 2024-04-24T23:08:07.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.962+0000 7f4616c79640 1 -- 172.21.15.43:0/3083046532 --> [v2:172.21.15.162:6800/2854620223,v1:172.21.15.162:6801/2854620223] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f461013cc00 con 0x7f45fc0711d0 2024-04-24T23:08:07.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.962+0000 7f460d7fa640 1 -- 172.21.15.43:0/3083046532 <== osd.4 v2:172.21.15.162:6800/2854620223 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f461013cc00 con 0x7f45fc0711d0 2024-04-24T23:08:07.964 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-24T23:08:07.964 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:08:07.964 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-24T23:08:07.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.962+0000 7f4616c79640 1 -- 172.21.15.43:0/3083046532 >> [v2:172.21.15.162:6800/2854620223,v1:172.21.15.162:6801/2854620223] conn(0x7f45fc0711d0 msgr2=0x7f45fc073670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.962+0000 7f4616c79640 1 --2- 172.21.15.43:0/3083046532 >> [v2:172.21.15.162:6800/2854620223,v1:172.21.15.162:6801/2854620223] conn(0x7f45fc0711d0 0x7f45fc073670 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.962+0000 7f4616c79640 1 -- 172.21.15.43:0/3083046532 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f45fc0678c0 msgr2=0x7f45fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.962+0000 7f4616c79640 1 --2- 172.21.15.43:0/3083046532 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f45fc0678c0 0x7f45fc069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f46040aa000 tx=0x7f46100707c0 comp rx=0 tx=0).stop 2024-04-24T23:08:07.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.962+0000 7f4616c79640 1 -- 172.21.15.43:0/3083046532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f8004810 msgr2=0x7f46101e3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:07.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.962+0000 7f4616c79640 1 --2- 172.21.15.43:0/3083046532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f8004810 0x7f46101e3db0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f460000e7d0 tx=0x7f460000ec90 comp rx=0 tx=0).stop 2024-04-24T23:08:07.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.962+0000 7f4615216640 1 -- 172.21.15.43:0/3083046532 reap_dead start 2024-04-24T23:08:07.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.962+0000 7f4616c79640 1 -- 172.21.15.43:0/3083046532 shutdown_connections 2024-04-24T23:08:07.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.962+0000 7f4616c79640 1 -- 172.21.15.43:0/3083046532 >> 172.21.15.43:0/3083046532 conn(0x7f46100b7880 msgr2=0x7f4610143d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:07.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.962+0000 7f4616c79640 1 -- 172.21.15.43:0/3083046532 shutdown_connections 2024-04-24T23:08:07.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:07.962+0000 7f4616c79640 1 -- 172.21.15.43:0/3083046532 wait complete. 2024-04-24T23:08:07.984 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-24T23:08:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.090+0000 7f3069276640 1 Processor -- start 2024-04-24T23:08:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.090+0000 7f3069276640 1 -- start start 2024-04-24T23:08:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3069276640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3064148740 0x7f30640b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3069276640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30640b72a0 con 0x7f30640b5450 2024-04-24T23:08:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3069276640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30640b4c50 con 0x7f3064061e90 2024-04-24T23:08:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3069276640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30640b4fc0 con 0x7f3064148740 2024-04-24T23:08:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f30627fc640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f30640b5450 0x7f3064148030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33898/0 (socket says 172.21.15.43:33898) 2024-04-24T23:08:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f30627fc640 1 -- 172.21.15.43:0/2773266091 learned_addr learned my addr 172.21.15.43:0/2773266091 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:08.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f30637fe640 1 --2- 172.21.15.43:0/2773266091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3064148740 0x7f30640b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3061ffb640 1 -- 172.21.15.43:0/2773266091 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1326034335 0 0) 0x7f30640b72a0 con 0x7f30640b5450 2024-04-24T23:08:08.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3061ffb640 1 -- 172.21.15.43:0/2773266091 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f304c003530 con 0x7f30640b5450 2024-04-24T23:08:08.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3061ffb640 1 -- 172.21.15.43:0/2773266091 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3958714767 0 0) 0x7f304c003530 con 0x7f30640b5450 2024-04-24T23:08:08.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3061ffb640 1 -- 172.21.15.43:0/2773266091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3064148740 msgr2=0x7f30640b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:08.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3061ffb640 1 --2- 172.21.15.43:0/2773266091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3064148740 0x7f30640b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3061ffb640 1 -- 172.21.15.43:0/2773266091 >> v1:172.21.15.162:6789/0 conn(0x7f3064061e90 legacy=0x7f306414b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3061ffb640 1 -- 172.21.15.43:0/2773266091 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3064062270 con 0x7f30640b5450 2024-04-24T23:08:08.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3061ffb640 1 -- 172.21.15.43:0/2773266091 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f3054001800 con 0x7f30640b5450 2024-04-24T23:08:08.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3061ffb640 1 -- 172.21.15.43:0/2773266091 >> v1:172.21.15.43:6789/0 conn(0x7f30640b5450 legacy=0x7f3064148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3061ffb640 1 --2- 172.21.15.43:0/2773266091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304c0039f0 0x7f304c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3061ffb640 1 --2- 172.21.15.43:0/2773266091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f304c004810 0x7f304c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3061ffb640 1 --2- 172.21.15.43:0/2773266091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3064148740 0x7f304c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3061ffb640 1 -- 172.21.15.43:0/2773266091 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30640b4fc0 con 0x7f304c0039f0 2024-04-24T23:08:08.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3061ffb640 1 -- 172.21.15.43:0/2773266091 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f304c00ba80 con 0x7f304c004810 2024-04-24T23:08:08.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3061ffb640 1 -- 172.21.15.43:0/2773266091 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f304c00bc80 con 0x7f3064148740 2024-04-24T23:08:08.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3062ffd640 1 --2- 172.21.15.43:0/2773266091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304c0039f0 0x7f304c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f30627fc640 1 --2- 172.21.15.43:0/2773266091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f304c004810 0x7f304c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3062ffd640 1 -- 172.21.15.43:0/2773266091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3064148740 msgr2=0x7f304c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:08.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f30637fe640 1 --2- 172.21.15.43:0/2773266091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3064148740 0x7f304c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3062ffd640 1 --2- 172.21.15.43:0/2773266091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3064148740 0x7f304c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3062ffd640 1 -- 172.21.15.43:0/2773266091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f304c004810 msgr2=0x7f304c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:08.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3062ffd640 1 --2- 172.21.15.43:0/2773266091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f304c004810 0x7f304c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f3062ffd640 1 -- 172.21.15.43:0/2773266091 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f304c003530 con 0x7f304c0039f0 2024-04-24T23:08:08.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f30627fc640 1 --2- 172.21.15.43:0/2773266091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f304c004810 0x7f304c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:08.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.094+0000 7f30637fe640 1 --2- 172.21.15.43:0/2773266091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3064148740 0x7f304c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:08.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3062ffd640 1 --2- 172.21.15.43:0/2773266091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304c0039f0 0x7f304c003e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3058001750 tx=0x7f305801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146988fa679a1e80 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:08.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3061ffb640 1 -- 172.21.15.43:0/2773266091 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30580013a0 con 0x7f304c0039f0 2024-04-24T23:08:08.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3061ffb640 1 -- 172.21.15.43:0/2773266091 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30580052f0 con 0x7f304c0039f0 2024-04-24T23:08:08.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3061ffb640 1 -- 172.21.15.43:0/2773266091 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058003840 con 0x7f304c0039f0 2024-04-24T23:08:08.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3069276640 1 -- 172.21.15.43:0/2773266091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304c0039f0 msgr2=0x7f304c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3069276640 1 --2- 172.21.15.43:0/2773266091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304c0039f0 0x7f304c003e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3058001750 tx=0x7f305801c3c0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f30637fe640 1 -- 172.21.15.43:0/2773266091 reap_dead start 2024-04-24T23:08:08.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3069276640 1 -- 172.21.15.43:0/2773266091 shutdown_connections 2024-04-24T23:08:08.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3069276640 1 -- 172.21.15.43:0/2773266091 >> 172.21.15.43:0/2773266091 conn(0x7f306409b250 msgr2=0x7f306409b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:08.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3069276640 1 -- 172.21.15.43:0/2773266091 shutdown_connections 2024-04-24T23:08:08.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3069276640 1 -- 172.21.15.43:0/2773266091 wait complete. 2024-04-24T23:08:08.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3069276640 1 Processor -- start 2024-04-24T23:08:08.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3069276640 1 -- start start 2024-04-24T23:08:08.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3069276640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304c0039f0 0x7f3064146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3069276640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30641e35f0 0x7f306413df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3069276640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306413e4d0 0x7f3064140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3069276640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3064153b70 con 0x7f304c0039f0 2024-04-24T23:08:08.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3069276640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3064153cf0 con 0x7f306413e4d0 2024-04-24T23:08:08.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3069276640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3064153e70 con 0x7f30641e35f0 2024-04-24T23:08:08.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3062ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304c0039f0 0x7f3064146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3062ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304c0039f0 0x7f3064146b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54890/0 (socket says 172.21.15.43:54890) 2024-04-24T23:08:08.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3062ffd640 1 -- 172.21.15.43:0/1908115473 learned_addr learned my addr 172.21.15.43:0/1908115473 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:08.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f30627fc640 1 --2- 172.21.15.43:0/1908115473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30641e35f0 0x7f306413df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f30637fe640 1 --2- 172.21.15.43:0/1908115473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306413e4d0 0x7f3064140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3062ffd640 1 -- 172.21.15.43:0/1908115473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30641e35f0 msgr2=0x7f306413df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3062ffd640 1 --2- 172.21.15.43:0/1908115473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30641e35f0 0x7f306413df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3062ffd640 1 -- 172.21.15.43:0/1908115473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306413e4d0 msgr2=0x7f3064140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3062ffd640 1 --2- 172.21.15.43:0/1908115473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306413e4d0 0x7f3064140ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.098+0000 7f3062ffd640 1 -- 172.21.15.43:0/1908115473 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3064071e80 con 0x7f304c0039f0 2024-04-24T23:08:08.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.102+0000 7f3062ffd640 1 --2- 172.21.15.43:0/1908115473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304c0039f0 0x7f3064146b60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3058001750 tx=0x7f304c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:08.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.102+0000 7f304b7fe640 1 -- 172.21.15.43:0/1908115473 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058007a40 con 0x7f304c0039f0 2024-04-24T23:08:08.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.102+0000 7f304b7fe640 1 -- 172.21.15.43:0/1908115473 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30580bb070 con 0x7f304c0039f0 2024-04-24T23:08:08.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.102+0000 7f304b7fe640 1 -- 172.21.15.43:0/1908115473 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30580013a0 con 0x7f304c0039f0 2024-04-24T23:08:08.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.102+0000 7f3069276640 1 -- 172.21.15.43:0/1908115473 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3064072160 con 0x7f304c0039f0 2024-04-24T23:08:08.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.102+0000 7f3069276640 1 -- 172.21.15.43:0/1908115473 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3064142b20 con 0x7f304c0039f0 2024-04-24T23:08:08.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.102+0000 7f3069276640 1 -- 172.21.15.43:0/1908115473 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f306404f580 con 0x7f304c0039f0 2024-04-24T23:08:08.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.102+0000 7f304b7fe640 1 -- 172.21.15.43:0/1908115473 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f30580b4040 con 0x7f304c0039f0 2024-04-24T23:08:08.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.102+0000 7f304b7fe640 1 --2- 172.21.15.43:0/1908115473 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f30500678c0 0x7f3050069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.102+0000 7f304b7fe640 1 -- 172.21.15.43:0/1908115473 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f305811fe70 con 0x7f304c0039f0 2024-04-24T23:08:08.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.102+0000 7f30627fc640 1 --2- 172.21.15.43:0/1908115473 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f30500678c0 0x7f3050069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.102+0000 7f30627fc640 1 --2- 172.21.15.43:0/1908115473 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f30500678c0 0x7f3050069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3054001970 tx=0x7f3054009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:08.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.106+0000 7f304b7fe640 1 -- 172.21.15.43:0/1908115473 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f30580160d0 con 0x7f304c0039f0 2024-04-24T23:08:08.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.266+0000 7f3069276640 1 -- 172.21.15.43:0/1908115473 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f3064142db0 con 0x7f30500678c0 2024-04-24T23:08:08.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.266+0000 7f304b7fe640 1 -- 172.21.15.43:0/1908115473 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f305400f8d0 con 0x7f30500678c0 2024-04-24T23:08:08.268 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 4 to deep-scrub 2024-04-24T23:08:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.270+0000 7f3069276640 1 -- 172.21.15.43:0/1908115473 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f30500678c0 msgr2=0x7f3050069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.270+0000 7f3069276640 1 --2- 172.21.15.43:0/1908115473 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f30500678c0 0x7f3050069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3054001970 tx=0x7f3054009040 comp rx=0 tx=0).stop 2024-04-24T23:08:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.270+0000 7f3069276640 1 -- 172.21.15.43:0/1908115473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304c0039f0 msgr2=0x7f3064146b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.270+0000 7f3069276640 1 --2- 172.21.15.43:0/1908115473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304c0039f0 0x7f3064146b60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3058001750 tx=0x7f304c005840 comp rx=0 tx=0).stop 2024-04-24T23:08:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.270+0000 7f3069276640 1 -- 172.21.15.43:0/1908115473 shutdown_connections 2024-04-24T23:08:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.270+0000 7f3069276640 1 --2- 172.21.15.43:0/1908115473 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f30500678c0 0x7f3050069d80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.270+0000 7f3069276640 1 --2- 172.21.15.43:0/1908115473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306413e4d0 0x7f3064140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.270+0000 7f3069276640 1 --2- 172.21.15.43:0/1908115473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30641e35f0 0x7f306413df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.270+0000 7f3069276640 1 --2- 172.21.15.43:0/1908115473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f304c0039f0 0x7f3064146b60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.270+0000 7f3069276640 1 -- 172.21.15.43:0/1908115473 >> 172.21.15.43:0/1908115473 conn(0x7f306409b250 msgr2=0x7f3064074170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.270+0000 7f3069276640 1 -- 172.21.15.43:0/1908115473 shutdown_connections 2024-04-24T23:08:08.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.270+0000 7f3069276640 1 -- 172.21.15.43:0/1908115473 wait complete. 2024-04-24T23:08:08.286 INFO:tasks.ceph:Scrubbing osd.5 2024-04-24T23:08:08.287 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:08:08.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.410+0000 7fa0b06a2640 1 Processor -- start 2024-04-24T23:08:08.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.410+0000 7fa0b06a2640 1 -- start start 2024-04-24T23:08:08.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.410+0000 7fa0b06a2640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa0a8072eb0 0x7fa0a813f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.410+0000 7fa0b06a2640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0a8073290 con 0x7fa0a80b60f0 2024-04-24T23:08:08.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.410+0000 7fa0b06a2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0a80b07f0 con 0x7fa0a80b5840 2024-04-24T23:08:08.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.410+0000 7fa0b06a2640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa0a80b5400 con 0x7fa0a8072eb0 2024-04-24T23:08:08.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.410+0000 7fa0ae43e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa0a8072eb0 0x7fa0a813f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.410+0000 7fa0ae43e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa0a8072eb0 0x7fa0a813f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54900/0 (socket says 172.21.15.43:54900) 2024-04-24T23:08:08.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.410+0000 7fa0ae43e640 1 -- 172.21.15.43:0/412246820 learned_addr learned my addr 172.21.15.43:0/412246820 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:08.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.410+0000 7fa0aec3f640 1 --1- 172.21.15.43:0/412246820 >> v1:172.21.15.43:6789/0 conn(0x7fa0a80b60f0 0x7fa0a80b4630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33912/0 (socket says 172.21.15.43:33912) 2024-04-24T23:08:08.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.410+0000 7fa0ae43e640 1 -- 172.21.15.43:0/412246820 >> v1:172.21.15.162:6789/0 conn(0x7fa0a80b5840 legacy=0x7fa0a813f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:08.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.410+0000 7fa0ae43e640 1 -- 172.21.15.43:0/412246820 >> v1:172.21.15.43:6789/0 conn(0x7fa0a80b60f0 legacy=0x7fa0a80b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.410+0000 7fa0ae43e640 1 -- 172.21.15.43:0/412246820 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a806e890 con 0x7fa0a8072eb0 2024-04-24T23:08:08.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.410+0000 7fa0ae43e640 1 --2- 172.21.15.43:0/412246820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a8072eb0 0x7fa0a813f310 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa098009870 tx=0x7fa09801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e285bb89e9a34cbc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:08.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0ad43c640 1 -- 172.21.15.43:0/412246820 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0980b1070 con 0x7fa0a8072eb0 2024-04-24T23:08:08.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0ad43c640 1 -- 172.21.15.43:0/412246820 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0980ac600 con 0x7fa0a8072eb0 2024-04-24T23:08:08.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0ad43c640 1 -- 172.21.15.43:0/412246820 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0980ac9d0 con 0x7fa0a8072eb0 2024-04-24T23:08:08.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 -- 172.21.15.43:0/412246820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a8072eb0 msgr2=0x7fa0a813f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 --2- 172.21.15.43:0/412246820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a8072eb0 0x7fa0a813f310 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa098009870 tx=0x7fa09801c490 comp rx=0 tx=0).stop 2024-04-24T23:08:08.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 -- 172.21.15.43:0/412246820 shutdown_connections 2024-04-24T23:08:08.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 --2- 172.21.15.43:0/412246820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a8072eb0 0x7fa0a813f310 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 -- 172.21.15.43:0/412246820 >> 172.21.15.43:0/412246820 conn(0x7fa0a80ba030 msgr2=0x7fa0a80ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:08.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 -- 172.21.15.43:0/412246820 shutdown_connections 2024-04-24T23:08:08.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 -- 172.21.15.43:0/412246820 wait complete. 2024-04-24T23:08:08.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 Processor -- start 2024-04-24T23:08:08.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 -- start start 2024-04-24T23:08:08.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0a8072eb0 0x7fa0a813baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a80b60f0 0x7fa0a8070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0a81e3a40 0x7fa0a8135480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a8153a50 con 0x7fa0a80b60f0 2024-04-24T23:08:08.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a81538d0 con 0x7fa0a81e3a40 2024-04-24T23:08:08.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a8153bd0 con 0x7fa0a8072eb0 2024-04-24T23:08:08.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0adc3d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a80b60f0 0x7fa0a8070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0adc3d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a80b60f0 0x7fa0a8070f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54902/0 (socket says 172.21.15.43:54902) 2024-04-24T23:08:08.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0adc3d640 1 -- 172.21.15.43:0/4218968862 learned_addr learned my addr 172.21.15.43:0/4218968862 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:08.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0aec3f640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0a81e3a40 0x7fa0a8135480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0ae43e640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0a8072eb0 0x7fa0a813baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0adc3d640 1 -- 172.21.15.43:0/4218968862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0a8072eb0 msgr2=0x7fa0a813baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0adc3d640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0a8072eb0 0x7fa0a813baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0adc3d640 1 -- 172.21.15.43:0/4218968862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0a81e3a40 msgr2=0x7fa0a8135480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0adc3d640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0a81e3a40 0x7fa0a8135480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0adc3d640 1 -- 172.21.15.43:0/4218968862 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a8071460 con 0x7fa0a80b60f0 2024-04-24T23:08:08.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0aec3f640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0a81e3a40 0x7fa0a8135480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:08.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0ae43e640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0a8072eb0 0x7fa0a813baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:08.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0adc3d640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a80b60f0 0x7fa0a8070f20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400c450 tx=0x7fa0a400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:08.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa09effd640 1 -- 172.21.15.43:0/4218968862 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4012830 con 0x7fa0a80b60f0 2024-04-24T23:08:08.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa09effd640 1 -- 172.21.15.43:0/4218968862 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a4017070 con 0x7fa0a80b60f0 2024-04-24T23:08:08.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 -- 172.21.15.43:0/4218968862 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a80718e0 con 0x7fa0a80b60f0 2024-04-24T23:08:08.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa09effd640 1 -- 172.21.15.43:0/4218968862 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4012c30 con 0x7fa0a80b60f0 2024-04-24T23:08:08.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.414+0000 7fa0b06a2640 1 -- 172.21.15.43:0/4218968862 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a8072920 con 0x7fa0a80b60f0 2024-04-24T23:08:08.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.418+0000 7fa0b06a2640 1 -- 172.21.15.43:0/4218968862 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa0a804f580 con 0x7fa0a80b60f0 2024-04-24T23:08:08.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.418+0000 7fa09effd640 1 -- 172.21.15.43:0/4218968862 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa0a401c460 con 0x7fa0a80b60f0 2024-04-24T23:08:08.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.418+0000 7fa09effd640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa08c0678f0 0x7fa08c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.418+0000 7fa09effd640 1 -- 172.21.15.43:0/4218968862 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fa0a4085e10 con 0x7fa0a80b60f0 2024-04-24T23:08:08.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.418+0000 7fa0ae43e640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa08c0678f0 0x7fa08c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.418+0000 7fa09effd640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.162:6806/4243337477,v1:172.21.15.162:6809/4243337477] conn(0x7fa08c071200 0x7fa08c0736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.418+0000 7fa09effd640 1 -- 172.21.15.43:0/4218968862 --> [v2:172.21.15.162:6806/4243337477,v1:172.21.15.162:6809/4243337477] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa08c073d70 con 0x7fa08c071200 2024-04-24T23:08:08.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.418+0000 7fa09effd640 1 -- 172.21.15.43:0/4218968862 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa0a4088510 con 0x7fa0a80b60f0 2024-04-24T23:08:08.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.418+0000 7fa0ae43e640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa08c0678f0 0x7fa08c069db0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa0980ae000 tx=0x7fa098008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:08.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.418+0000 7fa0aec3f640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.162:6806/4243337477,v1:172.21.15.162:6809/4243337477] conn(0x7fa08c071200 0x7fa08c0736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.418+0000 7fa0aec3f640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.162:6806/4243337477,v1:172.21.15.162:6809/4243337477] conn(0x7fa08c071200 0x7fa08c0736a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:08.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.422+0000 7fa09effd640 1 -- 172.21.15.43:0/4218968862 <== osd.5 v2:172.21.15.162:6806/4243337477 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa08c073d70 con 0x7fa08c071200 2024-04-24T23:08:08.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.434+0000 7fa0b06a2640 1 -- 172.21.15.43:0/4218968862 --> [v2:172.21.15.162:6806/4243337477,v1:172.21.15.162:6809/4243337477] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa0a813fb60 con 0x7fa08c071200 2024-04-24T23:08:08.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.434+0000 7fa09effd640 1 -- 172.21.15.43:0/4218968862 <== osd.5 v2:172.21.15.162:6806/4243337477 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa0a813fb60 con 0x7fa08c071200 2024-04-24T23:08:08.436 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-24T23:08:08.436 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:08:08.436 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-24T23:08:08.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.434+0000 7fa0b06a2640 1 -- 172.21.15.43:0/4218968862 >> [v2:172.21.15.162:6806/4243337477,v1:172.21.15.162:6809/4243337477] conn(0x7fa08c071200 msgr2=0x7fa08c0736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.434+0000 7fa0b06a2640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.162:6806/4243337477,v1:172.21.15.162:6809/4243337477] conn(0x7fa08c071200 0x7fa08c0736a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.434+0000 7fa0b06a2640 1 -- 172.21.15.43:0/4218968862 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa08c0678f0 msgr2=0x7fa08c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.434+0000 7fa0b06a2640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa08c0678f0 0x7fa08c069db0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa0980ae000 tx=0x7fa098008040 comp rx=0 tx=0).stop 2024-04-24T23:08:08.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.434+0000 7fa0b06a2640 1 -- 172.21.15.43:0/4218968862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a80b60f0 msgr2=0x7fa0a8070f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.434+0000 7fa0b06a2640 1 --2- 172.21.15.43:0/4218968862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a80b60f0 0x7fa0a8070f20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400c450 tx=0x7fa0a400c910 comp rx=0 tx=0).stop 2024-04-24T23:08:08.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.434+0000 7fa0aec3f640 1 -- 172.21.15.43:0/4218968862 reap_dead start 2024-04-24T23:08:08.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.434+0000 7fa0b06a2640 1 -- 172.21.15.43:0/4218968862 shutdown_connections 2024-04-24T23:08:08.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.434+0000 7fa0b06a2640 1 -- 172.21.15.43:0/4218968862 >> 172.21.15.43:0/4218968862 conn(0x7fa0a80ba030 msgr2=0x7fa0a813d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:08.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.434+0000 7fa0b06a2640 1 -- 172.21.15.43:0/4218968862 shutdown_connections 2024-04-24T23:08:08.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.434+0000 7fa0b06a2640 1 -- 172.21.15.43:0/4218968862 wait complete. 2024-04-24T23:08:08.451 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-24T23:08:08.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f0467cb2640 1 Processor -- start 2024-04-24T23:08:08.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f0467cb2640 1 -- start start 2024-04-24T23:08:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f0467cb2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f046006f430 0x7f04600b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f0467cb2640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0460073080 0x7f0460145540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f0467cb2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f04600b1d10 0x7f0460145a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f0467cb2640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f04600b68b0 con 0x7f0460073080 2024-04-24T23:08:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f0467cb2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f04600705f0 con 0x7f04600b1d10 2024-04-24T23:08:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f0467cb2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f04600b6b00 con 0x7f046006f430 2024-04-24T23:08:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f046524d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0460073080 0x7f0460145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f046524d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0460073080 0x7f0460145540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54908/0 (socket says 172.21.15.43:54908) 2024-04-24T23:08:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f046524d640 1 -- 172.21.15.43:0/3080594508 learned_addr learned my addr 172.21.15.43:0/3080594508 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f046624f640 1 --2- 172.21.15.43:0/3080594508 >> v2:172.21.15.162:3300/0 conn(0x7f04600b1d10 0x7f0460145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f0465a4e640 1 --2- 172.21.15.43:0/3080594508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f046006f430 0x7f04600b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f046524d640 1 -- 172.21.15.43:0/3080594508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f046006f430 msgr2=0x7f04600b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:08.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f046524d640 1 --2- 172.21.15.43:0/3080594508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f046006f430 0x7f04600b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f046524d640 1 -- 172.21.15.43:0/3080594508 >> v2:172.21.15.162:3300/0 conn(0x7f04600b1d10 msgr2=0x7f0460145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:08.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f046524d640 1 --2- 172.21.15.43:0/3080594508 >> v2:172.21.15.162:3300/0 conn(0x7f04600b1d10 0x7f0460145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.566+0000 7f046524d640 1 -- 172.21.15.43:0/3080594508 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04600b6de0 con 0x7f0460073080 2024-04-24T23:08:08.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.570+0000 7f046524d640 1 --2- 172.21.15.43:0/3080594508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0460073080 0x7f0460145540 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f04600b8c30 tx=0x7f045001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bf0afaf5d94f31 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:08.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.570+0000 7f0464a4c640 1 -- 172.21.15.43:0/3080594508 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04500b1070 con 0x7f0460073080 2024-04-24T23:08:08.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.570+0000 7f0464a4c640 1 -- 172.21.15.43:0/3080594508 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04500a8050 con 0x7f0460073080 2024-04-24T23:08:08.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.570+0000 7f0464a4c640 1 -- 172.21.15.43:0/3080594508 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04500ac860 con 0x7f0460073080 2024-04-24T23:08:08.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.570+0000 7f0467cb2640 1 -- 172.21.15.43:0/3080594508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0460073080 msgr2=0x7f0460145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.570+0000 7f0467cb2640 1 --2- 172.21.15.43:0/3080594508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0460073080 0x7f0460145540 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f04600b8c30 tx=0x7f045001c400 comp rx=0 tx=0).stop 2024-04-24T23:08:08.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.570+0000 7f0467cb2640 1 -- 172.21.15.43:0/3080594508 shutdown_connections 2024-04-24T23:08:08.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.570+0000 7f0467cb2640 1 --2- 172.21.15.43:0/3080594508 >> v2:172.21.15.162:3300/0 conn(0x7f04600b1d10 0x7f0460145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.570+0000 7f0467cb2640 1 --2- 172.21.15.43:0/3080594508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0460073080 0x7f0460145540 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.570+0000 7f0467cb2640 1 --2- 172.21.15.43:0/3080594508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f046006f430 0x7f04600b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.570+0000 7f0467cb2640 1 -- 172.21.15.43:0/3080594508 >> 172.21.15.43:0/3080594508 conn(0x7f04600b7880 msgr2=0x7f04600b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:08.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.570+0000 7f0467cb2640 1 -- 172.21.15.43:0/3080594508 shutdown_connections 2024-04-24T23:08:08.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.570+0000 7f0467cb2640 1 -- 172.21.15.43:0/3080594508 wait complete. 2024-04-24T23:08:08.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.570+0000 7f0467cb2640 1 Processor -- start 2024-04-24T23:08:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.570+0000 7f0467cb2640 1 -- start start 2024-04-24T23:08:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f0467cb2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f046006f430 0x7f04601410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f0467cb2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0460073080 0x7f04600b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f0467cb2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04600b1d10 0x7f04600b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f0467cb2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f04600b5f90 con 0x7f04600b1d10 2024-04-24T23:08:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f0467cb2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f04600703d0 con 0x7f046006f430 2024-04-24T23:08:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f0467cb2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f04600b6110 con 0x7f0460073080 2024-04-24T23:08:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f046624f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04600b1d10 0x7f04600b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f046624f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04600b1d10 0x7f04600b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54918/0 (socket says 172.21.15.43:54918) 2024-04-24T23:08:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f046624f640 1 -- 172.21.15.43:0/3607567904 learned_addr learned my addr 172.21.15.43:0/3607567904 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f0465a4e640 1 --2- 172.21.15.43:0/3607567904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f046006f430 0x7f04601410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f046524d640 1 --2- 172.21.15.43:0/3607567904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0460073080 0x7f04600b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f046624f640 1 -- 172.21.15.43:0/3607567904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0460073080 msgr2=0x7f04600b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f046624f640 1 --2- 172.21.15.43:0/3607567904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0460073080 0x7f04600b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f046624f640 1 -- 172.21.15.43:0/3607567904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f046006f430 msgr2=0x7f04601410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f046624f640 1 --2- 172.21.15.43:0/3607567904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f046006f430 0x7f04601410e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f046624f640 1 -- 172.21.15.43:0/3607567904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0460141780 con 0x7f04600b1d10 2024-04-24T23:08:08.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f0465a4e640 1 --2- 172.21.15.43:0/3607567904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f046006f430 0x7f04601410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:08:08.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f046624f640 1 --2- 172.21.15.43:0/3607567904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04600b1d10 0x7f04600b2c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0458007e60 tx=0x7f045800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:08.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f04567fc640 1 -- 172.21.15.43:0/3607567904 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458014420 con 0x7f04600b1d10 2024-04-24T23:08:08.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f04567fc640 1 -- 172.21.15.43:0/3607567904 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0458019070 con 0x7f04600b1d10 2024-04-24T23:08:08.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f04567fc640 1 -- 172.21.15.43:0/3607567904 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458014820 con 0x7f04600b1d10 2024-04-24T23:08:08.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f0467cb2640 1 -- 172.21.15.43:0/3607567904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04601427d0 con 0x7f04600b1d10 2024-04-24T23:08:08.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f0467cb2640 1 -- 172.21.15.43:0/3607567904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0460142fb0 con 0x7f04600b1d10 2024-04-24T23:08:08.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f0467cb2640 1 -- 172.21.15.43:0/3607567904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f046013ff30 con 0x7f04600b1d10 2024-04-24T23:08:08.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f04567fc640 1 -- 172.21.15.43:0/3607567904 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f04580149c0 con 0x7f04600b1d10 2024-04-24T23:08:08.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f04567fc640 1 --2- 172.21.15.43:0/3607567904 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f04440678c0 0x7f0444069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f04567fc640 1 -- 172.21.15.43:0/3607567904 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f0458086910 con 0x7f04600b1d10 2024-04-24T23:08:08.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.574+0000 7f0465a4e640 1 --2- 172.21.15.43:0/3607567904 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f04440678c0 0x7f0444069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.578+0000 7f0465a4e640 1 --2- 172.21.15.43:0/3607567904 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f04440678c0 0x7f0444069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f045c00aa70 tx=0x7f045c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:08.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.578+0000 7f04567fc640 1 -- 172.21.15.43:0/3607567904 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f0458057060 con 0x7f04600b1d10 2024-04-24T23:08:08.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.742+0000 7f0467cb2640 1 -- 172.21.15.43:0/3607567904 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f0460141950 con 0x7f04440678c0 2024-04-24T23:08:08.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.746+0000 7f04567fc640 1 -- 172.21.15.43:0/3607567904 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0460141950 con 0x7f04440678c0 2024-04-24T23:08:08.746 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 5 to deep-scrub 2024-04-24T23:08:08.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.746+0000 7f0467cb2640 1 -- 172.21.15.43:0/3607567904 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f04440678c0 msgr2=0x7f0444069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.746+0000 7f0467cb2640 1 --2- 172.21.15.43:0/3607567904 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f04440678c0 0x7f0444069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f045c00aa70 tx=0x7f045c008040 comp rx=0 tx=0).stop 2024-04-24T23:08:08.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.746+0000 7f0467cb2640 1 -- 172.21.15.43:0/3607567904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04600b1d10 msgr2=0x7f04600b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.746+0000 7f0467cb2640 1 --2- 172.21.15.43:0/3607567904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04600b1d10 0x7f04600b2c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0458007e60 tx=0x7f045800e4b0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.746+0000 7f0467cb2640 1 -- 172.21.15.43:0/3607567904 shutdown_connections 2024-04-24T23:08:08.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.746+0000 7f0467cb2640 1 --2- 172.21.15.43:0/3607567904 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f04440678c0 0x7f0444069d80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.746+0000 7f0467cb2640 1 --2- 172.21.15.43:0/3607567904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04600b1d10 0x7f04600b2c50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.746+0000 7f0467cb2640 1 --2- 172.21.15.43:0/3607567904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0460073080 0x7f04600b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.746+0000 7f0467cb2640 1 --2- 172.21.15.43:0/3607567904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f046006f430 0x7f04601410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.746+0000 7f0467cb2640 1 -- 172.21.15.43:0/3607567904 >> 172.21.15.43:0/3607567904 conn(0x7f04600b7880 msgr2=0x7f046013c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:08.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.746+0000 7f0467cb2640 1 -- 172.21.15.43:0/3607567904 shutdown_connections 2024-04-24T23:08:08.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.746+0000 7f0467cb2640 1 -- 172.21.15.43:0/3607567904 wait complete. 2024-04-24T23:08:08.764 INFO:tasks.ceph:Scrubbing osd.6 2024-04-24T23:08:08.765 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:08:08.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bfe355640 1 Processor -- start 2024-04-24T23:08:08.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bfe355640 1 -- start start 2024-04-24T23:08:08.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bfe355640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bf8145c10 0x7f2bf8150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bfe355640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf80b5720 con 0x7f2bf8072f40 2024-04-24T23:08:08.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bfe355640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf8073320 con 0x7f2bf806be60 2024-04-24T23:08:08.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bfe355640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf80b61c0 con 0x7f2bf8145c10 2024-04-24T23:08:08.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf7fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f2bf8072f40 0x7f2bf8145500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33916/0 (socket says 172.21.15.43:33916) 2024-04-24T23:08:08.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf7fff640 1 -- 172.21.15.43:0/731033604 learned_addr learned my addr 172.21.15.43:0/731033604 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:08.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf6ffd640 1 -- 172.21.15.43:0/731033604 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467976388 0 0) 0x7f2bf80b5720 con 0x7f2bf8072f40 2024-04-24T23:08:08.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf6ffd640 1 -- 172.21.15.43:0/731033604 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2be0003530 con 0x7f2bf8072f40 2024-04-24T23:08:08.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bfc8f2640 1 --2- 172.21.15.43:0/731033604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bf8145c10 0x7f2bf8150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf6ffd640 1 -- 172.21.15.43:0/731033604 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2301870523 0 0) 0x7f2be0003530 con 0x7f2bf8072f40 2024-04-24T23:08:08.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf6ffd640 1 -- 172.21.15.43:0/731033604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bf8145c10 msgr2=0x7f2bf8150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:08.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf6ffd640 1 --2- 172.21.15.43:0/731033604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bf8145c10 0x7f2bf8150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf6ffd640 1 -- 172.21.15.43:0/731033604 >> v1:172.21.15.162:6789/0 conn(0x7f2bf806be60 legacy=0x7f2bf80b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf6ffd640 1 -- 172.21.15.43:0/731033604 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf80b59c0 con 0x7f2bf8072f40 2024-04-24T23:08:08.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf6ffd640 1 -- 172.21.15.43:0/731033604 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f2be8001680 con 0x7f2bf8072f40 2024-04-24T23:08:08.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf6ffd640 1 -- 172.21.15.43:0/731033604 >> v1:172.21.15.43:6789/0 conn(0x7f2bf8072f40 legacy=0x7f2bf8145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf6ffd640 1 --2- 172.21.15.43:0/731033604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2be00039f0 0x7f2be0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf6ffd640 1 --2- 172.21.15.43:0/731033604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be0004810 0x7f2be0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf6ffd640 1 --2- 172.21.15.43:0/731033604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bf8145c10 0x7f2be000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf6ffd640 1 -- 172.21.15.43:0/731033604 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf80b61c0 con 0x7f2be0004810 2024-04-24T23:08:08.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf6ffd640 1 -- 172.21.15.43:0/731033604 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2be0005530 con 0x7f2be00039f0 2024-04-24T23:08:08.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf6ffd640 1 -- 172.21.15.43:0/731033604 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2be000bf10 con 0x7f2bf8145c10 2024-04-24T23:08:08.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf77fe640 1 --2- 172.21.15.43:0/731033604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be0004810 0x7f2be0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bfc8f2640 1 --2- 172.21.15.43:0/731033604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bf8145c10 0x7f2be000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf7fff640 1 --2- 172.21.15.43:0/731033604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2be00039f0 0x7f2be0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf77fe640 1 -- 172.21.15.43:0/731033604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bf8145c10 msgr2=0x7f2be000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:08.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf77fe640 1 --2- 172.21.15.43:0/731033604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bf8145c10 0x7f2be000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf77fe640 1 -- 172.21.15.43:0/731033604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2be00039f0 msgr2=0x7f2be0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:08.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf77fe640 1 --2- 172.21.15.43:0/731033604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2be00039f0 0x7f2be0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf77fe640 1 -- 172.21.15.43:0/731033604 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be0003530 con 0x7f2be0004810 2024-04-24T23:08:08.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.882+0000 7f2bf7fff640 1 --2- 172.21.15.43:0/731033604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2be00039f0 0x7f2be0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:08.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bf77fe640 1 --2- 172.21.15.43:0/731033604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be0004810 0x7f2be0004c90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2bec001e70 tx=0x7f2bec01c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4498318d355ac6b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:08.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bf6ffd640 1 -- 172.21.15.43:0/731033604 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec001a90 con 0x7f2be0004810 2024-04-24T23:08:08.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bf6ffd640 1 -- 172.21.15.43:0/731033604 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bec003b80 con 0x7f2be0004810 2024-04-24T23:08:08.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bf6ffd640 1 -- 172.21.15.43:0/731033604 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec005080 con 0x7f2be0004810 2024-04-24T23:08:08.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfe355640 1 -- 172.21.15.43:0/731033604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be0004810 msgr2=0x7f2be0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfe355640 1 --2- 172.21.15.43:0/731033604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be0004810 0x7f2be0004c90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2bec001e70 tx=0x7f2bec01c720 comp rx=0 tx=0).stop 2024-04-24T23:08:08.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfc8f2640 1 -- 172.21.15.43:0/731033604 reap_dead start 2024-04-24T23:08:08.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfe355640 1 -- 172.21.15.43:0/731033604 shutdown_connections 2024-04-24T23:08:08.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfe355640 1 -- 172.21.15.43:0/731033604 >> 172.21.15.43:0/731033604 conn(0x7f2bf806c300 msgr2=0x7f2bf806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:08.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfe355640 1 -- 172.21.15.43:0/731033604 shutdown_connections 2024-04-24T23:08:08.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfe355640 1 -- 172.21.15.43:0/731033604 wait complete. 2024-04-24T23:08:08.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfe355640 1 Processor -- start 2024-04-24T23:08:08.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfe355640 1 -- start start 2024-04-24T23:08:08.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfe355640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2be0004810 0x7f2bf813a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfe355640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bf81e3b20 0x7f2bf8072580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfe355640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bf81340f0 0x7f2bf813eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfe355640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8151970 con 0x7f2bf81e3b20 2024-04-24T23:08:08.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfe355640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf81517f0 con 0x7f2be0004810 2024-04-24T23:08:08.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfe355640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf8151af0 con 0x7f2bf81340f0 2024-04-24T23:08:08.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bf77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bf81e3b20 0x7f2bf8072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bf77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bf81e3b20 0x7f2bf8072580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54932/0 (socket says 172.21.15.43:54932) 2024-04-24T23:08:08.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bf77fe640 1 -- 172.21.15.43:0/2951943243 learned_addr learned my addr 172.21.15.43:0/2951943243 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:08.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bf7fff640 1 --2- 172.21.15.43:0/2951943243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2be0004810 0x7f2bf813a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.886+0000 7f2bfc8f2640 1 --2- 172.21.15.43:0/2951943243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bf81340f0 0x7f2bf813eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf77fe640 1 -- 172.21.15.43:0/2951943243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bf81340f0 msgr2=0x7f2bf813eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf77fe640 1 --2- 172.21.15.43:0/2951943243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bf81340f0 0x7f2bf813eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf77fe640 1 -- 172.21.15.43:0/2951943243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2be0004810 msgr2=0x7f2bf813a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf77fe640 1 --2- 172.21.15.43:0/2951943243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2be0004810 0x7f2bf813a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf77fe640 1 -- 172.21.15.43:0/2951943243 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf813a870 con 0x7f2bf81e3b20 2024-04-24T23:08:08.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf77fe640 1 --2- 172.21.15.43:0/2951943243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bf81e3b20 0x7f2bf8072580 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2bec01cc00 tx=0x7f2be0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:08.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf4ff9640 1 -- 172.21.15.43:0/2951943243 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec005030 con 0x7f2bf81e3b20 2024-04-24T23:08:08.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf4ff9640 1 -- 172.21.15.43:0/2951943243 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bec0051d0 con 0x7f2bf81e3b20 2024-04-24T23:08:08.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bfe355640 1 -- 172.21.15.43:0/2951943243 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf813bd70 con 0x7f2bf81e3b20 2024-04-24T23:08:08.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf4ff9640 1 -- 172.21.15.43:0/2951943243 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec005580 con 0x7f2bf81e3b20 2024-04-24T23:08:08.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bfe355640 1 -- 172.21.15.43:0/2951943243 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf8071d80 con 0x7f2bf81e3b20 2024-04-24T23:08:08.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bfe355640 1 -- 172.21.15.43:0/2951943243 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2bf804f580 con 0x7f2bf81e3b20 2024-04-24T23:08:08.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf4ff9640 1 -- 172.21.15.43:0/2951943243 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2bec0b1040 con 0x7f2bf81e3b20 2024-04-24T23:08:08.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf4ff9640 1 --2- 172.21.15.43:0/2951943243 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f2be40678f0 0x7f2be4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf4ff9640 1 -- 172.21.15.43:0/2951943243 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f2bec121100 con 0x7f2bf81e3b20 2024-04-24T23:08:08.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf7fff640 1 --2- 172.21.15.43:0/2951943243 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f2be40678f0 0x7f2be4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf4ff9640 1 --2- 172.21.15.43:0/2951943243 >> [v2:172.21.15.162:6824/4054273326,v1:172.21.15.162:6825/4054273326] conn(0x7f2be4071200 0x7f2be40736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:08.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf4ff9640 1 -- 172.21.15.43:0/2951943243 --> [v2:172.21.15.162:6824/4054273326,v1:172.21.15.162:6825/4054273326] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2bec003b80 con 0x7f2be4071200 2024-04-24T23:08:08.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf4ff9640 1 -- 172.21.15.43:0/2951943243 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2bec121560 con 0x7f2bf81e3b20 2024-04-24T23:08:08.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bfc8f2640 1 --2- 172.21.15.43:0/2951943243 >> [v2:172.21.15.162:6824/4054273326,v1:172.21.15.162:6825/4054273326] conn(0x7f2be4071200 0x7f2be40736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:08.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bf7fff640 1 --2- 172.21.15.43:0/2951943243 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f2be40678f0 0x7f2be4069db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2be8005b00 tx=0x7f2be8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:08.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.890+0000 7f2bfc8f2640 1 --2- 172.21.15.43:0/2951943243 >> [v2:172.21.15.162:6824/4054273326,v1:172.21.15.162:6825/4054273326] conn(0x7f2be4071200 0x7f2be40736a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:08.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.894+0000 7f2bf4ff9640 1 -- 172.21.15.43:0/2951943243 <== osd.6 v2:172.21.15.162:6824/4054273326 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2bec003b80 con 0x7f2be4071200 2024-04-24T23:08:08.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.910+0000 7f2bfe355640 1 -- 172.21.15.43:0/2951943243 --> [v2:172.21.15.162:6824/4054273326,v1:172.21.15.162:6825/4054273326] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2bf80baa60 con 0x7f2be4071200 2024-04-24T23:08:08.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.910+0000 7f2bf4ff9640 1 -- 172.21.15.43:0/2951943243 <== osd.6 v2:172.21.15.162:6824/4054273326 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2bf80baa60 con 0x7f2be4071200 2024-04-24T23:08:08.911 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-24T23:08:08.911 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:08:08.911 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-24T23:08:08.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.910+0000 7f2bfe355640 1 -- 172.21.15.43:0/2951943243 >> [v2:172.21.15.162:6824/4054273326,v1:172.21.15.162:6825/4054273326] conn(0x7f2be4071200 msgr2=0x7f2be40736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.910+0000 7f2bfe355640 1 --2- 172.21.15.43:0/2951943243 >> [v2:172.21.15.162:6824/4054273326,v1:172.21.15.162:6825/4054273326] conn(0x7f2be4071200 0x7f2be40736a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:08.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.910+0000 7f2bfe355640 1 -- 172.21.15.43:0/2951943243 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f2be40678f0 msgr2=0x7f2be4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.910+0000 7f2bfe355640 1 --2- 172.21.15.43:0/2951943243 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f2be40678f0 0x7f2be4069db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2be8005b00 tx=0x7f2be8009040 comp rx=0 tx=0).stop 2024-04-24T23:08:08.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.910+0000 7f2bfe355640 1 -- 172.21.15.43:0/2951943243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bf81e3b20 msgr2=0x7f2bf8072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:08.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.910+0000 7f2bfe355640 1 --2- 172.21.15.43:0/2951943243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bf81e3b20 0x7f2bf8072580 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2bec01cc00 tx=0x7f2be0005840 comp rx=0 tx=0).stop 2024-04-24T23:08:08.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.910+0000 7f2bfc8f2640 1 -- 172.21.15.43:0/2951943243 reap_dead start 2024-04-24T23:08:08.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.910+0000 7f2bfe355640 1 -- 172.21.15.43:0/2951943243 shutdown_connections 2024-04-24T23:08:08.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.910+0000 7f2bfe355640 1 -- 172.21.15.43:0/2951943243 >> 172.21.15.43:0/2951943243 conn(0x7f2bf806c300 msgr2=0x7f2bf8144bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:08.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.910+0000 7f2bfe355640 1 -- 172.21.15.43:0/2951943243 shutdown_connections 2024-04-24T23:08:08.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:08.910+0000 7f2bfe355640 1 -- 172.21.15.43:0/2951943243 wait complete. 2024-04-24T23:08:08.926 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-24T23:08:09.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a59845640 1 Processor -- start 2024-04-24T23:08:09.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a59845640 1 -- start start 2024-04-24T23:08:09.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a59845640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5a540b5b10 0x7f5a54145e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a59845640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a54149850 con 0x7f5a540b80e0 2024-04-24T23:08:09.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a59845640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a54062270 con 0x7f5a54061e90 2024-04-24T23:08:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a59845640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5a540b7c50 con 0x7f5a540b5b10 2024-04-24T23:08:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a537fe640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5a540b80e0 0x7f5a5414fe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33920/0 (socket says 172.21.15.43:33920) 2024-04-24T23:08:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a537fe640 1 -- 172.21.15.43:0/1462108505 learned_addr learned my addr 172.21.15.43:0/1462108505 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a527fc640 1 --2- 172.21.15.43:0/1462108505 >> v2:172.21.15.162:3300/0 conn(0x7f5a540b5b10 0x7f5a54145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a51ffb640 1 -- 172.21.15.43:0/1462108505 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3210643432 0 0) 0x7f5a54149850 con 0x7f5a540b80e0 2024-04-24T23:08:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a51ffb640 1 -- 172.21.15.43:0/1462108505 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a3c003530 con 0x7f5a540b80e0 2024-04-24T23:08:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a51ffb640 1 -- 172.21.15.43:0/1462108505 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3388651602 0 0) 0x7f5a3c003530 con 0x7f5a540b80e0 2024-04-24T23:08:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a51ffb640 1 -- 172.21.15.43:0/1462108505 >> v2:172.21.15.162:3300/0 conn(0x7f5a540b5b10 msgr2=0x7f5a54145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a51ffb640 1 --2- 172.21.15.43:0/1462108505 >> v2:172.21.15.162:3300/0 conn(0x7f5a540b5b10 0x7f5a54145e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a51ffb640 1 -- 172.21.15.43:0/1462108505 >> v1:172.21.15.162:6789/0 conn(0x7f5a54061e90 legacy=0x7f5a54149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a51ffb640 1 -- 172.21.15.43:0/1462108505 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a54146380 con 0x7f5a540b80e0 2024-04-24T23:08:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a51ffb640 1 -- 172.21.15.43:0/1462108505 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f5a4c001a00 con 0x7f5a540b80e0 2024-04-24T23:08:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a51ffb640 1 -- 172.21.15.43:0/1462108505 >> v1:172.21.15.43:6789/0 conn(0x7f5a540b80e0 legacy=0x7f5a5414fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a51ffb640 1 --2- 172.21.15.43:0/1462108505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a3c0039c0 0x7f5a3c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a51ffb640 1 --2- 172.21.15.43:0/1462108505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3c004810 0x7f5a3c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a51ffb640 1 --2- 172.21.15.43:0/1462108505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a3c0052f0 0x7f5a3c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a51ffb640 1 -- 172.21.15.43:0/1462108505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5a540b7c50 con 0x7f5a3c0052f0 2024-04-24T23:08:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a51ffb640 1 -- 172.21.15.43:0/1462108505 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c00c1c0 con 0x7f5a3c004810 2024-04-24T23:08:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a51ffb640 1 -- 172.21.15.43:0/1462108505 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3c00c3c0 con 0x7f5a3c0039c0 2024-04-24T23:08:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a537fe640 1 --2- 172.21.15.43:0/1462108505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a3c0052f0 0x7f5a3c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a527fc640 1 --2- 172.21.15.43:0/1462108505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3c004810 0x7f5a3c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a52ffd640 1 --2- 172.21.15.43:0/1462108505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a3c0039c0 0x7f5a3c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a537fe640 1 -- 172.21.15.43:0/1462108505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a3c0039c0 msgr2=0x7f5a3c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a537fe640 1 --2- 172.21.15.43:0/1462108505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a3c0039c0 0x7f5a3c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a537fe640 1 -- 172.21.15.43:0/1462108505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3c004810 msgr2=0x7f5a3c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a537fe640 1 --2- 172.21.15.43:0/1462108505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3c004810 0x7f5a3c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.038+0000 7f5a537fe640 1 -- 172.21.15.43:0/1462108505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3c003530 con 0x7f5a3c0052f0 2024-04-24T23:08:09.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a537fe640 1 -- 172.21.15.43:0/1462108505 reap_dead start 2024-04-24T23:08:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a537fe640 1 --2- 172.21.15.43:0/1462108505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a3c0052f0 0x7f5a3c00b9d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c002240 tx=0x7f5a4c01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae496737f1364c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a51ffb640 1 -- 172.21.15.43:0/1462108505 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c00a4a0 con 0x7f5a3c0052f0 2024-04-24T23:08:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a51ffb640 1 -- 172.21.15.43:0/1462108505 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a4c0ad430 con 0x7f5a3c0052f0 2024-04-24T23:08:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a51ffb640 1 -- 172.21.15.43:0/1462108505 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c0ad800 con 0x7f5a3c0052f0 2024-04-24T23:08:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a59845640 1 -- 172.21.15.43:0/1462108505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a3c0052f0 msgr2=0x7f5a3c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a59845640 1 --2- 172.21.15.43:0/1462108505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a3c0052f0 0x7f5a3c00b9d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c002240 tx=0x7f5a4c01d360 comp rx=0 tx=0).stop 2024-04-24T23:08:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a59845640 1 -- 172.21.15.43:0/1462108505 shutdown_connections 2024-04-24T23:08:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a59845640 1 --2- 172.21.15.43:0/1462108505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a3c0052f0 0x7f5a3c00b9d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a59845640 1 -- 172.21.15.43:0/1462108505 >> 172.21.15.43:0/1462108505 conn(0x7f5a5409b250 msgr2=0x7f5a5409b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a59845640 1 -- 172.21.15.43:0/1462108505 shutdown_connections 2024-04-24T23:08:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a59845640 1 -- 172.21.15.43:0/1462108505 wait complete. 2024-04-24T23:08:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a59845640 1 Processor -- start 2024-04-24T23:08:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a59845640 1 -- start start 2024-04-24T23:08:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a59845640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3c0052f0 0x7f5a541df470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a59845640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a541df9b0 0x7f5a541dbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a59845640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a541dc440 0x7f5a541dc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a59845640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5a541461d0 con 0x7f5a541df9b0 2024-04-24T23:08:09.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a59845640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a54146050 con 0x7f5a3c0052f0 2024-04-24T23:08:09.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a59845640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5a541455e0 con 0x7f5a541dc440 2024-04-24T23:08:09.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a527fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a541df9b0 0x7f5a541dbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a527fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a541df9b0 0x7f5a541dbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54944/0 (socket says 172.21.15.43:54944) 2024-04-24T23:08:09.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a527fc640 1 -- 172.21.15.43:0/2682245804 learned_addr learned my addr 172.21.15.43:0/2682245804 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:09.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a52ffd640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3c0052f0 0x7f5a541df470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a537fe640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a541dc440 0x7f5a541dc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a527fc640 1 -- 172.21.15.43:0/2682245804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a541dc440 msgr2=0x7f5a541dc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a527fc640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a541dc440 0x7f5a541dc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a527fc640 1 -- 172.21.15.43:0/2682245804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3c0052f0 msgr2=0x7f5a541df470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a527fc640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3c0052f0 0x7f5a541df470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a527fc640 1 -- 172.21.15.43:0/2682245804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a541404a0 con 0x7f5a541df9b0 2024-04-24T23:08:09.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a52ffd640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3c0052f0 0x7f5a541df470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:08:09.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.042+0000 7f5a537fe640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a541dc440 0x7f5a541dc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:09.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.046+0000 7f5a527fc640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a541df9b0 0x7f5a541dbf00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5a480115c0 tx=0x7f5a48011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:09.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.046+0000 7f5a3bfff640 1 -- 172.21.15.43:0/2682245804 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4800f8f0 con 0x7f5a541df9b0 2024-04-24T23:08:09.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.046+0000 7f5a3bfff640 1 -- 172.21.15.43:0/2682245804 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a4800fa90 con 0x7f5a541df9b0 2024-04-24T23:08:09.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.046+0000 7f5a59845640 1 -- 172.21.15.43:0/2682245804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a54097530 con 0x7f5a541df9b0 2024-04-24T23:08:09.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.046+0000 7f5a3bfff640 1 -- 172.21.15.43:0/2682245804 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4800fe40 con 0x7f5a541df9b0 2024-04-24T23:08:09.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.046+0000 7f5a59845640 1 -- 172.21.15.43:0/2682245804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a54070d20 con 0x7f5a541df9b0 2024-04-24T23:08:09.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.046+0000 7f5a59845640 1 -- 172.21.15.43:0/2682245804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a54071970 con 0x7f5a541df9b0 2024-04-24T23:08:09.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.046+0000 7f5a3bfff640 1 -- 172.21.15.43:0/2682245804 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5a48015460 con 0x7f5a541df9b0 2024-04-24T23:08:09.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.046+0000 7f5a3bfff640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5a400678c0 0x7f5a40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.046+0000 7f5a3bfff640 1 -- 172.21.15.43:0/2682245804 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f5a48086940 con 0x7f5a541df9b0 2024-04-24T23:08:09.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.046+0000 7f5a52ffd640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5a400678c0 0x7f5a40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.046+0000 7f5a52ffd640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5a400678c0 0x7f5a40069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5a5409f670 tx=0x7f5a44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:09.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.050+0000 7f5a3bfff640 1 -- 172.21.15.43:0/2682245804 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5a48019030 con 0x7f5a541df9b0 2024-04-24T23:08:09.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.210+0000 7f5a59845640 1 -- 172.21.15.43:0/2682245804 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f5a5404f580 con 0x7f5a400678c0 2024-04-24T23:08:09.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.214+0000 7f5a3bfff640 1 -- 172.21.15.43:0/2682245804 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5a5404f580 con 0x7f5a400678c0 2024-04-24T23:08:09.214 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 6 to deep-scrub 2024-04-24T23:08:09.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.214+0000 7f5a59845640 1 -- 172.21.15.43:0/2682245804 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5a400678c0 msgr2=0x7f5a40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.214+0000 7f5a59845640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5a400678c0 0x7f5a40069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5a5409f670 tx=0x7f5a44009040 comp rx=0 tx=0).stop 2024-04-24T23:08:09.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.214+0000 7f5a59845640 1 -- 172.21.15.43:0/2682245804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a541df9b0 msgr2=0x7f5a541dbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.214+0000 7f5a59845640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a541df9b0 0x7f5a541dbf00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5a480115c0 tx=0x7f5a48011a80 comp rx=0 tx=0).stop 2024-04-24T23:08:09.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.214+0000 7f5a59845640 1 -- 172.21.15.43:0/2682245804 shutdown_connections 2024-04-24T23:08:09.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.214+0000 7f5a59845640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f5a400678c0 0x7f5a40069d80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.214+0000 7f5a59845640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a541dc440 0x7f5a541dc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.214+0000 7f5a59845640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a541df9b0 0x7f5a541dbf00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.214+0000 7f5a59845640 1 --2- 172.21.15.43:0/2682245804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3c0052f0 0x7f5a541df470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.214+0000 7f5a59845640 1 -- 172.21.15.43:0/2682245804 >> 172.21.15.43:0/2682245804 conn(0x7f5a5409b250 msgr2=0x7f5a540b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:09.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.214+0000 7f5a59845640 1 -- 172.21.15.43:0/2682245804 shutdown_connections 2024-04-24T23:08:09.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.214+0000 7f5a59845640 1 -- 172.21.15.43:0/2682245804 wait complete. 2024-04-24T23:08:09.233 INFO:tasks.ceph:Scrubbing osd.7 2024-04-24T23:08:09.233 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-24T23:08:09.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9f58cc640 1 Processor -- start 2024-04-24T23:08:09.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9f58cc640 1 -- start start 2024-04-24T23:08:09.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9f58cc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9f006be60 0x7fc9f00b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9f58cc640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9f00b5720 con 0x7fc9f0072f40 2024-04-24T23:08:09.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9f58cc640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9f0073320 con 0x7fc9f0145c10 2024-04-24T23:08:09.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9f58cc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f00b61c0 con 0x7fc9f006be60 2024-04-24T23:08:09.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9eeffd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc9f0072f40 0x7fc9f0145500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33932/0 (socket says 172.21.15.43:33932) 2024-04-24T23:08:09.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9eeffd640 1 -- 172.21.15.43:0/3622809627 learned_addr learned my addr 172.21.15.43:0/3622809627 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:09.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9e7fff640 1 --2- 172.21.15.43:0/3622809627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9f006be60 0x7fc9f00b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1400617210 0 0) 0x7fc9f00b5720 con 0x7fc9f0072f40 2024-04-24T23:08:09.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9dc003530 con 0x7fc9f0072f40 2024-04-24T23:08:09.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 791737193 0 0) 0x7fc9f0073320 con 0x7fc9f0145c10 2024-04-24T23:08:09.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9f00b5720 con 0x7fc9f0145c10 2024-04-24T23:08:09.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 562966036 0 0) 0x7fc9dc003530 con 0x7fc9f0072f40 2024-04-24T23:08:09.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9f006be60 msgr2=0x7fc9f00b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:09.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 --2- 172.21.15.43:0/3622809627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9f006be60 0x7fc9f00b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 >> v1:172.21.15.162:6789/0 conn(0x7fc9f0145c10 legacy=0x7fc9f014fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f00b59c0 con 0x7fc9f0072f40 2024-04-24T23:08:09.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7fc9e0001600 con 0x7fc9f0072f40 2024-04-24T23:08:09.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 >> v1:172.21.15.43:6789/0 conn(0x7fc9f0072f40 legacy=0x7fc9f0145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 --2- 172.21.15.43:0/3622809627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9dc003b80 0x7fc9dc003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 --2- 172.21.15.43:0/3622809627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc004810 0x7fc9dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 --2- 172.21.15.43:0/3622809627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9f006be60 0x7fc9dc005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f00b61c0 con 0x7fc9dc004810 2024-04-24T23:08:09.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc00bb60 con 0x7fc9dc003b80 2024-04-24T23:08:09.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc9dc00bd60 con 0x7fc9f006be60 2024-04-24T23:08:09.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9e7fff640 1 --2- 172.21.15.43:0/3622809627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc004810 0x7fc9dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9eeffd640 1 --2- 172.21.15.43:0/3622809627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9dc003b80 0x7fc9dc003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9e7fff640 1 -- 172.21.15.43:0/3622809627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9f006be60 msgr2=0x7fc9dc005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:09.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9e7fff640 1 --2- 172.21.15.43:0/3622809627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9f006be60 0x7fc9dc005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9e7fff640 1 -- 172.21.15.43:0/3622809627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9dc003b80 msgr2=0x7fc9dc003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:09.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9e7fff640 1 --2- 172.21.15.43:0/3622809627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9dc003b80 0x7fc9dc003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9e7fff640 1 -- 172.21.15.43:0/3622809627 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc003530 con 0x7fc9dc004810 2024-04-24T23:08:09.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.350+0000 7fc9eeffd640 1 --2- 172.21.15.43:0/3622809627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9dc003b80 0x7fc9dc003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:09.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.354+0000 7fc9e7fff640 1 --2- 172.21.15.43:0/3622809627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc004810 0x7fc9dc004c90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009ae0 tx=0x7fc9d801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223794b05527b145 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:09.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.354+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80b2070 con 0x7fc9dc004810 2024-04-24T23:08:09.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.354+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d80a5590 con 0x7fc9dc004810 2024-04-24T23:08:09.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.354+0000 7fc9ee7fc640 1 -- 172.21.15.43:0/3622809627 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80096b0 con 0x7fc9dc004810 2024-04-24T23:08:09.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.354+0000 7fc9f58cc640 1 -- 172.21.15.43:0/3622809627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc004810 msgr2=0x7fc9dc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.354+0000 7fc9f58cc640 1 --2- 172.21.15.43:0/3622809627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc004810 0x7fc9dc004c90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009ae0 tx=0x7fc9d801cab0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.354+0000 7fc9ef7fe640 1 -- 172.21.15.43:0/3622809627 reap_dead start 2024-04-24T23:08:09.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.354+0000 7fc9f58cc640 1 -- 172.21.15.43:0/3622809627 shutdown_connections 2024-04-24T23:08:09.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.354+0000 7fc9f58cc640 1 -- 172.21.15.43:0/3622809627 >> 172.21.15.43:0/3622809627 conn(0x7fc9f006c300 msgr2=0x7fc9f006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:09.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.354+0000 7fc9f58cc640 1 -- 172.21.15.43:0/3622809627 shutdown_connections 2024-04-24T23:08:09.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.354+0000 7fc9f58cc640 1 -- 172.21.15.43:0/3622809627 wait complete. 2024-04-24T23:08:09.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.354+0000 7fc9f58cc640 1 Processor -- start 2024-04-24T23:08:09.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.354+0000 7fc9f58cc640 1 -- start start 2024-04-24T23:08:09.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9f58cc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9dc004810 0x7fc9f00ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9f58cc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9f0139880 0x7fc9f01e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9f58cc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9f0070ad0 0x7fc9f0070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9f58cc640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f0151870 con 0x7fc9f0070ad0 2024-04-24T23:08:09.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9f58cc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01516f0 con 0x7fc9f0139880 2024-04-24T23:08:09.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9f58cc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f01519f0 con 0x7fc9dc004810 2024-04-24T23:08:09.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ef7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9f0070ad0 0x7fc9f0070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ef7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9f0070ad0 0x7fc9f0070f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54962/0 (socket says 172.21.15.43:54962) 2024-04-24T23:08:09.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ef7fe640 1 -- 172.21.15.43:0/368005456 learned_addr learned my addr 172.21.15.43:0/368005456 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:09.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9eeffd640 1 --2- 172.21.15.43:0/368005456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9dc004810 0x7fc9f00ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9e7fff640 1 --2- 172.21.15.43:0/368005456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9f0139880 0x7fc9f01e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ef7fe640 1 -- 172.21.15.43:0/368005456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9dc004810 msgr2=0x7fc9f00ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ef7fe640 1 --2- 172.21.15.43:0/368005456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9dc004810 0x7fc9f00ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ef7fe640 1 -- 172.21.15.43:0/368005456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9f0139880 msgr2=0x7fc9f01e3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ef7fe640 1 --2- 172.21.15.43:0/368005456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9f0139880 0x7fc9f01e3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ef7fe640 1 -- 172.21.15.43:0/368005456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f00aded0 con 0x7fc9f0070ad0 2024-04-24T23:08:09.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ef7fe640 1 --2- 172.21.15.43:0/368005456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9f0070ad0 0x7fc9f0070f50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0146040 tx=0x7fc9e800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:09.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ecff9640 1 -- 172.21.15.43:0/368005456 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8003980 con 0x7fc9f0070ad0 2024-04-24T23:08:09.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ecff9640 1 -- 172.21.15.43:0/368005456 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e8003b60 con 0x7fc9f0070ad0 2024-04-24T23:08:09.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9f58cc640 1 -- 172.21.15.43:0/368005456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f0139ce0 con 0x7fc9f0070ad0 2024-04-24T23:08:09.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ecff9640 1 -- 172.21.15.43:0/368005456 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8004020 con 0x7fc9f0070ad0 2024-04-24T23:08:09.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9f58cc640 1 -- 172.21.15.43:0/368005456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f00ae190 con 0x7fc9f0070ad0 2024-04-24T23:08:09.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9f58cc640 1 -- 172.21.15.43:0/368005456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9f004f580 con 0x7fc9f0070ad0 2024-04-24T23:08:09.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ecff9640 1 -- 172.21.15.43:0/368005456 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc9e80041c0 con 0x7fc9f0070ad0 2024-04-24T23:08:09.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ecff9640 1 --2- 172.21.15.43:0/368005456 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc9d00678f0 0x7fc9d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ecff9640 1 -- 172.21.15.43:0/368005456 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fc9e8085c20 con 0x7fc9f0070ad0 2024-04-24T23:08:09.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9eeffd640 1 --2- 172.21.15.43:0/368005456 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc9d00678f0 0x7fc9d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ecff9640 1 --2- 172.21.15.43:0/368005456 >> [v2:172.21.15.162:6802/2526900120,v1:172.21.15.162:6804/2526900120] conn(0x7fc9d0071210 0x7fc9d00736b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ecff9640 1 -- 172.21.15.43:0/368005456 --> [v2:172.21.15.162:6802/2526900120,v1:172.21.15.162:6804/2526900120] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9d0073d80 con 0x7fc9d0071210 2024-04-24T23:08:09.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9ecff9640 1 -- 172.21.15.43:0/368005456 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc9e80860b0 con 0x7fc9f0070ad0 2024-04-24T23:08:09.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9eeffd640 1 --2- 172.21.15.43:0/368005456 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc9d00678f0 0x7fc9d0069db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0001000 tx=0x7fc9e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:09.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.358+0000 7fc9e7fff640 1 --2- 172.21.15.43:0/368005456 >> [v2:172.21.15.162:6802/2526900120,v1:172.21.15.162:6804/2526900120] conn(0x7fc9d0071210 0x7fc9d00736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.362+0000 7fc9e7fff640 1 --2- 172.21.15.43:0/368005456 >> [v2:172.21.15.162:6802/2526900120,v1:172.21.15.162:6804/2526900120] conn(0x7fc9d0071210 0x7fc9d00736b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:09.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.362+0000 7fc9ecff9640 1 -- 172.21.15.43:0/368005456 <== osd.7 v2:172.21.15.162:6802/2526900120 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9d0073d80 con 0x7fc9d0071210 2024-04-24T23:08:09.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.374+0000 7fc9f58cc640 1 -- 172.21.15.43:0/368005456 --> [v2:172.21.15.162:6802/2526900120,v1:172.21.15.162:6804/2526900120] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc9f00baa60 con 0x7fc9d0071210 2024-04-24T23:08:09.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.374+0000 7fc9ecff9640 1 -- 172.21.15.43:0/368005456 <== osd.7 v2:172.21.15.162:6802/2526900120 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc9f00baa60 con 0x7fc9d0071210 2024-04-24T23:08:09.378 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-24T23:08:09.378 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T23:08:09.378 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-24T23:08:09.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.374+0000 7fc9f58cc640 1 -- 172.21.15.43:0/368005456 >> [v2:172.21.15.162:6802/2526900120,v1:172.21.15.162:6804/2526900120] conn(0x7fc9d0071210 msgr2=0x7fc9d00736b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.378+0000 7fc9f58cc640 1 --2- 172.21.15.43:0/368005456 >> [v2:172.21.15.162:6802/2526900120,v1:172.21.15.162:6804/2526900120] conn(0x7fc9d0071210 0x7fc9d00736b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.378+0000 7fc9f58cc640 1 -- 172.21.15.43:0/368005456 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc9d00678f0 msgr2=0x7fc9d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.378+0000 7fc9f58cc640 1 --2- 172.21.15.43:0/368005456 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc9d00678f0 0x7fc9d0069db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0001000 tx=0x7fc9e0009040 comp rx=0 tx=0).stop 2024-04-24T23:08:09.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.378+0000 7fc9f58cc640 1 -- 172.21.15.43:0/368005456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9f0070ad0 msgr2=0x7fc9f0070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.378+0000 7fc9f58cc640 1 --2- 172.21.15.43:0/368005456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9f0070ad0 0x7fc9f0070f50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0146040 tx=0x7fc9e800cad0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.378+0000 7fc9ef7fe640 1 -- 172.21.15.43:0/368005456 reap_dead start 2024-04-24T23:08:09.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.378+0000 7fc9f58cc640 1 -- 172.21.15.43:0/368005456 shutdown_connections 2024-04-24T23:08:09.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.378+0000 7fc9f58cc640 1 -- 172.21.15.43:0/368005456 >> 172.21.15.43:0/368005456 conn(0x7fc9f006c300 msgr2=0x7fc9f00b6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:09.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.378+0000 7fc9f58cc640 1 -- 172.21.15.43:0/368005456 shutdown_connections 2024-04-24T23:08:09.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.378+0000 7fc9f58cc640 1 -- 172.21.15.43:0/368005456 wait complete. 2024-04-24T23:08:09.393 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-24T23:08:09.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.506+0000 7efeaf1c8640 1 Processor -- start 2024-04-24T23:08:09.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.506+0000 7efeaf1c8640 1 -- start start 2024-04-24T23:08:09.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.506+0000 7efeaf1c8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efea80b80e0 0x7efea80b8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.506+0000 7efeaf1c8640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efea8146550 con 0x7efea80b5b10 2024-04-24T23:08:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.506+0000 7efeaf1c8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efea8149850 con 0x7efea8061e90 2024-04-24T23:08:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.506+0000 7efeaf1c8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efea80b7c50 con 0x7efea80b80e0 2024-04-24T23:08:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.506+0000 7efea7fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7efea80b5b10 0x7efea8145e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33942/0 (socket says 172.21.15.43:33942) 2024-04-24T23:08:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.506+0000 7efea7fff640 1 -- 172.21.15.43:0/882114005 learned_addr learned my addr 172.21.15.43:0/882114005 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.506+0000 7efead765640 1 --2- 172.21.15.43:0/882114005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efea80b80e0 0x7efea80b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.506+0000 7efea77fe640 1 -- 172.21.15.43:0/882114005 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4292894867 0 0) 0x7efea8146550 con 0x7efea80b5b10 2024-04-24T23:08:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 -- 172.21.15.43:0/882114005 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe98003530 con 0x7efea80b5b10 2024-04-24T23:08:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 -- 172.21.15.43:0/882114005 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1666016525 0 0) 0x7efe98003530 con 0x7efea80b5b10 2024-04-24T23:08:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 -- 172.21.15.43:0/882114005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efea80b80e0 msgr2=0x7efea80b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 --2- 172.21.15.43:0/882114005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efea80b80e0 0x7efea80b8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 -- 172.21.15.43:0/882114005 >> v1:172.21.15.162:6789/0 conn(0x7efea8061e90 legacy=0x7efea8149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 -- 172.21.15.43:0/882114005 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea8062270 con 0x7efea80b5b10 2024-04-24T23:08:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 -- 172.21.15.43:0/882114005 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7efe94001800 con 0x7efea80b5b10 2024-04-24T23:08:09.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 -- 172.21.15.43:0/882114005 >> v1:172.21.15.43:6789/0 conn(0x7efea80b5b10 legacy=0x7efea8145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 --2- 172.21.15.43:0/882114005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe980039f0 0x7efe98003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 --2- 172.21.15.43:0/882114005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe98004810 0x7efe98004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 --2- 172.21.15.43:0/882114005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efea80b80e0 0x7efe980052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 -- 172.21.15.43:0/882114005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efea80b7c50 con 0x7efe980039f0 2024-04-24T23:08:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 -- 172.21.15.43:0/882114005 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efe9800bbc0 con 0x7efe98004810 2024-04-24T23:08:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 -- 172.21.15.43:0/882114005 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efe9800bdc0 con 0x7efea80b80e0 2024-04-24T23:08:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efeacf64640 1 --2- 172.21.15.43:0/882114005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe980039f0 0x7efe98003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea7fff640 1 --2- 172.21.15.43:0/882114005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe98004810 0x7efe98004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efeacf64640 1 -- 172.21.15.43:0/882114005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efea80b80e0 msgr2=0x7efe980052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efeacf64640 1 --2- 172.21.15.43:0/882114005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efea80b80e0 0x7efe980052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efeacf64640 1 -- 172.21.15.43:0/882114005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe98004810 msgr2=0x7efe98004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efeacf64640 1 --2- 172.21.15.43:0/882114005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe98004810 0x7efe98004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efeacf64640 1 -- 172.21.15.43:0/882114005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe98003530 con 0x7efe980039f0 2024-04-24T23:08:09.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea7fff640 1 --2- 172.21.15.43:0/882114005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe98004810 0x7efe98004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:09.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efeacf64640 1 --2- 172.21.15.43:0/882114005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe980039f0 0x7efe98003e10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7efe9c001780 tx=0x7efe9c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9c0eca76b1a9d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 -- 172.21.15.43:0/882114005 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c0013a0 con 0x7efe980039f0 2024-04-24T23:08:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 -- 172.21.15.43:0/882114005 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe9c0052f0 con 0x7efe980039f0 2024-04-24T23:08:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efea77fe640 1 -- 172.21.15.43:0/882114005 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c003840 con 0x7efe980039f0 2024-04-24T23:08:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efeaf1c8640 1 -- 172.21.15.43:0/882114005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe980039f0 msgr2=0x7efe98003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efeaf1c8640 1 --2- 172.21.15.43:0/882114005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe980039f0 0x7efe98003e10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7efe9c001780 tx=0x7efe9c01c420 comp rx=0 tx=0).stop 2024-04-24T23:08:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efead765640 1 -- 172.21.15.43:0/882114005 reap_dead start 2024-04-24T23:08:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efeaf1c8640 1 -- 172.21.15.43:0/882114005 shutdown_connections 2024-04-24T23:08:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efeaf1c8640 1 -- 172.21.15.43:0/882114005 >> 172.21.15.43:0/882114005 conn(0x7efea809b250 msgr2=0x7efea809b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efeaf1c8640 1 -- 172.21.15.43:0/882114005 shutdown_connections 2024-04-24T23:08:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.510+0000 7efeaf1c8640 1 -- 172.21.15.43:0/882114005 wait complete. 2024-04-24T23:08:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efeaf1c8640 1 Processor -- start 2024-04-24T23:08:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efeaf1c8640 1 -- start start 2024-04-24T23:08:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efeaf1c8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe980039f0 0x7efea8141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efeaf1c8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea81e1df0 0x7efea81de820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efeaf1c8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efea81ded60 0x7efea80b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efeaf1c8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efea81518b0 con 0x7efea81ded60 2024-04-24T23:08:09.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efeaf1c8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efea81455e0 con 0x7efea81e1df0 2024-04-24T23:08:09.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efeaf1c8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efea8151a30 con 0x7efe980039f0 2024-04-24T23:08:09.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efead765640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efea81ded60 0x7efea80b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efead765640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efea81ded60 0x7efea80b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54978/0 (socket says 172.21.15.43:54978) 2024-04-24T23:08:09.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efead765640 1 -- 172.21.15.43:0/3637751806 learned_addr learned my addr 172.21.15.43:0/3637751806 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:09.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efeacf64640 1 --2- 172.21.15.43:0/3637751806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe980039f0 0x7efea8141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efea7fff640 1 --2- 172.21.15.43:0/3637751806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea81e1df0 0x7efea81de820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efead765640 1 -- 172.21.15.43:0/3637751806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe980039f0 msgr2=0x7efea8141bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efead765640 1 --2- 172.21.15.43:0/3637751806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe980039f0 0x7efea8141bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efead765640 1 -- 172.21.15.43:0/3637751806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea81e1df0 msgr2=0x7efea81de820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efead765640 1 --2- 172.21.15.43:0/3637751806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea81e1df0 0x7efea81de820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efead765640 1 -- 172.21.15.43:0/3637751806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea81df1e0 con 0x7efea81ded60 2024-04-24T23:08:09.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efead765640 1 --2- 172.21.15.43:0/3637751806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efea81ded60 0x7efea80b2d30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efea80b84c0 tx=0x7efea000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:09.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efea57fa640 1 -- 172.21.15.43:0/3637751806 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0018020 con 0x7efea81ded60 2024-04-24T23:08:09.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efea57fa640 1 -- 172.21.15.43:0/3637751806 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea000ba80 con 0x7efea81ded60 2024-04-24T23:08:09.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efeaf1c8640 1 -- 172.21.15.43:0/3637751806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea81e2330 con 0x7efea81ded60 2024-04-24T23:08:09.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efea57fa640 1 -- 172.21.15.43:0/3637751806 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea000be50 con 0x7efea81ded60 2024-04-24T23:08:09.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efeaf1c8640 1 -- 172.21.15.43:0/3637751806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea8143240 con 0x7efea81ded60 2024-04-24T23:08:09.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.514+0000 7efeaf1c8640 1 -- 172.21.15.43:0/3637751806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efea804f580 con 0x7efea81ded60 2024-04-24T23:08:09.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.518+0000 7efea57fa640 1 -- 172.21.15.43:0/3637751806 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efea001b020 con 0x7efea81ded60 2024-04-24T23:08:09.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.518+0000 7efea57fa640 1 --2- 172.21.15.43:0/3637751806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7efe8c067a90 0x7efe8c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.518+0000 7efeacf64640 1 --2- 172.21.15.43:0/3637751806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7efe8c067a90 0x7efe8c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.518+0000 7efea57fa640 1 -- 172.21.15.43:0/3637751806 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7efea0086ac0 con 0x7efea81ded60 2024-04-24T23:08:09.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.518+0000 7efeacf64640 1 --2- 172.21.15.43:0/3637751806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7efe8c067a90 0x7efe8c069f50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efe9c001750 tx=0x7efe9c0011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:09.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.522+0000 7efea57fa640 1 -- 172.21.15.43:0/3637751806 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7efea0022030 con 0x7efea81ded60 2024-04-24T23:08:09.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.686+0000 7efeaf1c8640 1 -- 172.21.15.43:0/3637751806 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7efea809bf40 con 0x7efe8c067a90 2024-04-24T23:08:09.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.686+0000 7efea57fa640 1 -- 172.21.15.43:0/3637751806 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7efea809bf40 con 0x7efe8c067a90 2024-04-24T23:08:09.688 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 7 to deep-scrub 2024-04-24T23:08:09.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.686+0000 7efeaf1c8640 1 -- 172.21.15.43:0/3637751806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7efe8c067a90 msgr2=0x7efe8c069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.686+0000 7efeaf1c8640 1 --2- 172.21.15.43:0/3637751806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7efe8c067a90 0x7efe8c069f50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efe9c001750 tx=0x7efe9c0011a0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.686+0000 7efeaf1c8640 1 -- 172.21.15.43:0/3637751806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efea81ded60 msgr2=0x7efea80b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.686+0000 7efeaf1c8640 1 --2- 172.21.15.43:0/3637751806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efea81ded60 0x7efea80b2d30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efea80b84c0 tx=0x7efea000b480 comp rx=0 tx=0).stop 2024-04-24T23:08:09.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.686+0000 7efeaf1c8640 1 -- 172.21.15.43:0/3637751806 shutdown_connections 2024-04-24T23:08:09.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.686+0000 7efeaf1c8640 1 --2- 172.21.15.43:0/3637751806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7efe8c067a90 0x7efe8c069f50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.686+0000 7efeaf1c8640 1 --2- 172.21.15.43:0/3637751806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efea81ded60 0x7efea80b2d30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.686+0000 7efeaf1c8640 1 --2- 172.21.15.43:0/3637751806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea81e1df0 0x7efea81de820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.686+0000 7efeaf1c8640 1 --2- 172.21.15.43:0/3637751806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe980039f0 0x7efea8141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.686+0000 7efeaf1c8640 1 -- 172.21.15.43:0/3637751806 >> 172.21.15.43:0/3637751806 conn(0x7efea809b250 msgr2=0x7efea8145c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:09.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.690+0000 7efeaf1c8640 1 -- 172.21.15.43:0/3637751806 shutdown_connections 2024-04-24T23:08:09.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.690+0000 7efeaf1c8640 1 -- 172.21.15.43:0/3637751806 wait complete. 2024-04-24T23:08:09.706 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:08:09.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cdf1c2640 1 Processor -- start 2024-04-24T23:08:09.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cdf1c2640 1 -- start start 2024-04-24T23:08:09.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cdf1c2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8cd806be60 0x7f8cd80b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cdf1c2640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cd80b5720 con 0x7f8cd8072f40 2024-04-24T23:08:09.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cdf1c2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cd8073320 con 0x7f8cd8145c10 2024-04-24T23:08:09.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cdf1c2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd80b61c0 con 0x7f8cd806be60 2024-04-24T23:08:09.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cdcf5e640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8cd8072f40 0x7f8cd8145500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33948/0 (socket says 172.21.15.43:33948) 2024-04-24T23:08:09.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cdcf5e640 1 -- 172.21.15.43:0/2731304285 learned_addr learned my addr 172.21.15.43:0/2731304285 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:09.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd77fe640 1 -- 172.21.15.43:0/2731304285 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 405040528 0 0) 0x7f8cd80b5720 con 0x7f8cd8072f40 2024-04-24T23:08:09.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd77fe640 1 -- 172.21.15.43:0/2731304285 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cc0003530 con 0x7f8cd8072f40 2024-04-24T23:08:09.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd7fff640 1 --2- 172.21.15.43:0/2731304285 >> v2:172.21.15.162:3300/0 conn(0x7f8cd806be60 0x7f8cd80b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd77fe640 1 -- 172.21.15.43:0/2731304285 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1761645539 0 0) 0x7f8cc0003530 con 0x7f8cd8072f40 2024-04-24T23:08:09.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd77fe640 1 -- 172.21.15.43:0/2731304285 >> v2:172.21.15.162:3300/0 conn(0x7f8cd806be60 msgr2=0x7f8cd80b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:09.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd77fe640 1 --2- 172.21.15.43:0/2731304285 >> v2:172.21.15.162:3300/0 conn(0x7f8cd806be60 0x7f8cd80b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd77fe640 1 -- 172.21.15.43:0/2731304285 >> v1:172.21.15.162:6789/0 conn(0x7f8cd8145c10 legacy=0x7f8cd814fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:09.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd77fe640 1 -- 172.21.15.43:0/2731304285 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd80b59c0 con 0x7f8cd8072f40 2024-04-24T23:08:09.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd77fe640 1 -- 172.21.15.43:0/2731304285 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f8cc8001680 con 0x7f8cd8072f40 2024-04-24T23:08:09.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd77fe640 1 -- 172.21.15.43:0/2731304285 >> v1:172.21.15.43:6789/0 conn(0x7f8cd8072f40 legacy=0x7f8cd8145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd77fe640 1 --2- 172.21.15.43:0/2731304285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cc00039c0 0x7f8cc0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd77fe640 1 --2- 172.21.15.43:0/2731304285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cc0004810 0x7f8cc0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd77fe640 1 --2- 172.21.15.43:0/2731304285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cc00052f0 0x7f8cc000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd77fe640 1 -- 172.21.15.43:0/2731304285 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd80b61c0 con 0x7f8cc0004810 2024-04-24T23:08:09.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd77fe640 1 -- 172.21.15.43:0/2731304285 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc000c1c0 con 0x7f8cc00052f0 2024-04-24T23:08:09.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd77fe640 1 -- 172.21.15.43:0/2731304285 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc000c3c0 con 0x7f8cc00039c0 2024-04-24T23:08:09.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd7fff640 1 --2- 172.21.15.43:0/2731304285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cc0004810 0x7f8cc0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cdcf5e640 1 --2- 172.21.15.43:0/2731304285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cc00039c0 0x7f8cc0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cdd75f640 1 --2- 172.21.15.43:0/2731304285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cc00052f0 0x7f8cc000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd7fff640 1 -- 172.21.15.43:0/2731304285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cc00039c0 msgr2=0x7f8cc0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:09.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd7fff640 1 --2- 172.21.15.43:0/2731304285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cc00039c0 0x7f8cc0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd7fff640 1 -- 172.21.15.43:0/2731304285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cc00052f0 msgr2=0x7f8cc000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:09.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd7fff640 1 --2- 172.21.15.43:0/2731304285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cc00052f0 0x7f8cc000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cd7fff640 1 -- 172.21.15.43:0/2731304285 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc0003530 con 0x7f8cc0004810 2024-04-24T23:08:09.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cdcf5e640 1 --2- 172.21.15.43:0/2731304285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cc00039c0 0x7f8cc0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:09.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cdd75f640 1 --2- 172.21.15.43:0/2731304285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cc00052f0 0x7f8cc000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:09.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.826+0000 7f8cdd75f640 1 -- 172.21.15.43:0/2731304285 reap_dead start 2024-04-24T23:08:09.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cd7fff640 1 --2- 172.21.15.43:0/2731304285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cc0004810 0x7f8cc0004c90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00ba00 tx=0x7f8ccc01c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd575f531143ce3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:09.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cd77fe640 1 -- 172.21.15.43:0/2731304285 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00b600 con 0x7f8cc0004810 2024-04-24T23:08:09.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cd77fe640 1 -- 172.21.15.43:0/2731304285 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ccc0b1070 con 0x7f8cc0004810 2024-04-24T23:08:09.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cd77fe640 1 -- 172.21.15.43:0/2731304285 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0ac840 con 0x7f8cc0004810 2024-04-24T23:08:09.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdf1c2640 1 -- 172.21.15.43:0/2731304285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cc0004810 msgr2=0x7f8cc0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdf1c2640 1 --2- 172.21.15.43:0/2731304285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cc0004810 0x7f8cc0004c90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00ba00 tx=0x7f8ccc01c660 comp rx=0 tx=0).stop 2024-04-24T23:08:09.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdf1c2640 1 -- 172.21.15.43:0/2731304285 shutdown_connections 2024-04-24T23:08:09.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdf1c2640 1 --2- 172.21.15.43:0/2731304285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cc0004810 0x7f8cc0004c90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdf1c2640 1 -- 172.21.15.43:0/2731304285 >> 172.21.15.43:0/2731304285 conn(0x7f8cd806c300 msgr2=0x7f8cd806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:09.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdf1c2640 1 -- 172.21.15.43:0/2731304285 shutdown_connections 2024-04-24T23:08:09.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdf1c2640 1 -- 172.21.15.43:0/2731304285 wait complete. 2024-04-24T23:08:09.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdf1c2640 1 Processor -- start 2024-04-24T23:08:09.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdf1c2640 1 -- start start 2024-04-24T23:08:09.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdf1c2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cc0004810 0x7f8cd80b9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdf1c2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd80b80c0 0x7f8cd81ded30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdf1c2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cd81df270 0x7f8cd8138b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdf1c2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd8148bf0 con 0x7f8cd80b80c0 2024-04-24T23:08:09.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdf1c2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd8148a70 con 0x7f8cc0004810 2024-04-24T23:08:09.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdf1c2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd8148d70 con 0x7f8cd81df270 2024-04-24T23:08:09.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cd7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd80b80c0 0x7f8cd81ded30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cd7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd80b80c0 0x7f8cd81ded30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54992/0 (socket says 172.21.15.43:54992) 2024-04-24T23:08:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cd7fff640 1 -- 172.21.15.43:0/2079711901 learned_addr learned my addr 172.21.15.43:0/2079711901 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdd75f640 1 --2- 172.21.15.43:0/2079711901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cd81df270 0x7f8cd8138b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdcf5e640 1 --2- 172.21.15.43:0/2079711901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cc0004810 0x7f8cd80b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cd7fff640 1 -- 172.21.15.43:0/2079711901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cd81df270 msgr2=0x7f8cd8138b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cd7fff640 1 --2- 172.21.15.43:0/2079711901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cd81df270 0x7f8cd8138b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cd7fff640 1 -- 172.21.15.43:0/2079711901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cc0004810 msgr2=0x7f8cd80b9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cd7fff640 1 --2- 172.21.15.43:0/2079711901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cc0004810 0x7f8cd80b9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cd7fff640 1 -- 172.21.15.43:0/2079711901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd8139fa0 con 0x7f8cd80b80c0 2024-04-24T23:08:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cdcf5e640 1 --2- 172.21.15.43:0/2079711901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cc0004810 0x7f8cd80b9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cd7fff640 1 --2- 172.21.15.43:0/2079711901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd80b80c0 0x7f8cd81ded30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0ae040 tx=0x7f8cc0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.830+0000 7f8cd57fa640 1 -- 172.21.15.43:0/2079711901 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0bb070 con 0x7f8cd80b80c0 2024-04-24T23:08:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.834+0000 7f8cd57fa640 1 -- 172.21.15.43:0/2079711901 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ccc004220 con 0x7f8cd80b80c0 2024-04-24T23:08:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.834+0000 7f8cdf1c2640 1 -- 172.21.15.43:0/2079711901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd8146900 con 0x7f8cd80b80c0 2024-04-24T23:08:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.834+0000 7f8cd57fa640 1 -- 172.21.15.43:0/2079711901 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0ac750 con 0x7f8cd80b80c0 2024-04-24T23:08:09.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.834+0000 7f8cdf1c2640 1 -- 172.21.15.43:0/2079711901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd80b9d00 con 0x7f8cd80b80c0 2024-04-24T23:08:09.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.834+0000 7f8cdf1c2640 1 -- 172.21.15.43:0/2079711901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd804f580 con 0x7f8cd80b80c0 2024-04-24T23:08:09.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.834+0000 7f8cd57fa640 1 -- 172.21.15.43:0/2079711901 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ccc0ab070 con 0x7f8cd80b80c0 2024-04-24T23:08:09.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.834+0000 7f8cd57fa640 1 --2- 172.21.15.43:0/2079711901 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8cc40678c0 0x7f8cc4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:09.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.834+0000 7f8cd57fa640 1 -- 172.21.15.43:0/2079711901 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f8ccc120430 con 0x7f8cd80b80c0 2024-04-24T23:08:09.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.834+0000 7f8cdcf5e640 1 --2- 172.21.15.43:0/2079711901 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8cc40678c0 0x7f8cc4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:09.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.834+0000 7f8cdcf5e640 1 --2- 172.21.15.43:0/2079711901 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8cc40678c0 0x7f8cc4069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80017f0 tx=0x7f8cc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:09.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:09.842+0000 7f8cd57fa640 1 -- 172.21.15.43:0/2079711901 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8ccc016370 con 0x7f8cd80b80c0 2024-04-24T23:08:10.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:10.002+0000 7f8cdf1c2640 1 -- 172.21.15.43:0/2079711901 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8cd80b1940 con 0x7f8cc40678c0 2024-04-24T23:08:10.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:10.010+0000 7f8cd57fa640 1 -- 172.21.15.43:0/2079711901 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332100 (secure 0 0 0) 0x7f8cd80b1940 con 0x7f8cc40678c0 2024-04-24T23:08:10.015 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:08:10.018 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-24T23:08:10.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:10.014+0000 7f8cdf1c2640 1 -- 172.21.15.43:0/2079711901 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8cc40678c0 msgr2=0x7f8cc4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:10.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:10.014+0000 7f8cdf1c2640 1 --2- 172.21.15.43:0/2079711901 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8cc40678c0 0x7f8cc4069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80017f0 tx=0x7f8cc8009040 comp rx=0 tx=0).stop 2024-04-24T23:08:10.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:10.014+0000 7f8cdf1c2640 1 -- 172.21.15.43:0/2079711901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd80b80c0 msgr2=0x7f8cd81ded30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:10.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:10.014+0000 7f8cdf1c2640 1 --2- 172.21.15.43:0/2079711901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd80b80c0 0x7f8cd81ded30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0ae040 tx=0x7f8cc0005840 comp rx=0 tx=0).stop 2024-04-24T23:08:10.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:10.014+0000 7f8cdf1c2640 1 -- 172.21.15.43:0/2079711901 shutdown_connections 2024-04-24T23:08:10.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:10.014+0000 7f8cdf1c2640 1 --2- 172.21.15.43:0/2079711901 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f8cc40678c0 0x7f8cc4069d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:10.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:10.014+0000 7f8cdf1c2640 1 --2- 172.21.15.43:0/2079711901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cd81df270 0x7f8cd8138b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:10.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:10.014+0000 7f8cdf1c2640 1 --2- 172.21.15.43:0/2079711901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd80b80c0 0x7f8cd81ded30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:10.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:10.014+0000 7f8cdf1c2640 1 --2- 172.21.15.43:0/2079711901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cc0004810 0x7f8cd80b9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:10.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:10.014+0000 7f8cdf1c2640 1 -- 172.21.15.43:0/2079711901 >> 172.21.15.43:0/2079711901 conn(0x7f8cd806c300 msgr2=0x7f8cd81439c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:10.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:10.014+0000 7f8cdf1c2640 1 -- 172.21.15.43:0/2079711901 shutdown_connections 2024-04-24T23:08:10.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:10.014+0000 7f8cdf1c2640 1 -- 172.21.15.43:0/2079711901 wait complete. 2024-04-24T23:08:10.036 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-04-24T23:08:08.389450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":156743271,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":1258,"num_read_kb":1896,"num_write":71340,"num_write_kb":667177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66253,"ondisk_log_size":66253,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":909072,"kb_used_data":87952,"kb_used_omap":12,"kb_used_meta":821043,"kb_avail":754065648,"statfs":{"total":773094113280,"available":772163223552,"internally_reserved":0,"allocated":90062848,"data_stored":314410014,"data_compressed":57812372,"data_compressed_allocated":71720960,"data_compressed_original":297476096,"omap_allocated":12752,"internal_metadata":840748592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12959101,"num_objects":-1370,"num_object_clones":0,"num_object_copies":-4124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1370,"num_whiteouts":0,"num_read":11,"num_read_kb":93,"num_write":1414,"num_write_kb":1202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003749"},"pg_stats":[{"pgid":"2.1f","version":"27'518","reported_seq":548,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.790935+0000","last_change":"2024-04-24T23:00:15.425241+0000","last_active":"2024-04-24T23:07:54.790935+0000","last_peered":"2024-04-24T23:07:54.790935+0000","last_clean":"2024-04-24T23:07:54.790935+0000","last_became_active":"2024-04-24T23:00:15.417152+0000","last_became_peered":"2024-04-24T23:00:15.417152+0000","last_unstale":"2024-04-24T23:07:54.790935+0000","last_undegraded":"2024-04-24T23:07:54.790935+0000","last_fullsized":"2024-04-24T23:07:54.790935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":574,"num_write_kb":8831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'314","reported_seq":341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.466280+0000","last_change":"2024-04-24T23:00:16.450360+0000","last_active":"2024-04-24T23:08:02.466280+0000","last_peered":"2024-04-24T23:08:02.466280+0000","last_clean":"2024-04-24T23:08:02.466280+0000","last_became_active":"2024-04-24T23:00:16.449631+0000","last_became_peered":"2024-04-24T23:00:16.449631+0000","last_unstale":"2024-04-24T23:08:02.466280+0000","last_undegraded":"2024-04-24T23:08:02.466280+0000","last_fullsized":"2024-04-24T23:08:02.466280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:03:09.773642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'1014","reported_seq":1035,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.824046+0000","last_change":"2024-04-24T23:00:20.537107+0000","last_active":"2024-04-24T23:07:55.824046+0000","last_peered":"2024-04-24T23:07:55.824046+0000","last_clean":"2024-04-24T23:07:55.824046+0000","last_became_active":"2024-04-24T23:00:20.535916+0000","last_became_peered":"2024-04-24T23:00:20.535916+0000","last_unstale":"2024-04-24T23:07:55.824046+0000","last_undegraded":"2024-04-24T23:07:55.824046+0000","last_fullsized":"2024-04-24T23:07:55.824046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1014,"log_dups_size":0,"ondisk_log_size":1014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.364772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":7177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'578","reported_seq":607,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.796855+0000","last_change":"2024-04-24T23:00:15.418251+0000","last_active":"2024-04-24T23:07:54.796855+0000","last_peered":"2024-04-24T23:07:54.796855+0000","last_clean":"2024-04-24T23:07:54.796855+0000","last_became_active":"2024-04-24T23:00:15.417502+0000","last_became_peered":"2024-04-24T23:00:15.417502+0000","last_unstale":"2024-04-24T23:07:54.796855+0000","last_undegraded":"2024-04-24T23:07:54.796855+0000","last_fullsized":"2024-04-24T23:07:54.796855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:50:53.490837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":611,"num_write_kb":25054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'288","reported_seq":315,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.470814+0000","last_change":"2024-04-24T23:00:16.452960+0000","last_active":"2024-04-24T23:08:02.470814+0000","last_peered":"2024-04-24T23:08:02.470814+0000","last_clean":"2024-04-24T23:08:02.470814+0000","last_became_active":"2024-04-24T23:00:16.452212+0000","last_became_peered":"2024-04-24T23:00:16.452212+0000","last_unstale":"2024-04-24T23:08:02.470814+0000","last_undegraded":"2024-04-24T23:08:02.470814+0000","last_fullsized":"2024-04-24T23:08:02.470814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:56:26.361607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'1050","reported_seq":1072,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.895654+0000","last_change":"2024-04-24T23:00:20.518435+0000","last_active":"2024-04-24T23:07:55.895654+0000","last_peered":"2024-04-24T23:07:55.895654+0000","last_clean":"2024-04-24T23:07:55.895654+0000","last_became_active":"2024-04-24T23:00:20.517975+0000","last_became_peered":"2024-04-24T23:00:20.517975+0000","last_unstale":"2024-04-24T23:07:55.895654+0000","last_undegraded":"2024-04-24T23:07:55.895654+0000","last_fullsized":"2024-04-24T23:07:55.895654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1050,"log_dups_size":0,"ondisk_log_size":1050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":6799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1034","reported_seq":1064,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:48.336011+0000","last_change":"2024-04-24T23:00:15.401804+0000","last_active":"2024-04-24T23:07:48.336011+0000","last_peered":"2024-04-24T23:07:48.336011+0000","last_clean":"2024-04-24T23:07:48.336011+0000","last_became_active":"2024-04-24T23:00:15.400064+0000","last_became_peered":"2024-04-24T23:00:15.400064+0000","last_unstale":"2024-04-24T23:07:48.336011+0000","last_undegraded":"2024-04-24T23:07:48.336011+0000","last_fullsized":"2024-04-24T23:07:48.336011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1034,"log_dups_size":0,"ondisk_log_size":1034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":1068,"num_write_kb":29480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'289","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.473954+0000","last_change":"2024-04-24T23:00:16.451873+0000","last_active":"2024-04-24T23:08:02.473954+0000","last_peered":"2024-04-24T23:08:02.473954+0000","last_clean":"2024-04-24T23:08:02.473954+0000","last_became_active":"2024-04-24T23:00:16.451601+0000","last_became_peered":"2024-04-24T23:00:16.451601+0000","last_unstale":"2024-04-24T23:08:02.473954+0000","last_undegraded":"2024-04-24T23:08:02.473954+0000","last_fullsized":"2024-04-24T23:08:02.473954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'993","reported_seq":1015,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.915043+0000","last_change":"2024-04-24T23:00:20.518757+0000","last_active":"2024-04-24T23:07:55.915043+0000","last_peered":"2024-04-24T23:07:55.915043+0000","last_clean":"2024-04-24T23:07:55.915043+0000","last_became_active":"2024-04-24T23:00:20.518002+0000","last_became_peered":"2024-04-24T23:00:20.518002+0000","last_unstale":"2024-04-24T23:07:55.915043+0000","last_undegraded":"2024-04-24T23:07:55.915043+0000","last_fullsized":"2024-04-24T23:07:55.915043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":6590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'200","reported_seq":230,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.775742+0000","last_change":"2024-04-24T23:00:15.398338+0000","last_active":"2024-04-24T23:07:55.775742+0000","last_peered":"2024-04-24T23:07:55.775742+0000","last_clean":"2024-04-24T23:07:55.775742+0000","last_became_active":"2024-04-24T23:00:15.395766+0000","last_became_peered":"2024-04-24T23:00:15.395766+0000","last_unstale":"2024-04-24T23:07:55.775742+0000","last_undegraded":"2024-04-24T23:07:55.775742+0000","last_fullsized":"2024-04-24T23:07:55.775742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":248,"num_write_kb":4421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'299","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.474235+0000","last_change":"2024-04-24T23:00:16.458641+0000","last_active":"2024-04-24T23:08:02.474235+0000","last_peered":"2024-04-24T23:08:02.474235+0000","last_clean":"2024-04-24T23:08:02.474235+0000","last_became_active":"2024-04-24T23:00:16.458237+0000","last_became_peered":"2024-04-24T23:00:16.458237+0000","last_unstale":"2024-04-24T23:08:02.474235+0000","last_undegraded":"2024-04-24T23:08:02.474235+0000","last_fullsized":"2024-04-24T23:08:02.474235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'1016","reported_seq":1045,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.900373+0000","last_change":"2024-04-24T23:00:57.665634+0000","last_active":"2024-04-24T23:07:55.900373+0000","last_peered":"2024-04-24T23:07:55.900373+0000","last_clean":"2024-04-24T23:07:55.900373+0000","last_became_active":"2024-04-24T23:00:57.664750+0000","last_became_peered":"2024-04-24T23:00:57.664750+0000","last_unstale":"2024-04-24T23:07:55.900373+0000","last_undegraded":"2024-04-24T23:07:55.900373+0000","last_fullsized":"2024-04-24T23:07:55.900373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":6657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,4],"acting":[2,6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'326","reported_seq":353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.442717+0000","last_change":"2024-04-24T23:00:16.448014+0000","last_active":"2024-04-24T23:08:02.442717+0000","last_peered":"2024-04-24T23:08:02.442717+0000","last_clean":"2024-04-24T23:08:02.442717+0000","last_became_active":"2024-04-24T23:00:16.447488+0000","last_became_peered":"2024-04-24T23:00:16.447488+0000","last_unstale":"2024-04-24T23:08:02.442717+0000","last_undegraded":"2024-04-24T23:08:02.442717+0000","last_fullsized":"2024-04-24T23:08:02.442717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'770","reported_seq":799,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.775123+0000","last_change":"2024-04-24T23:00:15.408781+0000","last_active":"2024-04-24T23:07:55.775123+0000","last_peered":"2024-04-24T23:07:55.775123+0000","last_clean":"2024-04-24T23:07:55.775123+0000","last_became_active":"2024-04-24T23:00:15.408120+0000","last_became_peered":"2024-04-24T23:00:15.408120+0000","last_unstale":"2024-04-24T23:07:55.775123+0000","last_undegraded":"2024-04-24T23:07:55.775123+0000","last_fullsized":"2024-04-24T23:07:55.775123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":817,"num_write_kb":21262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'991","reported_seq":1013,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.896244+0000","last_change":"2024-04-24T23:00:20.503964+0000","last_active":"2024-04-24T23:07:55.896244+0000","last_peered":"2024-04-24T23:07:55.896244+0000","last_clean":"2024-04-24T23:07:55.896244+0000","last_became_active":"2024-04-24T23:00:20.501703+0000","last_became_peered":"2024-04-24T23:00:20.501703+0000","last_unstale":"2024-04-24T23:07:55.896244+0000","last_undegraded":"2024-04-24T23:07:55.896244+0000","last_fullsized":"2024-04-24T23:07:55.896244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":7022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'337","reported_seq":364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.456838+0000","last_change":"2024-04-24T23:00:16.472987+0000","last_active":"2024-04-24T23:08:02.456838+0000","last_peered":"2024-04-24T23:08:02.456838+0000","last_clean":"2024-04-24T23:08:02.456838+0000","last_became_active":"2024-04-24T23:00:16.472226+0000","last_became_peered":"2024-04-24T23:00:16.472226+0000","last_unstale":"2024-04-24T23:08:02.456838+0000","last_undegraded":"2024-04-24T23:08:02.456838+0000","last_fullsized":"2024-04-24T23:08:02.456838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:54.453105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":260,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'309","reported_seq":338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:49.727569+0000","last_change":"2024-04-24T23:00:15.422963+0000","last_active":"2024-04-24T23:07:49.727569+0000","last_peered":"2024-04-24T23:07:49.727569+0000","last_clean":"2024-04-24T23:07:49.727569+0000","last_became_active":"2024-04-24T23:00:15.422121+0000","last_became_peered":"2024-04-24T23:00:15.422121+0000","last_unstale":"2024-04-24T23:07:49.727569+0000","last_undegraded":"2024-04-24T23:07:49.727569+0000","last_fullsized":"2024-04-24T23:07:49.727569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":340,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'1105","reported_seq":1127,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.859598+0000","last_change":"2024-04-24T23:00:20.540688+0000","last_active":"2024-04-24T23:07:55.859598+0000","last_peered":"2024-04-24T23:07:55.859598+0000","last_clean":"2024-04-24T23:07:55.859598+0000","last_became_active":"2024-04-24T23:00:20.540220+0000","last_became_peered":"2024-04-24T23:00:20.540220+0000","last_unstale":"2024-04-24T23:07:55.859598+0000","last_undegraded":"2024-04-24T23:07:55.859598+0000","last_fullsized":"2024-04-24T23:07:55.859598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1391,"num_write_kb":7499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'337","reported_seq":365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.474107+0000","last_change":"2024-04-24T23:00:16.488633+0000","last_active":"2024-04-24T23:08:02.474107+0000","last_peered":"2024-04-24T23:08:02.474107+0000","last_clean":"2024-04-24T23:08:02.474107+0000","last_became_active":"2024-04-24T23:00:16.487476+0000","last_became_peered":"2024-04-24T23:00:16.487476+0000","last_unstale":"2024-04-24T23:08:02.474107+0000","last_undegraded":"2024-04-24T23:08:02.474107+0000","last_fullsized":"2024-04-24T23:08:02.474107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'215","reported_seq":245,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:53.747816+0000","last_change":"2024-04-24T23:00:15.397973+0000","last_active":"2024-04-24T23:07:53.747816+0000","last_peered":"2024-04-24T23:07:53.747816+0000","last_clean":"2024-04-24T23:07:53.747816+0000","last_became_active":"2024-04-24T23:00:15.396600+0000","last_became_peered":"2024-04-24T23:00:15.396600+0000","last_unstale":"2024-04-24T23:07:53.747816+0000","last_undegraded":"2024-04-24T23:07:53.747816+0000","last_fullsized":"2024-04-24T23:07:53.747816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":224,"num_write_kb":12479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'989","reported_seq":1010,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.895864+0000","last_change":"2024-04-24T23:00:20.511547+0000","last_active":"2024-04-24T23:07:55.895864+0000","last_peered":"2024-04-24T23:07:55.895864+0000","last_clean":"2024-04-24T23:07:55.895864+0000","last_became_active":"2024-04-24T23:00:20.510602+0000","last_became_peered":"2024-04-24T23:00:20.510602+0000","last_unstale":"2024-04-24T23:07:55.895864+0000","last_undegraded":"2024-04-24T23:07:55.895864+0000","last_fullsized":"2024-04-24T23:07:55.895864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:17.847434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1239,"num_write_kb":6767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'349","reported_seq":376,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.466144+0000","last_change":"2024-04-24T23:00:16.483393+0000","last_active":"2024-04-24T23:08:02.466144+0000","last_peered":"2024-04-24T23:08:02.466144+0000","last_clean":"2024-04-24T23:08:02.466144+0000","last_became_active":"2024-04-24T23:00:16.483092+0000","last_became_peered":"2024-04-24T23:00:16.483092+0000","last_unstale":"2024-04-24T23:08:02.466144+0000","last_undegraded":"2024-04-24T23:08:02.466144+0000","last_fullsized":"2024-04-24T23:08:02.466144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'273","reported_seq":303,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.888745+0000","last_change":"2024-04-24T23:00:15.398005+0000","last_active":"2024-04-24T23:07:54.888745+0000","last_peered":"2024-04-24T23:07:54.888745+0000","last_clean":"2024-04-24T23:07:54.888745+0000","last_became_active":"2024-04-24T23:00:15.397638+0000","last_became_peered":"2024-04-24T23:00:15.397638+0000","last_unstale":"2024-04-24T23:07:54.888745+0000","last_undegraded":"2024-04-24T23:07:54.888745+0000","last_fullsized":"2024-04-24T23:07:54.888745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":320,"num_write_kb":4474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'934","reported_seq":956,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.909579+0000","last_change":"2024-04-24T23:00:20.505995+0000","last_active":"2024-04-24T23:07:55.909579+0000","last_peered":"2024-04-24T23:07:55.909579+0000","last_clean":"2024-04-24T23:07:55.909579+0000","last_became_active":"2024-04-24T23:00:20.505532+0000","last_became_peered":"2024-04-24T23:00:20.505532+0000","last_unstale":"2024-04-24T23:07:55.909579+0000","last_undegraded":"2024-04-24T23:07:55.909579+0000","last_fullsized":"2024-04-24T23:07:55.909579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":6588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'333","reported_seq":361,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.474101+0000","last_change":"2024-04-24T23:00:16.484306+0000","last_active":"2024-04-24T23:08:02.474101+0000","last_peered":"2024-04-24T23:08:02.474101+0000","last_clean":"2024-04-24T23:08:02.474101+0000","last_became_active":"2024-04-24T23:00:16.483585+0000","last_became_peered":"2024-04-24T23:00:16.483585+0000","last_unstale":"2024-04-24T23:08:02.474101+0000","last_undegraded":"2024-04-24T23:08:02.474101+0000","last_fullsized":"2024-04-24T23:08:02.474101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'156","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:56.724923+0000","last_change":"2024-04-24T23:00:15.421158+0000","last_active":"2024-04-24T23:07:56.724923+0000","last_peered":"2024-04-24T23:07:56.724923+0000","last_clean":"2024-04-24T23:07:56.724923+0000","last_became_active":"2024-04-24T23:00:15.420839+0000","last_became_peered":"2024-04-24T23:00:15.420839+0000","last_unstale":"2024-04-24T23:07:56.724923+0000","last_undegraded":"2024-04-24T23:07:56.724923+0000","last_fullsized":"2024-04-24T23:07:56.724923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":209,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'1029","reported_seq":1051,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.909629+0000","last_change":"2024-04-24T23:00:20.519755+0000","last_active":"2024-04-24T23:07:55.909629+0000","last_peered":"2024-04-24T23:07:55.909629+0000","last_clean":"2024-04-24T23:07:55.909629+0000","last_became_active":"2024-04-24T23:00:20.518470+0000","last_became_peered":"2024-04-24T23:00:20.518470+0000","last_unstale":"2024-04-24T23:07:55.909629+0000","last_undegraded":"2024-04-24T23:07:55.909629+0000","last_fullsized":"2024-04-24T23:07:55.909629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":7455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'291","reported_seq":319,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.471686+0000","last_change":"2024-04-24T23:00:16.464487+0000","last_active":"2024-04-24T23:08:02.471686+0000","last_peered":"2024-04-24T23:08:02.471686+0000","last_clean":"2024-04-24T23:08:02.471686+0000","last_became_active":"2024-04-24T23:00:16.463565+0000","last_became_peered":"2024-04-24T23:00:16.463565+0000","last_unstale":"2024-04-24T23:08:02.471686+0000","last_undegraded":"2024-04-24T23:08:02.471686+0000","last_fullsized":"2024-04-24T23:08:02.471686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'448","reported_seq":478,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.488203+0000","last_change":"2024-04-24T23:00:15.400228+0000","last_active":"2024-04-24T23:08:02.488203+0000","last_peered":"2024-04-24T23:08:02.488203+0000","last_clean":"2024-04-24T23:08:02.488203+0000","last_became_active":"2024-04-24T23:00:15.397465+0000","last_became_peered":"2024-04-24T23:00:15.397465+0000","last_unstale":"2024-04-24T23:08:02.488203+0000","last_undegraded":"2024-04-24T23:08:02.488203+0000","last_fullsized":"2024-04-24T23:08:02.488203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8008961,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1199,"num_write_kb":9322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'1049","reported_seq":1071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.910407+0000","last_change":"2024-04-24T23:00:20.516766+0000","last_active":"2024-04-24T23:07:55.910407+0000","last_peered":"2024-04-24T23:07:55.910407+0000","last_clean":"2024-04-24T23:07:55.910407+0000","last_became_active":"2024-04-24T23:00:20.515972+0000","last_became_peered":"2024-04-24T23:00:20.515972+0000","last_unstale":"2024-04-24T23:07:55.910407+0000","last_undegraded":"2024-04-24T23:07:55.910407+0000","last_fullsized":"2024-04-24T23:07:55.910407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1319,"num_write_kb":7165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'300","reported_seq":327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.460622+0000","last_change":"2024-04-24T23:00:16.480627+0000","last_active":"2024-04-24T23:08:02.460622+0000","last_peered":"2024-04-24T23:08:02.460622+0000","last_clean":"2024-04-24T23:08:02.460622+0000","last_became_active":"2024-04-24T23:00:16.480021+0000","last_became_peered":"2024-04-24T23:00:16.480021+0000","last_unstale":"2024-04-24T23:08:02.460622+0000","last_undegraded":"2024-04-24T23:08:02.460622+0000","last_fullsized":"2024-04-24T23:08:02.460622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:04.285389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'297","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:49.795975+0000","last_change":"2024-04-24T23:00:15.428375+0000","last_active":"2024-04-24T23:07:49.795975+0000","last_peered":"2024-04-24T23:07:49.795975+0000","last_clean":"2024-04-24T23:07:49.795975+0000","last_became_active":"2024-04-24T23:00:15.428016+0000","last_became_peered":"2024-04-24T23:00:15.428016+0000","last_unstale":"2024-04-24T23:07:49.795975+0000","last_undegraded":"2024-04-24T23:07:49.795975+0000","last_fullsized":"2024-04-24T23:07:49.795975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":311,"num_write_kb":16738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'1004","reported_seq":1025,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.826119+0000","last_change":"2024-04-24T23:00:20.535274+0000","last_active":"2024-04-24T23:07:55.826119+0000","last_peered":"2024-04-24T23:07:55.826119+0000","last_clean":"2024-04-24T23:07:55.826119+0000","last_became_active":"2024-04-24T23:00:20.524747+0000","last_became_peered":"2024-04-24T23:00:20.524747+0000","last_unstale":"2024-04-24T23:07:55.826119+0000","last_undegraded":"2024-04-24T23:07:55.826119+0000","last_fullsized":"2024-04-24T23:07:55.826119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.814128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1252,"num_write_kb":7166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'319","reported_seq":346,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.450023+0000","last_change":"2024-04-24T23:00:16.456641+0000","last_active":"2024-04-24T23:08:02.450023+0000","last_peered":"2024-04-24T23:08:02.450023+0000","last_clean":"2024-04-24T23:08:02.450023+0000","last_became_active":"2024-04-24T23:00:16.456268+0000","last_became_peered":"2024-04-24T23:00:16.456268+0000","last_unstale":"2024-04-24T23:08:02.450023+0000","last_undegraded":"2024-04-24T23:08:02.450023+0000","last_fullsized":"2024-04-24T23:08:02.450023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'112","reported_seq":141,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.896251+0000","last_change":"2024-04-24T23:00:15.429119+0000","last_active":"2024-04-24T23:07:54.896251+0000","last_peered":"2024-04-24T23:07:54.896251+0000","last_clean":"2024-04-24T23:07:54.896251+0000","last_became_active":"2024-04-24T23:00:15.428374+0000","last_became_peered":"2024-04-24T23:00:15.428374+0000","last_unstale":"2024-04-24T23:07:54.896251+0000","last_undegraded":"2024-04-24T23:07:54.896251+0000","last_fullsized":"2024-04-24T23:07:54.896251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:13:30.412685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":161,"num_write_kb":4386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'1030","reported_seq":1051,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.864947+0000","last_change":"2024-04-24T23:00:20.535730+0000","last_active":"2024-04-24T23:07:55.864947+0000","last_peered":"2024-04-24T23:07:55.864947+0000","last_clean":"2024-04-24T23:07:55.864947+0000","last_became_active":"2024-04-24T23:00:20.534430+0000","last_became_peered":"2024-04-24T23:00:20.534430+0000","last_unstale":"2024-04-24T23:07:55.864947+0000","last_undegraded":"2024-04-24T23:07:55.864947+0000","last_fullsized":"2024-04-24T23:07:55.864947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:35.156511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1288,"num_write_kb":6636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'316","reported_seq":344,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.470773+0000","last_change":"2024-04-24T23:00:16.444070+0000","last_active":"2024-04-24T23:08:02.470773+0000","last_peered":"2024-04-24T23:08:02.470773+0000","last_clean":"2024-04-24T23:08:02.470773+0000","last_became_active":"2024-04-24T23:00:16.443620+0000","last_became_peered":"2024-04-24T23:00:16.443620+0000","last_unstale":"2024-04-24T23:08:02.470773+0000","last_undegraded":"2024-04-24T23:08:02.470773+0000","last_fullsized":"2024-04-24T23:08:02.470773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'510","reported_seq":539,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.788493+0000","last_change":"2024-04-24T23:00:15.422571+0000","last_active":"2024-04-24T23:07:54.788493+0000","last_peered":"2024-04-24T23:07:54.788493+0000","last_clean":"2024-04-24T23:07:54.788493+0000","last_became_active":"2024-04-24T23:00:15.422167+0000","last_became_peered":"2024-04-24T23:00:15.422167+0000","last_unstale":"2024-04-24T23:07:54.788493+0000","last_undegraded":"2024-04-24T23:07:54.788493+0000","last_fullsized":"2024-04-24T23:07:54.788493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":552,"num_write_kb":25017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'943","reported_seq":964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.834843+0000","last_change":"2024-04-24T23:00:20.540587+0000","last_active":"2024-04-24T23:07:55.834843+0000","last_peered":"2024-04-24T23:07:55.834843+0000","last_clean":"2024-04-24T23:07:55.834843+0000","last_became_active":"2024-04-24T23:00:20.524719+0000","last_became_peered":"2024-04-24T23:00:20.524719+0000","last_unstale":"2024-04-24T23:07:55.834843+0000","last_undegraded":"2024-04-24T23:07:55.834843+0000","last_fullsized":"2024-04-24T23:07:55.834843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:51.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'320","reported_seq":347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.477357+0000","last_change":"2024-04-24T23:00:16.471678+0000","last_active":"2024-04-24T23:08:02.477357+0000","last_peered":"2024-04-24T23:08:02.477357+0000","last_clean":"2024-04-24T23:08:02.477357+0000","last_became_active":"2024-04-24T23:00:16.469390+0000","last_became_peered":"2024-04-24T23:00:16.469390+0000","last_unstale":"2024-04-24T23:08:02.477357+0000","last_undegraded":"2024-04-24T23:08:02.477357+0000","last_fullsized":"2024-04-24T23:08:02.477357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:31:59.778549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'887","reported_seq":1585,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:56.723481+0000","last_change":"2024-04-24T23:00:15.423024+0000","last_active":"2024-04-24T23:07:56.723481+0000","last_peered":"2024-04-24T23:07:56.723481+0000","last_clean":"2024-04-24T23:07:56.723481+0000","last_became_active":"2024-04-24T23:00:15.422275+0000","last_became_peered":"2024-04-24T23:00:15.422275+0000","last_unstale":"2024-04-24T23:07:56.723481+0000","last_undegraded":"2024-04-24T23:07:56.723481+0000","last_fullsized":"2024-04-24T23:07:56.723481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9730440,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":691,"num_read_kb":1796,"num_write":947,"num_write_kb":14533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'1020","reported_seq":1041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.845109+0000","last_change":"2024-04-24T23:00:20.535131+0000","last_active":"2024-04-24T23:07:55.845109+0000","last_peered":"2024-04-24T23:07:55.845109+0000","last_clean":"2024-04-24T23:07:55.845109+0000","last_became_active":"2024-04-24T23:00:20.534325+0000","last_became_peered":"2024-04-24T23:00:20.534325+0000","last_unstale":"2024-04-24T23:07:55.845109+0000","last_undegraded":"2024-04-24T23:07:55.845109+0000","last_fullsized":"2024-04-24T23:07:55.845109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:28.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1281,"num_write_kb":6595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'303","reported_seq":330,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.453731+0000","last_change":"2024-04-24T23:00:16.451991+0000","last_active":"2024-04-24T23:08:02.453731+0000","last_peered":"2024-04-24T23:08:02.453731+0000","last_clean":"2024-04-24T23:08:02.453731+0000","last_became_active":"2024-04-24T23:00:16.451226+0000","last_became_peered":"2024-04-24T23:00:16.451226+0000","last_unstale":"2024-04-24T23:08:02.453731+0000","last_undegraded":"2024-04-24T23:08:02.453731+0000","last_fullsized":"2024-04-24T23:08:02.453731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:07:30.426371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'647","reported_seq":676,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:51.887448+0000","last_change":"2024-04-24T23:00:15.414535+0000","last_active":"2024-04-24T23:07:51.887448+0000","last_peered":"2024-04-24T23:07:51.887448+0000","last_clean":"2024-04-24T23:07:51.887448+0000","last_became_active":"2024-04-24T23:00:15.414224+0000","last_became_peered":"2024-04-24T23:00:15.414224+0000","last_unstale":"2024-04-24T23:07:51.887448+0000","last_undegraded":"2024-04-24T23:07:51.887448+0000","last_fullsized":"2024-04-24T23:07:51.887448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":698,"num_write_kb":16967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'1115","reported_seq":1136,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.885451+0000","last_change":"2024-04-24T23:00:20.531159+0000","last_active":"2024-04-24T23:07:55.885451+0000","last_peered":"2024-04-24T23:07:55.885451+0000","last_clean":"2024-04-24T23:07:55.885451+0000","last_became_active":"2024-04-24T23:00:20.530682+0000","last_became_peered":"2024-04-24T23:00:20.530682+0000","last_unstale":"2024-04-24T23:07:55.885451+0000","last_undegraded":"2024-04-24T23:07:55.885451+0000","last_fullsized":"2024-04-24T23:07:55.885451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:45.629364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1380,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'294","reported_seq":322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.469217+0000","last_change":"2024-04-24T23:00:16.481649+0000","last_active":"2024-04-24T23:08:02.469217+0000","last_peered":"2024-04-24T23:08:02.469217+0000","last_clean":"2024-04-24T23:08:02.469217+0000","last_became_active":"2024-04-24T23:00:16.477192+0000","last_became_peered":"2024-04-24T23:00:16.477192+0000","last_unstale":"2024-04-24T23:08:02.469217+0000","last_undegraded":"2024-04-24T23:08:02.469217+0000","last_fullsized":"2024-04-24T23:08:02.469217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'170","reported_seq":199,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:51.718595+0000","last_change":"2024-04-24T23:00:15.407927+0000","last_active":"2024-04-24T23:07:51.718595+0000","last_peered":"2024-04-24T23:07:51.718595+0000","last_clean":"2024-04-24T23:07:51.718595+0000","last_became_active":"2024-04-24T23:00:15.407609+0000","last_became_peered":"2024-04-24T23:00:15.407609+0000","last_unstale":"2024-04-24T23:07:51.718595+0000","last_undegraded":"2024-04-24T23:07:51.718595+0000","last_fullsized":"2024-04-24T23:07:51.718595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":211,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:07.683387+0000","last_change":"2024-04-24T23:08:07.683435+0000","last_active":"2024-04-24T23:08:07.683387+0000","last_peered":"2024-04-24T23:08:07.683387+0000","last_clean":"2024-04-24T23:08:07.683387+0000","last_became_active":"2024-04-24T23:00:03.344074+0000","last_became_peered":"2024-04-24T23:00:03.344074+0000","last_unstale":"2024-04-24T23:08:07.683387+0000","last_undegraded":"2024-04-24T23:08:07.683387+0000","last_fullsized":"2024-04-24T23:08:07.683387+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-24T23:08:07.683292+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-24T23:08:07.683292+0000","last_clean_scrub_stamp":"2024-04-24T23:08:07.683292+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:08.895892+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'994","reported_seq":1009,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.887079+0000","last_change":"2024-04-24T23:00:57.865441+0000","last_active":"2024-04-24T23:07:55.887079+0000","last_peered":"2024-04-24T23:07:55.887079+0000","last_clean":"2024-04-24T23:07:55.887079+0000","last_became_active":"2024-04-24T23:00:57.864235+0000","last_became_peered":"2024-04-24T23:00:57.864235+0000","last_unstale":"2024-04-24T23:07:55.887079+0000","last_undegraded":"2024-04-24T23:07:55.887079+0000","last_fullsized":"2024-04-24T23:07:55.887079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":994,"log_dups_size":0,"ondisk_log_size":994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:54.068285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1231,"num_write_kb":6895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2,0],"acting":[5,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"27'317","reported_seq":344,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.425997+0000","last_change":"2024-04-24T23:00:16.448759+0000","last_active":"2024-04-24T23:08:02.425997+0000","last_peered":"2024-04-24T23:08:02.425997+0000","last_clean":"2024-04-24T23:08:02.425997+0000","last_became_active":"2024-04-24T23:00:16.448187+0000","last_became_peered":"2024-04-24T23:00:16.448187+0000","last_unstale":"2024-04-24T23:08:02.425997+0000","last_undegraded":"2024-04-24T23:08:02.425997+0000","last_fullsized":"2024-04-24T23:08:02.425997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'231","reported_seq":260,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:42.632794+0000","last_change":"2024-04-24T23:00:15.436270+0000","last_active":"2024-04-24T23:07:42.632794+0000","last_peered":"2024-04-24T23:07:42.632794+0000","last_clean":"2024-04-24T23:07:42.632794+0000","last_became_active":"2024-04-24T23:00:15.425134+0000","last_became_peered":"2024-04-24T23:00:15.425134+0000","last_unstale":"2024-04-24T23:07:42.632794+0000","last_undegraded":"2024-04-24T23:07:42.632794+0000","last_fullsized":"2024-04-24T23:07:42.632794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":252,"num_write_kb":12509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'1044","reported_seq":1066,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.908237+0000","last_change":"2024-04-24T23:00:20.500617+0000","last_active":"2024-04-24T23:07:55.908237+0000","last_peered":"2024-04-24T23:07:55.908237+0000","last_clean":"2024-04-24T23:07:55.908237+0000","last_became_active":"2024-04-24T23:00:20.500158+0000","last_became_peered":"2024-04-24T23:00:20.500158+0000","last_unstale":"2024-04-24T23:07:55.908237+0000","last_undegraded":"2024-04-24T23:07:55.908237+0000","last_fullsized":"2024-04-24T23:07:55.908237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1044,"log_dups_size":0,"ondisk_log_size":1044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1291,"num_write_kb":7061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'349","reported_seq":377,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.475241+0000","last_change":"2024-04-24T23:00:16.471754+0000","last_active":"2024-04-24T23:08:02.475241+0000","last_peered":"2024-04-24T23:08:02.475241+0000","last_clean":"2024-04-24T23:08:02.475241+0000","last_became_active":"2024-04-24T23:00:16.471497+0000","last_became_peered":"2024-04-24T23:00:16.471497+0000","last_unstale":"2024-04-24T23:08:02.475241+0000","last_undegraded":"2024-04-24T23:08:02.475241+0000","last_fullsized":"2024-04-24T23:08:02.475241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'523","reported_seq":552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:46.767969+0000","last_change":"2024-04-24T23:00:15.406401+0000","last_active":"2024-04-24T23:07:46.767969+0000","last_peered":"2024-04-24T23:07:46.767969+0000","last_clean":"2024-04-24T23:07:46.767969+0000","last_became_active":"2024-04-24T23:00:15.405636+0000","last_became_peered":"2024-04-24T23:00:15.405636+0000","last_unstale":"2024-04-24T23:07:46.767969+0000","last_undegraded":"2024-04-24T23:07:46.767969+0000","last_fullsized":"2024-04-24T23:07:46.767969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:02.654515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":558,"num_write_kb":25209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'1010","reported_seq":1031,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.846057+0000","last_change":"2024-04-24T23:00:20.502050+0000","last_active":"2024-04-24T23:07:55.846057+0000","last_peered":"2024-04-24T23:07:55.846057+0000","last_clean":"2024-04-24T23:07:55.846057+0000","last_became_active":"2024-04-24T23:00:20.500153+0000","last_became_peered":"2024-04-24T23:00:20.500153+0000","last_unstale":"2024-04-24T23:07:55.846057+0000","last_undegraded":"2024-04-24T23:07:55.846057+0000","last_fullsized":"2024-04-24T23:07:55.846057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:51.285256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":6978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'294","reported_seq":330,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:07.980369+0000","last_change":"2024-04-24T23:08:07.980416+0000","last_active":"2024-04-24T23:08:07.980369+0000","last_peered":"2024-04-24T23:08:07.980369+0000","last_clean":"2024-04-24T23:08:07.980369+0000","last_became_active":"2024-04-24T23:00:16.446170+0000","last_became_peered":"2024-04-24T23:00:16.446170+0000","last_unstale":"2024-04-24T23:08:07.980369+0000","last_undegraded":"2024-04-24T23:08:07.980369+0000","last_fullsized":"2024-04-24T23:08:07.980369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'294","last_scrub_stamp":"2024-04-24T23:08:07.980274+0000","last_deep_scrub":"27'294","last_deep_scrub_stamp":"2024-04-24T23:08:07.980274+0000","last_clean_scrub_stamp":"2024-04-24T23:08:07.980274+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:03.782520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'342","reported_seq":372,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.780600+0000","last_change":"2024-04-24T23:00:15.423703+0000","last_active":"2024-04-24T23:07:55.780600+0000","last_peered":"2024-04-24T23:07:55.780600+0000","last_clean":"2024-04-24T23:07:55.780600+0000","last_became_active":"2024-04-24T23:00:15.414863+0000","last_became_peered":"2024-04-24T23:00:15.414863+0000","last_unstale":"2024-04-24T23:07:55.780600+0000","last_undegraded":"2024-04-24T23:07:55.780600+0000","last_fullsized":"2024-04-24T23:07:55.780600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":379,"num_write_kb":12861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'1068","reported_seq":1090,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.903240+0000","last_change":"2024-04-24T23:00:20.499277+0000","last_active":"2024-04-24T23:07:55.903240+0000","last_peered":"2024-04-24T23:07:55.903240+0000","last_clean":"2024-04-24T23:07:55.903240+0000","last_became_active":"2024-04-24T23:00:20.498802+0000","last_became_peered":"2024-04-24T23:00:20.498802+0000","last_unstale":"2024-04-24T23:07:55.903240+0000","last_undegraded":"2024-04-24T23:07:55.903240+0000","last_fullsized":"2024-04-24T23:07:55.903240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":7543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'288","reported_seq":315,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.483239+0000","last_change":"2024-04-24T23:00:16.448112+0000","last_active":"2024-04-24T23:08:02.483239+0000","last_peered":"2024-04-24T23:08:02.483239+0000","last_clean":"2024-04-24T23:08:02.483239+0000","last_became_active":"2024-04-24T23:00:16.447838+0000","last_became_peered":"2024-04-24T23:00:16.447838+0000","last_unstale":"2024-04-24T23:08:02.483239+0000","last_undegraded":"2024-04-24T23:08:02.483239+0000","last_fullsized":"2024-04-24T23:08:02.483239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'304","reported_seq":334,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.778449+0000","last_change":"2024-04-24T23:00:15.420914+0000","last_active":"2024-04-24T23:07:55.778449+0000","last_peered":"2024-04-24T23:07:55.778449+0000","last_clean":"2024-04-24T23:07:55.778449+0000","last_became_active":"2024-04-24T23:00:15.420590+0000","last_became_peered":"2024-04-24T23:00:15.420590+0000","last_unstale":"2024-04-24T23:07:55.778449+0000","last_undegraded":"2024-04-24T23:07:55.778449+0000","last_fullsized":"2024-04-24T23:07:55.778449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":356,"num_write_kb":8611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'1045","reported_seq":1067,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.885541+0000","last_change":"2024-04-24T23:00:20.494192+0000","last_active":"2024-04-24T23:07:55.885541+0000","last_peered":"2024-04-24T23:07:55.885541+0000","last_clean":"2024-04-24T23:07:55.885541+0000","last_became_active":"2024-04-24T23:00:20.493784+0000","last_became_peered":"2024-04-24T23:00:20.493784+0000","last_unstale":"2024-04-24T23:07:55.885541+0000","last_undegraded":"2024-04-24T23:07:55.885541+0000","last_fullsized":"2024-04-24T23:07:55.885541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1045,"log_dups_size":0,"ondisk_log_size":1045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1330,"num_write_kb":7257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'367","reported_seq":394,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.443750+0000","last_change":"2024-04-24T23:00:16.452682+0000","last_active":"2024-04-24T23:08:02.443750+0000","last_peered":"2024-04-24T23:08:02.443750+0000","last_clean":"2024-04-24T23:08:02.443750+0000","last_became_active":"2024-04-24T23:00:16.447742+0000","last_became_peered":"2024-04-24T23:00:16.447742+0000","last_unstale":"2024-04-24T23:08:02.443750+0000","last_undegraded":"2024-04-24T23:08:02.443750+0000","last_fullsized":"2024-04-24T23:08:02.443750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'267","reported_seq":297,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:56.726948+0000","last_change":"2024-04-24T23:00:15.416986+0000","last_active":"2024-04-24T23:07:56.726948+0000","last_peered":"2024-04-24T23:07:56.726948+0000","last_clean":"2024-04-24T23:07:56.726948+0000","last_became_active":"2024-04-24T23:00:15.416198+0000","last_became_peered":"2024-04-24T23:00:15.416198+0000","last_unstale":"2024-04-24T23:07:56.726948+0000","last_undegraded":"2024-04-24T23:07:56.726948+0000","last_fullsized":"2024-04-24T23:07:56.726948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":330,"num_write_kb":8690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'1004","reported_seq":1025,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.833315+0000","last_change":"2024-04-24T23:00:20.526621+0000","last_active":"2024-04-24T23:07:55.833315+0000","last_peered":"2024-04-24T23:07:55.833315+0000","last_clean":"2024-04-24T23:07:55.833315+0000","last_became_active":"2024-04-24T23:00:20.525782+0000","last_became_peered":"2024-04-24T23:00:20.525782+0000","last_unstale":"2024-04-24T23:07:55.833315+0000","last_undegraded":"2024-04-24T23:07:55.833315+0000","last_fullsized":"2024-04-24T23:07:55.833315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:38:28.209697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":7027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'336","reported_seq":364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.471407+0000","last_change":"2024-04-24T23:00:16.454748+0000","last_active":"2024-04-24T23:08:02.471407+0000","last_peered":"2024-04-24T23:08:02.471407+0000","last_clean":"2024-04-24T23:08:02.471407+0000","last_became_active":"2024-04-24T23:00:16.454031+0000","last_became_peered":"2024-04-24T23:00:16.454031+0000","last_unstale":"2024-04-24T23:08:02.471407+0000","last_undegraded":"2024-04-24T23:08:02.471407+0000","last_fullsized":"2024-04-24T23:08:02.471407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'68","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.886527+0000","last_change":"2024-04-24T23:00:15.420149+0000","last_active":"2024-04-24T23:07:54.886527+0000","last_peered":"2024-04-24T23:07:54.886527+0000","last_clean":"2024-04-24T23:07:54.886527+0000","last_became_active":"2024-04-24T23:00:15.416688+0000","last_became_peered":"2024-04-24T23:00:15.416688+0000","last_unstale":"2024-04-24T23:07:54.886527+0000","last_undegraded":"2024-04-24T23:07:54.886527+0000","last_fullsized":"2024-04-24T23:07:54.886527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":106,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'996","reported_seq":1017,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.798909+0000","last_change":"2024-04-24T23:00:20.517137+0000","last_active":"2024-04-24T23:07:55.798909+0000","last_peered":"2024-04-24T23:07:55.798909+0000","last_clean":"2024-04-24T23:07:55.798909+0000","last_became_active":"2024-04-24T23:00:20.516152+0000","last_became_peered":"2024-04-24T23:00:20.516152+0000","last_unstale":"2024-04-24T23:07:55.798909+0000","last_undegraded":"2024-04-24T23:07:55.798909+0000","last_fullsized":"2024-04-24T23:07:55.798909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:29.452352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":6136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'317","reported_seq":344,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.472125+0000","last_change":"2024-04-24T23:00:16.458939+0000","last_active":"2024-04-24T23:08:02.472125+0000","last_peered":"2024-04-24T23:08:02.472125+0000","last_clean":"2024-04-24T23:08:02.472125+0000","last_became_active":"2024-04-24T23:00:16.458081+0000","last_became_peered":"2024-04-24T23:00:16.458081+0000","last_unstale":"2024-04-24T23:08:02.472125+0000","last_undegraded":"2024-04-24T23:08:02.472125+0000","last_fullsized":"2024-04-24T23:08:02.472125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'41","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:50.667052+0000","last_change":"2024-04-24T23:00:15.413409+0000","last_active":"2024-04-24T23:07:50.667052+0000","last_peered":"2024-04-24T23:07:50.667052+0000","last_clean":"2024-04-24T23:07:50.667052+0000","last_became_active":"2024-04-24T23:00:15.412847+0000","last_became_peered":"2024-04-24T23:00:15.412847+0000","last_unstale":"2024-04-24T23:07:50.667052+0000","last_undegraded":"2024-04-24T23:07:50.667052+0000","last_fullsized":"2024-04-24T23:07:50.667052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":81,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'915","reported_seq":936,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.796705+0000","last_change":"2024-04-24T23:00:20.536112+0000","last_active":"2024-04-24T23:07:55.796705+0000","last_peered":"2024-04-24T23:07:55.796705+0000","last_clean":"2024-04-24T23:07:55.796705+0000","last_became_active":"2024-04-24T23:00:20.529427+0000","last_became_peered":"2024-04-24T23:00:20.529427+0000","last_unstale":"2024-04-24T23:07:55.796705+0000","last_undegraded":"2024-04-24T23:07:55.796705+0000","last_fullsized":"2024-04-24T23:07:55.796705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:14.639189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":6219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'322","reported_seq":349,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.455462+0000","last_change":"2024-04-24T23:00:16.465373+0000","last_active":"2024-04-24T23:08:02.455462+0000","last_peered":"2024-04-24T23:08:02.455462+0000","last_clean":"2024-04-24T23:08:02.455462+0000","last_became_active":"2024-04-24T23:00:16.464653+0000","last_became_peered":"2024-04-24T23:00:16.464653+0000","last_unstale":"2024-04-24T23:08:02.455462+0000","last_undegraded":"2024-04-24T23:08:02.455462+0000","last_fullsized":"2024-04-24T23:08:02.455462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:43:24.143678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'531","reported_seq":560,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:51.885087+0000","last_change":"2024-04-24T23:00:15.427483+0000","last_active":"2024-04-24T23:07:51.885087+0000","last_peered":"2024-04-24T23:07:51.885087+0000","last_clean":"2024-04-24T23:07:51.885087+0000","last_became_active":"2024-04-24T23:00:15.426641+0000","last_became_peered":"2024-04-24T23:00:15.426641+0000","last_unstale":"2024-04-24T23:07:51.885087+0000","last_undegraded":"2024-04-24T23:07:51.885087+0000","last_fullsized":"2024-04-24T23:07:51.885087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:09.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":566,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'952","reported_seq":974,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.869155+0000","last_change":"2024-04-24T23:00:20.518479+0000","last_active":"2024-04-24T23:07:55.869155+0000","last_peered":"2024-04-24T23:07:55.869155+0000","last_clean":"2024-04-24T23:07:55.869155+0000","last_became_active":"2024-04-24T23:00:20.517950+0000","last_became_peered":"2024-04-24T23:00:20.517950+0000","last_unstale":"2024-04-24T23:07:55.869155+0000","last_undegraded":"2024-04-24T23:07:55.869155+0000","last_fullsized":"2024-04-24T23:07:55.869155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":7094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'294","reported_seq":322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.473469+0000","last_change":"2024-04-24T23:00:16.456931+0000","last_active":"2024-04-24T23:08:02.473469+0000","last_peered":"2024-04-24T23:08:02.473469+0000","last_clean":"2024-04-24T23:08:02.473469+0000","last_became_active":"2024-04-24T23:00:16.456636+0000","last_became_peered":"2024-04-24T23:00:16.456636+0000","last_unstale":"2024-04-24T23:08:02.473469+0000","last_undegraded":"2024-04-24T23:08:02.473469+0000","last_fullsized":"2024-04-24T23:08:02.473469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'571","reported_seq":608,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:07.410854+0000","last_change":"2024-04-24T23:08:07.410907+0000","last_active":"2024-04-24T23:08:07.410854+0000","last_peered":"2024-04-24T23:08:07.410854+0000","last_clean":"2024-04-24T23:08:07.410854+0000","last_became_active":"2024-04-24T23:00:15.427837+0000","last_became_peered":"2024-04-24T23:00:15.427837+0000","last_unstale":"2024-04-24T23:08:07.410854+0000","last_undegraded":"2024-04-24T23:08:07.410854+0000","last_fullsized":"2024-04-24T23:08:07.410854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'571","last_scrub_stamp":"2024-04-24T23:08:07.410756+0000","last_deep_scrub":"27'571","last_deep_scrub_stamp":"2024-04-24T23:08:07.410756+0000","last_clean_scrub_stamp":"2024-04-24T23:08:07.410756+0000","objects_scrubbed":4,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:36:51.328741+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":635,"num_write_kb":21119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'1015","reported_seq":1044,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.878248+0000","last_change":"2024-04-24T23:00:57.865502+0000","last_active":"2024-04-24T23:07:55.878248+0000","last_peered":"2024-04-24T23:07:55.878248+0000","last_clean":"2024-04-24T23:07:55.878248+0000","last_became_active":"2024-04-24T23:00:57.864156+0000","last_became_peered":"2024-04-24T23:00:57.864156+0000","last_unstale":"2024-04-24T23:07:55.878248+0000","last_undegraded":"2024-04-24T23:07:55.878248+0000","last_fullsized":"2024-04-24T23:07:55.878248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":6923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'298","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.443432+0000","last_change":"2024-04-24T23:00:16.453438+0000","last_active":"2024-04-24T23:08:02.443432+0000","last_peered":"2024-04-24T23:08:02.443432+0000","last_clean":"2024-04-24T23:08:02.443432+0000","last_became_active":"2024-04-24T23:00:16.453033+0000","last_became_peered":"2024-04-24T23:00:16.453033+0000","last_unstale":"2024-04-24T23:08:02.443432+0000","last_undegraded":"2024-04-24T23:08:02.443432+0000","last_fullsized":"2024-04-24T23:08:02.443432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'667","reported_seq":696,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.918276+0000","last_change":"2024-04-24T23:00:15.431369+0000","last_active":"2024-04-24T23:07:55.918276+0000","last_peered":"2024-04-24T23:07:55.918276+0000","last_clean":"2024-04-24T23:07:55.918276+0000","last_became_active":"2024-04-24T23:00:15.430254+0000","last_became_peered":"2024-04-24T23:00:15.430254+0000","last_unstale":"2024-04-24T23:07:55.918276+0000","last_undegraded":"2024-04-24T23:07:55.918276+0000","last_fullsized":"2024-04-24T23:07:55.918276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:20:36.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":729,"num_write_kb":21519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'963","reported_seq":985,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.912598+0000","last_change":"2024-04-24T23:00:20.503369+0000","last_active":"2024-04-24T23:07:55.912598+0000","last_peered":"2024-04-24T23:07:55.912598+0000","last_clean":"2024-04-24T23:07:55.912598+0000","last_became_active":"2024-04-24T23:00:20.502285+0000","last_became_peered":"2024-04-24T23:00:20.502285+0000","last_unstale":"2024-04-24T23:07:55.912598+0000","last_undegraded":"2024-04-24T23:07:55.912598+0000","last_fullsized":"2024-04-24T23:07:55.912598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'299","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.472446+0000","last_change":"2024-04-24T23:00:16.452958+0000","last_active":"2024-04-24T23:08:02.472446+0000","last_peered":"2024-04-24T23:08:02.472446+0000","last_clean":"2024-04-24T23:08:02.472446+0000","last_became_active":"2024-04-24T23:00:16.451611+0000","last_became_peered":"2024-04-24T23:00:16.451611+0000","last_unstale":"2024-04-24T23:08:02.472446+0000","last_undegraded":"2024-04-24T23:08:02.472446+0000","last_fullsized":"2024-04-24T23:08:02.472446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:07:06.283705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'414","reported_seq":444,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.729869+0000","last_change":"2024-04-24T23:00:15.397614+0000","last_active":"2024-04-24T23:07:55.729869+0000","last_peered":"2024-04-24T23:07:55.729869+0000","last_clean":"2024-04-24T23:07:55.729869+0000","last_became_active":"2024-04-24T23:00:15.397253+0000","last_became_peered":"2024-04-24T23:00:15.397253+0000","last_unstale":"2024-04-24T23:07:55.729869+0000","last_undegraded":"2024-04-24T23:07:55.729869+0000","last_fullsized":"2024-04-24T23:07:55.729869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":486,"num_write_kb":21108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'1063","reported_seq":1084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.895876+0000","last_change":"2024-04-24T23:00:20.506736+0000","last_active":"2024-04-24T23:07:55.895876+0000","last_peered":"2024-04-24T23:07:55.895876+0000","last_clean":"2024-04-24T23:07:55.895876+0000","last_became_active":"2024-04-24T23:00:20.505504+0000","last_became_peered":"2024-04-24T23:00:20.505504+0000","last_unstale":"2024-04-24T23:07:55.895876+0000","last_undegraded":"2024-04-24T23:07:55.895876+0000","last_fullsized":"2024-04-24T23:07:55.895876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:10.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1319,"num_write_kb":7863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'344","reported_seq":371,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.484693+0000","last_change":"2024-04-24T23:00:16.451217+0000","last_active":"2024-04-24T23:08:02.484693+0000","last_peered":"2024-04-24T23:08:02.484693+0000","last_clean":"2024-04-24T23:08:02.484693+0000","last_became_active":"2024-04-24T23:00:16.450149+0000","last_became_peered":"2024-04-24T23:00:16.450149+0000","last_unstale":"2024-04-24T23:08:02.484693+0000","last_undegraded":"2024-04-24T23:08:02.484693+0000","last_fullsized":"2024-04-24T23:08:02.484693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'68","reported_seq":98,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.897754+0000","last_change":"2024-04-24T23:00:15.428164+0000","last_active":"2024-04-24T23:07:54.897754+0000","last_peered":"2024-04-24T23:07:54.897754+0000","last_clean":"2024-04-24T23:07:54.897754+0000","last_became_active":"2024-04-24T23:00:15.427857+0000","last_became_peered":"2024-04-24T23:00:15.427857+0000","last_unstale":"2024-04-24T23:07:54.897754+0000","last_undegraded":"2024-04-24T23:07:54.897754+0000","last_fullsized":"2024-04-24T23:07:54.897754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":104,"num_write_kb":4310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'1074","reported_seq":1096,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.904783+0000","last_change":"2024-04-24T23:00:20.507135+0000","last_active":"2024-04-24T23:07:55.904783+0000","last_peered":"2024-04-24T23:07:55.904783+0000","last_clean":"2024-04-24T23:07:55.904783+0000","last_became_active":"2024-04-24T23:00:20.506257+0000","last_became_peered":"2024-04-24T23:00:20.506257+0000","last_unstale":"2024-04-24T23:07:55.904783+0000","last_undegraded":"2024-04-24T23:07:55.904783+0000","last_fullsized":"2024-04-24T23:07:55.904783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":7398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1072","reported_seq":1101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.905305+0000","last_change":"2024-04-24T23:00:57.867192+0000","last_active":"2024-04-24T23:07:55.905305+0000","last_peered":"2024-04-24T23:07:55.905305+0000","last_clean":"2024-04-24T23:07:55.905305+0000","last_became_active":"2024-04-24T23:00:57.865999+0000","last_became_peered":"2024-04-24T23:00:57.865999+0000","last_unstale":"2024-04-24T23:07:55.905305+0000","last_undegraded":"2024-04-24T23:07:55.905305+0000","last_fullsized":"2024-04-24T23:07:55.905305+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1072,"log_dups_size":0,"ondisk_log_size":1072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1313,"num_write_kb":7137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'327","reported_seq":355,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.471551+0000","last_change":"2024-04-24T23:00:16.478734+0000","last_active":"2024-04-24T23:08:02.471551+0000","last_peered":"2024-04-24T23:08:02.471551+0000","last_clean":"2024-04-24T23:08:02.471551+0000","last_became_active":"2024-04-24T23:00:16.477474+0000","last_became_peered":"2024-04-24T23:00:16.477474+0000","last_unstale":"2024-04-24T23:08:02.471551+0000","last_undegraded":"2024-04-24T23:08:02.471551+0000","last_fullsized":"2024-04-24T23:08:02.471551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'570","reported_seq":599,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:52.715965+0000","last_change":"2024-04-24T23:00:15.405948+0000","last_active":"2024-04-24T23:07:52.715965+0000","last_peered":"2024-04-24T23:07:52.715965+0000","last_clean":"2024-04-24T23:07:52.715965+0000","last_became_active":"2024-04-24T23:00:15.405608+0000","last_became_peered":"2024-04-24T23:00:15.405608+0000","last_unstale":"2024-04-24T23:07:52.715965+0000","last_undegraded":"2024-04-24T23:07:52.715965+0000","last_fullsized":"2024-04-24T23:07:52.715965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":627,"num_write_kb":21153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'936","reported_seq":958,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.906702+0000","last_change":"2024-04-24T23:00:20.493810+0000","last_active":"2024-04-24T23:07:55.906702+0000","last_peered":"2024-04-24T23:07:55.906702+0000","last_clean":"2024-04-24T23:07:55.906702+0000","last_became_active":"2024-04-24T23:00:20.492303+0000","last_became_peered":"2024-04-24T23:00:20.492303+0000","last_unstale":"2024-04-24T23:07:55.906702+0000","last_undegraded":"2024-04-24T23:07:55.906702+0000","last_fullsized":"2024-04-24T23:07:55.906702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":6525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'358","reported_seq":385,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.478846+0000","last_change":"2024-04-24T23:00:16.465460+0000","last_active":"2024-04-24T23:08:02.478846+0000","last_peered":"2024-04-24T23:08:02.478846+0000","last_clean":"2024-04-24T23:08:02.478846+0000","last_became_active":"2024-04-24T23:00:16.457311+0000","last_became_peered":"2024-04-24T23:00:16.457311+0000","last_unstale":"2024-04-24T23:08:02.478846+0000","last_undegraded":"2024-04-24T23:08:02.478846+0000","last_fullsized":"2024-04-24T23:08:02.478846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:43:08.876496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":274,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'151","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.731772+0000","last_change":"2024-04-24T23:00:15.436608+0000","last_active":"2024-04-24T23:07:55.731772+0000","last_peered":"2024-04-24T23:07:55.731772+0000","last_clean":"2024-04-24T23:07:55.731772+0000","last_became_active":"2024-04-24T23:00:15.435730+0000","last_became_peered":"2024-04-24T23:00:15.435730+0000","last_unstale":"2024-04-24T23:07:55.731772+0000","last_undegraded":"2024-04-24T23:07:55.731772+0000","last_fullsized":"2024-04-24T23:07:55.731772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:18.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":198,"num_write_kb":4560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'1083","reported_seq":1112,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:54.887362+0000","last_change":"2024-04-24T23:00:15.417533+0000","last_active":"2024-04-24T23:07:54.887362+0000","last_peered":"2024-04-24T23:07:54.887362+0000","last_clean":"2024-04-24T23:07:54.887362+0000","last_became_active":"2024-04-24T23:00:15.417226+0000","last_became_peered":"2024-04-24T23:00:15.417226+0000","last_unstale":"2024-04-24T23:07:54.887362+0000","last_undegraded":"2024-04-24T23:07:54.887362+0000","last_fullsized":"2024-04-24T23:07:54.887362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":1083,"log_dups_size":0,"ondisk_log_size":1083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":1127,"num_write_kb":29507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'300","reported_seq":328,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.475583+0000","last_change":"2024-04-24T23:00:16.483374+0000","last_active":"2024-04-24T23:08:02.475583+0000","last_peered":"2024-04-24T23:08:02.475583+0000","last_clean":"2024-04-24T23:08:02.475583+0000","last_became_active":"2024-04-24T23:00:16.482676+0000","last_became_peered":"2024-04-24T23:00:16.482676+0000","last_unstale":"2024-04-24T23:08:02.475583+0000","last_undegraded":"2024-04-24T23:08:02.475583+0000","last_fullsized":"2024-04-24T23:08:02.475583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'936","reported_seq":958,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.864514+0000","last_change":"2024-04-24T23:00:20.542916+0000","last_active":"2024-04-24T23:07:55.864514+0000","last_peered":"2024-04-24T23:07:55.864514+0000","last_clean":"2024-04-24T23:07:55.864514+0000","last_became_active":"2024-04-24T23:00:20.541822+0000","last_became_peered":"2024-04-24T23:00:20.541822+0000","last_unstale":"2024-04-24T23:07:55.864514+0000","last_undegraded":"2024-04-24T23:07:55.864514+0000","last_fullsized":"2024-04-24T23:07:55.864514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":5864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'464","reported_seq":493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:48.756371+0000","last_change":"2024-04-24T23:00:15.425495+0000","last_active":"2024-04-24T23:07:48.756371+0000","last_peered":"2024-04-24T23:07:48.756371+0000","last_clean":"2024-04-24T23:07:48.756371+0000","last_became_active":"2024-04-24T23:00:15.424739+0000","last_became_peered":"2024-04-24T23:00:15.424739+0000","last_unstale":"2024-04-24T23:07:48.756371+0000","last_undegraded":"2024-04-24T23:07:48.756371+0000","last_fullsized":"2024-04-24T23:07:48.756371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:14.367757+0000","last_clean_scrub_stamp":"2024-04-24T23:00:14.367757+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:49.740745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":495,"num_write_kb":8616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'329","reported_seq":357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.465023+0000","last_change":"2024-04-24T23:00:16.454250+0000","last_active":"2024-04-24T23:08:02.465023+0000","last_peered":"2024-04-24T23:08:02.465023+0000","last_clean":"2024-04-24T23:08:02.465023+0000","last_became_active":"2024-04-24T23:00:16.453965+0000","last_became_peered":"2024-04-24T23:00:16.453965+0000","last_unstale":"2024-04-24T23:08:02.465023+0000","last_undegraded":"2024-04-24T23:08:02.465023+0000","last_fullsized":"2024-04-24T23:08:02.465023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'945","reported_seq":966,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.864627+0000","last_change":"2024-04-24T23:00:20.510475+0000","last_active":"2024-04-24T23:07:55.864627+0000","last_peered":"2024-04-24T23:07:55.864627+0000","last_clean":"2024-04-24T23:07:55.864627+0000","last_became_active":"2024-04-24T23:00:20.509269+0000","last_became_peered":"2024-04-24T23:00:20.509269+0000","last_unstale":"2024-04-24T23:07:55.864627+0000","last_undegraded":"2024-04-24T23:07:55.864627+0000","last_fullsized":"2024-04-24T23:07:55.864627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:09.596902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":6611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'351","reported_seq":378,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.455155+0000","last_change":"2024-04-24T23:00:16.456976+0000","last_active":"2024-04-24T23:08:02.455155+0000","last_peered":"2024-04-24T23:08:02.455155+0000","last_clean":"2024-04-24T23:08:02.455155+0000","last_became_active":"2024-04-24T23:00:16.456289+0000","last_became_peered":"2024-04-24T23:00:16.456289+0000","last_unstale":"2024-04-24T23:08:02.455155+0000","last_undegraded":"2024-04-24T23:08:02.455155+0000","last_fullsized":"2024-04-24T23:08:02.455155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'354","reported_seq":381,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.461531+0000","last_change":"2024-04-24T23:00:16.471774+0000","last_active":"2024-04-24T23:08:02.461531+0000","last_peered":"2024-04-24T23:08:02.461531+0000","last_clean":"2024-04-24T23:08:02.461531+0000","last_became_active":"2024-04-24T23:00:16.466134+0000","last_became_peered":"2024-04-24T23:00:16.466134+0000","last_unstale":"2024-04-24T23:08:02.461531+0000","last_undegraded":"2024-04-24T23:08:02.461531+0000","last_fullsized":"2024-04-24T23:08:02.461531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:31.237423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'352","reported_seq":379,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.464722+0000","last_change":"2024-04-24T23:00:16.465926+0000","last_active":"2024-04-24T23:08:02.464722+0000","last_peered":"2024-04-24T23:08:02.464722+0000","last_clean":"2024-04-24T23:08:02.464722+0000","last_became_active":"2024-04-24T23:00:16.465659+0000","last_became_peered":"2024-04-24T23:00:16.465659+0000","last_unstale":"2024-04-24T23:08:02.464722+0000","last_undegraded":"2024-04-24T23:08:02.464722+0000","last_fullsized":"2024-04-24T23:08:02.464722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'319","reported_seq":346,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.448705+0000","last_change":"2024-04-24T23:00:16.474929+0000","last_active":"2024-04-24T23:08:02.448705+0000","last_peered":"2024-04-24T23:08:02.448705+0000","last_clean":"2024-04-24T23:08:02.448705+0000","last_became_active":"2024-04-24T23:00:16.474181+0000","last_became_peered":"2024-04-24T23:00:16.474181+0000","last_unstale":"2024-04-24T23:08:02.448705+0000","last_undegraded":"2024-04-24T23:08:02.448705+0000","last_fullsized":"2024-04-24T23:08:02.448705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:56.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'298","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.473766+0000","last_change":"2024-04-24T23:00:16.458411+0000","last_active":"2024-04-24T23:08:02.473766+0000","last_peered":"2024-04-24T23:08:02.473766+0000","last_clean":"2024-04-24T23:08:02.473766+0000","last_became_active":"2024-04-24T23:00:16.457641+0000","last_became_peered":"2024-04-24T23:00:16.457641+0000","last_unstale":"2024-04-24T23:08:02.473766+0000","last_undegraded":"2024-04-24T23:08:02.473766+0000","last_fullsized":"2024-04-24T23:08:02.473766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:06.907656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'302","reported_seq":329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.452407+0000","last_change":"2024-04-24T23:00:16.470324+0000","last_active":"2024-04-24T23:08:02.452407+0000","last_peered":"2024-04-24T23:08:02.452407+0000","last_clean":"2024-04-24T23:08:02.452407+0000","last_became_active":"2024-04-24T23:00:16.469614+0000","last_became_peered":"2024-04-24T23:00:16.469614+0000","last_unstale":"2024-04-24T23:08:02.452407+0000","last_undegraded":"2024-04-24T23:08:02.452407+0000","last_fullsized":"2024-04-24T23:08:02.452407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:05.517520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'376","reported_seq":403,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.483155+0000","last_change":"2024-04-24T23:00:16.450764+0000","last_active":"2024-04-24T23:08:02.483155+0000","last_peered":"2024-04-24T23:08:02.483155+0000","last_clean":"2024-04-24T23:08:02.483155+0000","last_became_active":"2024-04-24T23:00:16.450561+0000","last_became_peered":"2024-04-24T23:00:16.450561+0000","last_unstale":"2024-04-24T23:08:02.483155+0000","last_undegraded":"2024-04-24T23:08:02.483155+0000","last_fullsized":"2024-04-24T23:08:02.483155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'354","reported_seq":381,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.469742+0000","last_change":"2024-04-24T23:00:16.453953+0000","last_active":"2024-04-24T23:08:02.469742+0000","last_peered":"2024-04-24T23:08:02.469742+0000","last_clean":"2024-04-24T23:08:02.469742+0000","last_became_active":"2024-04-24T23:00:16.452345+0000","last_became_peered":"2024-04-24T23:00:16.452345+0000","last_unstale":"2024-04-24T23:08:02.469742+0000","last_undegraded":"2024-04-24T23:08:02.469742+0000","last_fullsized":"2024-04-24T23:08:02.469742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:58.273719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'336","reported_seq":363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.465622+0000","last_change":"2024-04-24T23:00:16.459030+0000","last_active":"2024-04-24T23:08:02.465622+0000","last_peered":"2024-04-24T23:08:02.465622+0000","last_clean":"2024-04-24T23:08:02.465622+0000","last_became_active":"2024-04-24T23:00:16.458402+0000","last_became_peered":"2024-04-24T23:00:16.458402+0000","last_unstale":"2024-04-24T23:08:02.465622+0000","last_undegraded":"2024-04-24T23:08:02.465622+0000","last_fullsized":"2024-04-24T23:08:02.465622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'306","reported_seq":333,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.465168+0000","last_change":"2024-04-24T23:00:16.456818+0000","last_active":"2024-04-24T23:08:02.465168+0000","last_peered":"2024-04-24T23:08:02.465168+0000","last_clean":"2024-04-24T23:08:02.465168+0000","last_became_active":"2024-04-24T23:00:16.453065+0000","last_became_peered":"2024-04-24T23:00:16.453065+0000","last_unstale":"2024-04-24T23:08:02.465168+0000","last_undegraded":"2024-04-24T23:08:02.465168+0000","last_fullsized":"2024-04-24T23:08:02.465168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:02.728439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'329","reported_seq":362,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.461155+0000","last_change":"2024-04-24T23:00:57.866802+0000","last_active":"2024-04-24T23:08:02.461155+0000","last_peered":"2024-04-24T23:08:02.461155+0000","last_clean":"2024-04-24T23:08:02.461155+0000","last_became_active":"2024-04-24T23:00:57.865894+0000","last_became_peered":"2024-04-24T23:00:57.865894+0000","last_unstale":"2024-04-24T23:08:02.461155+0000","last_undegraded":"2024-04-24T23:08:02.461155+0000","last_fullsized":"2024-04-24T23:08:02.461155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'309","reported_seq":337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.469074+0000","last_change":"2024-04-24T23:00:16.478716+0000","last_active":"2024-04-24T23:08:02.469074+0000","last_peered":"2024-04-24T23:08:02.469074+0000","last_clean":"2024-04-24T23:08:02.469074+0000","last_became_active":"2024-04-24T23:00:16.477982+0000","last_became_peered":"2024-04-24T23:00:16.477982+0000","last_unstale":"2024-04-24T23:08:02.469074+0000","last_undegraded":"2024-04-24T23:08:02.469074+0000","last_fullsized":"2024-04-24T23:08:02.469074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'353","reported_seq":389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:07.012983+0000","last_change":"2024-04-24T23:08:07.013005+0000","last_active":"2024-04-24T23:08:07.012983+0000","last_peered":"2024-04-24T23:08:07.012983+0000","last_clean":"2024-04-24T23:08:07.012983+0000","last_became_active":"2024-04-24T23:00:16.446583+0000","last_became_peered":"2024-04-24T23:00:16.446583+0000","last_unstale":"2024-04-24T23:08:07.012983+0000","last_undegraded":"2024-04-24T23:08:07.012983+0000","last_fullsized":"2024-04-24T23:08:07.012983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'353","last_scrub_stamp":"2024-04-24T23:08:07.012914+0000","last_deep_scrub":"27'353","last_deep_scrub_stamp":"2024-04-24T23:08:07.012914+0000","last_clean_scrub_stamp":"2024-04-24T23:08:07.012914+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:49:46.599567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'307","reported_seq":334,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.466692+0000","last_change":"2024-04-24T23:00:16.483354+0000","last_active":"2024-04-24T23:08:02.466692+0000","last_peered":"2024-04-24T23:08:02.466692+0000","last_clean":"2024-04-24T23:08:02.466692+0000","last_became_active":"2024-04-24T23:00:16.483079+0000","last_became_peered":"2024-04-24T23:00:16.483079+0000","last_unstale":"2024-04-24T23:08:02.466692+0000","last_undegraded":"2024-04-24T23:08:02.466692+0000","last_fullsized":"2024-04-24T23:08:02.466692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'303","reported_seq":330,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.464863+0000","last_change":"2024-04-24T23:00:16.472605+0000","last_active":"2024-04-24T23:08:02.464863+0000","last_peered":"2024-04-24T23:08:02.464863+0000","last_clean":"2024-04-24T23:08:02.464863+0000","last_became_active":"2024-04-24T23:00:16.466076+0000","last_became_peered":"2024-04-24T23:00:16.466076+0000","last_unstale":"2024-04-24T23:08:02.464863+0000","last_undegraded":"2024-04-24T23:08:02.464863+0000","last_fullsized":"2024-04-24T23:08:02.464863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:39.569705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'324","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.469077+0000","last_change":"2024-04-24T23:00:16.457737+0000","last_active":"2024-04-24T23:08:02.469077+0000","last_peered":"2024-04-24T23:08:02.469077+0000","last_clean":"2024-04-24T23:08:02.469077+0000","last_became_active":"2024-04-24T23:00:16.453949+0000","last_became_peered":"2024-04-24T23:00:16.453949+0000","last_unstale":"2024-04-24T23:08:02.469077+0000","last_undegraded":"2024-04-24T23:08:02.469077+0000","last_fullsized":"2024-04-24T23:08:02.469077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'334","reported_seq":369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:07.850824+0000","last_change":"2024-04-24T23:08:07.850872+0000","last_active":"2024-04-24T23:08:07.850824+0000","last_peered":"2024-04-24T23:08:07.850824+0000","last_clean":"2024-04-24T23:08:07.850824+0000","last_became_active":"2024-04-24T23:00:16.445253+0000","last_became_peered":"2024-04-24T23:00:16.445253+0000","last_unstale":"2024-04-24T23:08:07.850824+0000","last_undegraded":"2024-04-24T23:08:07.850824+0000","last_fullsized":"2024-04-24T23:08:07.850824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'334","last_scrub_stamp":"2024-04-24T23:08:07.850716+0000","last_deep_scrub":"27'334","last_deep_scrub_stamp":"2024-04-24T23:08:07.850716+0000","last_clean_scrub_stamp":"2024-04-24T23:08:07.850716+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:50:57.678621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'307","reported_seq":334,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.473165+0000","last_change":"2024-04-24T23:00:16.455784+0000","last_active":"2024-04-24T23:08:02.473165+0000","last_peered":"2024-04-24T23:08:02.473165+0000","last_clean":"2024-04-24T23:08:02.473165+0000","last_became_active":"2024-04-24T23:00:16.454953+0000","last_became_peered":"2024-04-24T23:00:16.454953+0000","last_unstale":"2024-04-24T23:08:02.473165+0000","last_undegraded":"2024-04-24T23:08:02.473165+0000","last_fullsized":"2024-04-24T23:08:02.473165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:06:32.545524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'318","reported_seq":345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.463934+0000","last_change":"2024-04-24T23:00:16.468365+0000","last_active":"2024-04-24T23:08:02.463934+0000","last_peered":"2024-04-24T23:08:02.463934+0000","last_clean":"2024-04-24T23:08:02.463934+0000","last_became_active":"2024-04-24T23:00:16.467630+0000","last_became_peered":"2024-04-24T23:00:16.467630+0000","last_unstale":"2024-04-24T23:08:02.463934+0000","last_undegraded":"2024-04-24T23:08:02.463934+0000","last_fullsized":"2024-04-24T23:08:02.463934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:13:25.768338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'309","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.474213+0000","last_change":"2024-04-24T23:00:16.456188+0000","last_active":"2024-04-24T23:08:02.474213+0000","last_peered":"2024-04-24T23:08:02.474213+0000","last_clean":"2024-04-24T23:08:02.474213+0000","last_became_active":"2024-04-24T23:00:16.455114+0000","last_became_peered":"2024-04-24T23:00:16.455114+0000","last_unstale":"2024-04-24T23:08:02.474213+0000","last_undegraded":"2024-04-24T23:08:02.474213+0000","last_fullsized":"2024-04-24T23:08:02.474213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:36.124103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'287","reported_seq":315,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.475685+0000","last_change":"2024-04-24T23:00:16.450776+0000","last_active":"2024-04-24T23:08:02.475685+0000","last_peered":"2024-04-24T23:08:02.475685+0000","last_clean":"2024-04-24T23:08:02.475685+0000","last_became_active":"2024-04-24T23:00:16.450466+0000","last_became_peered":"2024-04-24T23:00:16.450466+0000","last_unstale":"2024-04-24T23:08:02.475685+0000","last_undegraded":"2024-04-24T23:08:02.475685+0000","last_fullsized":"2024-04-24T23:08:02.475685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'307","reported_seq":335,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.473677+0000","last_change":"2024-04-24T23:00:16.450743+0000","last_active":"2024-04-24T23:08:02.473677+0000","last_peered":"2024-04-24T23:08:02.473677+0000","last_clean":"2024-04-24T23:08:02.473677+0000","last_became_active":"2024-04-24T23:00:16.450279+0000","last_became_peered":"2024-04-24T23:00:16.450279+0000","last_unstale":"2024-04-24T23:08:02.473677+0000","last_undegraded":"2024-04-24T23:08:02.473677+0000","last_fullsized":"2024-04-24T23:08:02.473677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'298","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.473860+0000","last_change":"2024-04-24T23:00:16.446745+0000","last_active":"2024-04-24T23:08:02.473860+0000","last_peered":"2024-04-24T23:08:02.473860+0000","last_clean":"2024-04-24T23:08:02.473860+0000","last_became_active":"2024-04-24T23:00:16.446317+0000","last_became_peered":"2024-04-24T23:00:16.446317+0000","last_unstale":"2024-04-24T23:08:02.473860+0000","last_undegraded":"2024-04-24T23:08:02.473860+0000","last_fullsized":"2024-04-24T23:08:02.473860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'337","reported_seq":365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.441040+0000","last_change":"2024-04-24T23:00:16.446352+0000","last_active":"2024-04-24T23:08:02.441040+0000","last_peered":"2024-04-24T23:08:02.441040+0000","last_clean":"2024-04-24T23:08:02.441040+0000","last_became_active":"2024-04-24T23:00:16.445839+0000","last_became_peered":"2024-04-24T23:00:16.445839+0000","last_unstale":"2024-04-24T23:08:02.441040+0000","last_undegraded":"2024-04-24T23:08:02.441040+0000","last_fullsized":"2024-04-24T23:08:02.441040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'273","reported_seq":300,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.481598+0000","last_change":"2024-04-24T23:00:16.451439+0000","last_active":"2024-04-24T23:08:02.481598+0000","last_peered":"2024-04-24T23:08:02.481598+0000","last_clean":"2024-04-24T23:08:02.481598+0000","last_became_active":"2024-04-24T23:00:16.450293+0000","last_became_peered":"2024-04-24T23:00:16.450293+0000","last_unstale":"2024-04-24T23:08:02.481598+0000","last_undegraded":"2024-04-24T23:08:02.481598+0000","last_fullsized":"2024-04-24T23:08:02.481598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:19.586817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'314","reported_seq":342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.470429+0000","last_change":"2024-04-24T23:00:16.482222+0000","last_active":"2024-04-24T23:08:02.470429+0000","last_peered":"2024-04-24T23:08:02.470429+0000","last_clean":"2024-04-24T23:08:02.470429+0000","last_became_active":"2024-04-24T23:00:16.481897+0000","last_became_peered":"2024-04-24T23:00:16.481897+0000","last_unstale":"2024-04-24T23:08:02.470429+0000","last_undegraded":"2024-04-24T23:08:02.470429+0000","last_fullsized":"2024-04-24T23:08:02.470429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'318","reported_seq":345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.468234+0000","last_change":"2024-04-24T23:00:16.482100+0000","last_active":"2024-04-24T23:08:02.468234+0000","last_peered":"2024-04-24T23:08:02.468234+0000","last_clean":"2024-04-24T23:08:02.468234+0000","last_became_active":"2024-04-24T23:00:16.481832+0000","last_became_peered":"2024-04-24T23:00:16.481832+0000","last_unstale":"2024-04-24T23:08:02.468234+0000","last_undegraded":"2024-04-24T23:08:02.468234+0000","last_fullsized":"2024-04-24T23:08:02.468234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'323","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.473231+0000","last_change":"2024-04-24T23:00:16.466121+0000","last_active":"2024-04-24T23:08:02.473231+0000","last_peered":"2024-04-24T23:08:02.473231+0000","last_clean":"2024-04-24T23:08:02.473231+0000","last_became_active":"2024-04-24T23:00:16.465749+0000","last_became_peered":"2024-04-24T23:00:16.465749+0000","last_unstale":"2024-04-24T23:08:02.473231+0000","last_undegraded":"2024-04-24T23:08:02.473231+0000","last_fullsized":"2024-04-24T23:08:02.473231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'308","reported_seq":335,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.469903+0000","last_change":"2024-04-24T23:00:16.481682+0000","last_active":"2024-04-24T23:08:02.469903+0000","last_peered":"2024-04-24T23:08:02.469903+0000","last_clean":"2024-04-24T23:08:02.469903+0000","last_became_active":"2024-04-24T23:00:16.481381+0000","last_became_peered":"2024-04-24T23:00:16.481381+0000","last_unstale":"2024-04-24T23:08:02.469903+0000","last_undegraded":"2024-04-24T23:08:02.469903+0000","last_fullsized":"2024-04-24T23:08:02.469903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'305","reported_seq":332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.456434+0000","last_change":"2024-04-24T23:00:16.461984+0000","last_active":"2024-04-24T23:08:02.456434+0000","last_peered":"2024-04-24T23:08:02.456434+0000","last_clean":"2024-04-24T23:08:02.456434+0000","last_became_active":"2024-04-24T23:00:16.461267+0000","last_became_peered":"2024-04-24T23:00:16.461267+0000","last_unstale":"2024-04-24T23:08:02.456434+0000","last_undegraded":"2024-04-24T23:08:02.456434+0000","last_fullsized":"2024-04-24T23:08:02.456434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:53:00.776972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'326","reported_seq":353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.450420+0000","last_change":"2024-04-24T23:00:16.460191+0000","last_active":"2024-04-24T23:08:02.450420+0000","last_peered":"2024-04-24T23:08:02.450420+0000","last_clean":"2024-04-24T23:08:02.450420+0000","last_became_active":"2024-04-24T23:00:16.459445+0000","last_became_peered":"2024-04-24T23:00:16.459445+0000","last_unstale":"2024-04-24T23:08:02.450420+0000","last_undegraded":"2024-04-24T23:08:02.450420+0000","last_fullsized":"2024-04-24T23:08:02.450420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:12.313822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'310","reported_seq":338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:02.470695+0000","last_change":"2024-04-24T23:00:16.450409+0000","last_active":"2024-04-24T23:08:02.470695+0000","last_peered":"2024-04-24T23:08:02.470695+0000","last_clean":"2024-04-24T23:08:02.470695+0000","last_became_active":"2024-04-24T23:00:16.450061+0000","last_became_peered":"2024-04-24T23:00:16.450061+0000","last_unstale":"2024-04-24T23:08:02.470695+0000","last_undegraded":"2024-04-24T23:08:02.470695+0000","last_fullsized":"2024-04-24T23:08:02.470695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:15.376899+0000","last_clean_scrub_stamp":"2024-04-24T23:00:15.376899+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40344,"num_write_kb":220872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32314,"ondisk_log_size":32314,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15318,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20401,"ondisk_log_size":20401,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":156152903,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":1142,"num_read_kb":1796,"num_write":15519,"num_write_kb":443889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87670784,"data_stored":312305806,"data_compressed":57745618,"data_compressed_allocated":71630848,"data_compressed_original":296329216,"omap_allocated":0,"internal_metadata":0},"log_size":13419,"ondisk_log_size":13419,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509539,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116732,"kb_used_data":9204,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94255108,"statfs":{"total":96636764160,"available":96517230592,"internally_reserved":0,"allocated":9424896,"data_stored":30817518,"data_compressed":5693383,"data_compressed_allocated":7151616,"data_compressed_original":28721152,"omap_allocated":1590,"internal_metadata":110098890},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112928,"kb_used_data":9624,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94258912,"statfs":{"total":96636764160,"available":96521125888,"internally_reserved":0,"allocated":9854976,"data_stored":37485867,"data_compressed":6753749,"data_compressed_allocated":8212480,"data_compressed_original":36028416,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509540,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133964,"kb_used_data":12612,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94237876,"statfs":{"total":96636764160,"available":96499585024,"internally_reserved":0,"allocated":12914688,"data_stored":46253360,"data_compressed":8519580,"data_compressed_allocated":10514432,"data_compressed_original":44023808,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509540,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89148,"kb_used_data":3828,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94282692,"statfs":{"total":96636764160,"available":96545476608,"internally_reserved":0,"allocated":3919872,"data_stored":12699018,"data_compressed":2449723,"data_compressed_allocated":3092480,"data_compressed_original":12046336,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509540,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113264,"kb_used_data":9896,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94258576,"statfs":{"total":96636764160,"available":96520781824,"internally_reserved":0,"allocated":10133504,"data_stored":34260304,"data_compressed":6393594,"data_compressed_allocated":7995392,"data_compressed_original":32296960,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509539,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131964,"kb_used_data":16180,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94239876,"statfs":{"total":96636764160,"available":96501633024,"internally_reserved":0,"allocated":16568320,"data_stored":58456099,"data_compressed":10542411,"data_compressed_allocated":13033472,"data_compressed_original":55099392,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542244,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91380,"kb_used_data":10220,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94280460,"statfs":{"total":96636764160,"available":96543191040,"internally_reserved":0,"allocated":10465280,"data_stored":37864170,"data_compressed":6877701,"data_compressed_allocated":8454144,"data_compressed_original":36020224,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574948,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119692,"kb_used_data":16388,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94252148,"statfs":{"total":96636764160,"available":96514199552,"internally_reserved":0,"allocated":16781312,"data_stored":56573678,"data_compressed":10582231,"data_compressed_allocated":13266944,"data_compressed_original":53239808,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16285696,"data_stored":58340665,"data_compressed":10542411,"data_compressed_allocated":13033472,"data_compressed_original":55099392,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9785344,"data_stored":33554502,"data_compressed":6360217,"data_compressed_allocated":7950336,"data_compressed_original":31723520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3637248,"data_stored":12583584,"data_compressed":2449723,"data_compressed_allocated":3092480,"data_compressed_original":12046336,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":46137926,"data_compressed":8519580,"data_compressed_allocated":10514432,"data_compressed_original":44023808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9572352,"data_stored":37370433,"data_compressed":6753749,"data_compressed_allocated":8212480,"data_compressed_original":36028416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16433152,"data_stored":55867876,"data_compressed":10548854,"data_compressed_allocated":13221888,"data_compressed_original":52666368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10182656,"data_stored":37748736,"data_compressed":6877701,"data_compressed_allocated":8454144,"data_compressed_original":36020224,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9142272,"data_stored":30702084,"data_compressed":5693383,"data_compressed_allocated":7151616,"data_compressed_original":28721152,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:08:10.044 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.045 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.045 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.045 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.045 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.045 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.045 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.045 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.045 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.045 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.046 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.046 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.046 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.046 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.046 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.046 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.046 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.046 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.047 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.047 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.047 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.047 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.047 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.047 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.047 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.047 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.047 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.048 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.048 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.048 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.048 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.048 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.048 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.048 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.048 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.049 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.049 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.049 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.049 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.049 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.049 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.049 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.049 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.049 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.050 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.050 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.050 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.050 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.050 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.050 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.050 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.050 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.051 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.051 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.051 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.051 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.051 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.051 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.051 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.051 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.051 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.052 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.052 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.052 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.052 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.052 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.052 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.052 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.052 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.052 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.053 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.053 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.053 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.053 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.053 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.053 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.053 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.053 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.054 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.054 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.054 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.054 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.054 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.054 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.054 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.054 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.055 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.055 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.055 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.055 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.055 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.055 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-24T23:00:14.367757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.055 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.055 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.056 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.056 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.056 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.056 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.056 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.056 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.056 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.056 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.057 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.057 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.057 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.057 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.057 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.057 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.057 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.057 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.057 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.058 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.058 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.058 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.058 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.058 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.058 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.058 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.058 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.059 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.059 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.059 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.059 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.059 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-24T23:00:15.376899+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:10.059 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T23:08:30.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:08:30.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.182+0000 7f9798f5a640 1 Processor -- start 2024-04-24T23:08:30.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.182+0000 7f9798f5a640 1 -- start start 2024-04-24T23:08:30.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9798f5a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97940b5e00 0x7f97941488f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:30.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9798f5a640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97940b4e60 con 0x7f9794072ec0 2024-04-24T23:08:30.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9798f5a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97940732a0 con 0x7f97940b3bb0 2024-04-24T23:08:30.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9798f5a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f97940b5100 con 0x7f97940b5e00 2024-04-24T23:08:30.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f979259c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9794072ec0 0x7f97940b34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:35642/0 (socket says 172.21.15.43:35642) 2024-04-24T23:08:30.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f979259c640 1 -- 172.21.15.43:0/48808119 learned_addr learned my addr 172.21.15.43:0/48808119 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:30.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f978bfff640 1 --2- 172.21.15.43:0/48808119 >> v2:172.21.15.162:3300/0 conn(0x7f97940b5e00 0x7f97941488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:30.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9791d9b640 1 -- 172.21.15.43:0/48808119 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1669679172 0 0) 0x7f97940b4e60 con 0x7f9794072ec0 2024-04-24T23:08:30.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9791d9b640 1 -- 172.21.15.43:0/48808119 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9780003530 con 0x7f9794072ec0 2024-04-24T23:08:30.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9791d9b640 1 -- 172.21.15.43:0/48808119 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4270164071 0 0) 0x7f9780003530 con 0x7f9794072ec0 2024-04-24T23:08:30.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9791d9b640 1 -- 172.21.15.43:0/48808119 >> v2:172.21.15.162:3300/0 conn(0x7f97940b5e00 msgr2=0x7f97941488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:30.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9791d9b640 1 --2- 172.21.15.43:0/48808119 >> v2:172.21.15.162:3300/0 conn(0x7f97940b5e00 0x7f97941488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:30.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9791d9b640 1 -- 172.21.15.43:0/48808119 >> v1:172.21.15.162:6789/0 conn(0x7f97940b3bb0 legacy=0x7f979414fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:30.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9791d9b640 1 -- 172.21.15.43:0/48808119 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97940b19d0 con 0x7f9794072ec0 2024-04-24T23:08:30.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9791d9b640 1 -- 172.21.15.43:0/48808119 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f9784001680 con 0x7f9794072ec0 2024-04-24T23:08:30.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9791d9b640 1 -- 172.21.15.43:0/48808119 >> v1:172.21.15.43:6789/0 conn(0x7f9794072ec0 legacy=0x7f97940b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:30.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9791d9b640 1 --2- 172.21.15.43:0/48808119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97800039c0 0x7f9780003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:30.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9791d9b640 1 --2- 172.21.15.43:0/48808119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9780004810 0x7f9780004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:30.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9791d9b640 1 --2- 172.21.15.43:0/48808119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97800052a0 0x7f978000fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:30.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9791d9b640 1 -- 172.21.15.43:0/48808119 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f97800105a0 con 0x7f97800052a0 2024-04-24T23:08:30.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9791d9b640 1 -- 172.21.15.43:0/48808119 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9780010750 con 0x7f9780004810 2024-04-24T23:08:30.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9791d9b640 1 -- 172.21.15.43:0/48808119 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9780010950 con 0x7f97800039c0 2024-04-24T23:08:30.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9792d9d640 1 --2- 172.21.15.43:0/48808119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97800052a0 0x7f978000fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:30.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f979259c640 1 --2- 172.21.15.43:0/48808119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97800039c0 0x7f9780003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:30.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f978bfff640 1 --2- 172.21.15.43:0/48808119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9780004810 0x7f9780004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:30.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9792d9d640 1 -- 172.21.15.43:0/48808119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97800039c0 msgr2=0x7f9780003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:30.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9792d9d640 1 --2- 172.21.15.43:0/48808119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97800039c0 0x7f9780003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:30.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9792d9d640 1 -- 172.21.15.43:0/48808119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9780004810 msgr2=0x7f9780004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:30.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9792d9d640 1 --2- 172.21.15.43:0/48808119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9780004810 0x7f9780004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:30.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f9792d9d640 1 -- 172.21.15.43:0/48808119 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9780003530 con 0x7f97800052a0 2024-04-24T23:08:30.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.186+0000 7f978bfff640 1 --2- 172.21.15.43:0/48808119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9780004810 0x7f9780004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:30.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9792d9d640 1 -- 172.21.15.43:0/48808119 reap_dead start 2024-04-24T23:08:30.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9792d9d640 1 --2- 172.21.15.43:0/48808119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97800052a0 0x7f978000fde0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f978c001e70 tx=0x7f978c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5f2c9f855b97be server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:30.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9791d9b640 1 -- 172.21.15.43:0/48808119 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c001a90 con 0x7f97800052a0 2024-04-24T23:08:30.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9791d9b640 1 -- 172.21.15.43:0/48808119 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978c003980 con 0x7f97800052a0 2024-04-24T23:08:30.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9791d9b640 1 -- 172.21.15.43:0/48808119 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c003d70 con 0x7f97800052a0 2024-04-24T23:08:30.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9798f5a640 1 -- 172.21.15.43:0/48808119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97800052a0 msgr2=0x7f978000fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:30.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9798f5a640 1 --2- 172.21.15.43:0/48808119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97800052a0 0x7f978000fde0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f978c001e70 tx=0x7f978c01c780 comp rx=0 tx=0).stop 2024-04-24T23:08:30.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9798f5a640 1 -- 172.21.15.43:0/48808119 shutdown_connections 2024-04-24T23:08:30.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9798f5a640 1 --2- 172.21.15.43:0/48808119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97800052a0 0x7f978000fde0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:30.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9798f5a640 1 -- 172.21.15.43:0/48808119 >> 172.21.15.43:0/48808119 conn(0x7f979406c300 msgr2=0x7f979406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:30.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9798f5a640 1 -- 172.21.15.43:0/48808119 shutdown_connections 2024-04-24T23:08:30.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9798f5a640 1 -- 172.21.15.43:0/48808119 wait complete. 2024-04-24T23:08:30.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9798f5a640 1 Processor -- start 2024-04-24T23:08:30.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9798f5a640 1 -- start start 2024-04-24T23:08:30.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9798f5a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97800052a0 0x7f9794138bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:30.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9798f5a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9794139110 0x7f979413e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:30.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9798f5a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979413eb10 0x7f9794141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:30.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9798f5a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f97940b0e10 con 0x7f979413eb10 2024-04-24T23:08:30.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9798f5a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f97940b0c90 con 0x7f9794139110 2024-04-24T23:08:30.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9798f5a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f97941488f0 con 0x7f97800052a0 2024-04-24T23:08:30.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9792d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979413eb10 0x7f9794141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:30.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9792d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979413eb10 0x7f9794141310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56320/0 (socket says 172.21.15.43:56320) 2024-04-24T23:08:30.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.190+0000 7f9792d9d640 1 -- 172.21.15.43:0/1561485189 learned_addr learned my addr 172.21.15.43:0/1561485189 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:30.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f979259c640 1 --2- 172.21.15.43:0/1561485189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97800052a0 0x7f9794138bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:30.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f978bfff640 1 --2- 172.21.15.43:0/1561485189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9794139110 0x7f979413e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:30.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f9792d9d640 1 -- 172.21.15.43:0/1561485189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97800052a0 msgr2=0x7f9794138bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:30.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f9792d9d640 1 --2- 172.21.15.43:0/1561485189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97800052a0 0x7f9794138bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:30.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f9792d9d640 1 -- 172.21.15.43:0/1561485189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9794139110 msgr2=0x7f979413e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:30.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f9792d9d640 1 --2- 172.21.15.43:0/1561485189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9794139110 0x7f979413e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:30.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f9792d9d640 1 -- 172.21.15.43:0/1561485189 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9794139570 con 0x7f979413eb10 2024-04-24T23:08:30.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f978bfff640 1 --2- 172.21.15.43:0/1561485189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9794139110 0x7f979413e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:30.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f9792d9d640 1 --2- 172.21.15.43:0/1561485189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979413eb10 0x7f9794141310 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f978c01d020 tx=0x7f9780005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:30.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f978affd640 1 -- 172.21.15.43:0/1561485189 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c0b8070 con 0x7f979413eb10 2024-04-24T23:08:30.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f978affd640 1 -- 172.21.15.43:0/1561485189 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978c0b0070 con 0x7f979413eb10 2024-04-24T23:08:30.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f978affd640 1 -- 172.21.15.43:0/1561485189 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c007dc0 con 0x7f979413eb10 2024-04-24T23:08:30.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f9798f5a640 1 -- 172.21.15.43:0/1561485189 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9794142c60 con 0x7f979413eb10 2024-04-24T23:08:30.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f9798f5a640 1 -- 172.21.15.43:0/1561485189 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97941df4a0 con 0x7f979413eb10 2024-04-24T23:08:30.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f9798f5a640 1 -- 172.21.15.43:0/1561485189 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f979404f580 con 0x7f979413eb10 2024-04-24T23:08:30.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f978affd640 1 -- 172.21.15.43:0/1561485189 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f978c0b2070 con 0x7f979413eb10 2024-04-24T23:08:30.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f978affd640 1 --2- 172.21.15.43:0/1561485189 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f97740678f0 0x7f9774069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:30.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f978affd640 1 -- 172.21.15.43:0/1561485189 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f978c11ecc0 con 0x7f979413eb10 2024-04-24T23:08:30.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f979259c640 1 --2- 172.21.15.43:0/1561485189 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f97740678f0 0x7f9774069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:30.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.194+0000 7f979259c640 1 --2- 172.21.15.43:0/1561485189 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f97740678f0 0x7f9774069db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f97840010f0 tx=0x7f9784009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:30.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.198+0000 7f978affd640 1 -- 172.21.15.43:0/1561485189 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f978c0c1020 con 0x7f979413eb10 2024-04-24T23:08:30.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.354+0000 7f9798f5a640 1 -- 172.21.15.43:0/1561485189 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f979413ef90 con 0x7f97740678f0 2024-04-24T23:08:30.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.370+0000 7f978affd640 1 -- 172.21.15.43:0/1561485189 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335427 (secure 0 0 0) 0x7f979413ef90 con 0x7f97740678f0 2024-04-24T23:08:30.374 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:08:30.376 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-24T23:08:30.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.374+0000 7f9798f5a640 1 -- 172.21.15.43:0/1561485189 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f97740678f0 msgr2=0x7f9774069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:30.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.374+0000 7f9798f5a640 1 --2- 172.21.15.43:0/1561485189 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f97740678f0 0x7f9774069db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f97840010f0 tx=0x7f9784009040 comp rx=0 tx=0).stop 2024-04-24T23:08:30.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.374+0000 7f9798f5a640 1 -- 172.21.15.43:0/1561485189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979413eb10 msgr2=0x7f9794141310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:30.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.374+0000 7f9798f5a640 1 --2- 172.21.15.43:0/1561485189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979413eb10 0x7f9794141310 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f978c01d020 tx=0x7f9780005840 comp rx=0 tx=0).stop 2024-04-24T23:08:30.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.374+0000 7f9798f5a640 1 -- 172.21.15.43:0/1561485189 shutdown_connections 2024-04-24T23:08:30.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.374+0000 7f9798f5a640 1 --2- 172.21.15.43:0/1561485189 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f97740678f0 0x7f9774069db0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:30.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.374+0000 7f9798f5a640 1 --2- 172.21.15.43:0/1561485189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979413eb10 0x7f9794141310 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:30.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.374+0000 7f9798f5a640 1 --2- 172.21.15.43:0/1561485189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9794139110 0x7f979413e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:30.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.374+0000 7f9798f5a640 1 --2- 172.21.15.43:0/1561485189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97800052a0 0x7f9794138bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:30.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.374+0000 7f9798f5a640 1 -- 172.21.15.43:0/1561485189 >> 172.21.15.43:0/1561485189 conn(0x7f979406c300 msgr2=0x7f97941434a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:30.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.374+0000 7f9798f5a640 1 -- 172.21.15.43:0/1561485189 shutdown_connections 2024-04-24T23:08:30.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:30.374+0000 7f9798f5a640 1 -- 172.21.15.43:0/1561485189 wait complete. 2024-04-24T23:08:30.390 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2024-04-24T23:08:28.394248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":156743271,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":1258,"num_read_kb":1896,"num_write":71340,"num_write_kb":667177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5463,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66300,"ondisk_log_size":66300,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":909072,"kb_used_data":87952,"kb_used_omap":12,"kb_used_meta":821043,"kb_avail":754065648,"statfs":{"total":773094113280,"available":772163223552,"internally_reserved":0,"allocated":90062848,"data_stored":314410014,"data_compressed":57812372,"data_compressed_allocated":71720960,"data_compressed_original":297476096,"omap_allocated":12752,"internal_metadata":840748592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":463,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002760"},"pg_stats":[{"pgid":"2.1f","version":"27'520","reported_seq":558,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.469821+0000","last_change":"2024-04-24T23:08:13.469888+0000","last_active":"2024-04-24T23:08:13.469821+0000","last_peered":"2024-04-24T23:08:13.469821+0000","last_clean":"2024-04-24T23:08:13.469821+0000","last_became_active":"2024-04-24T23:00:15.417152+0000","last_became_peered":"2024-04-24T23:00:15.417152+0000","last_unstale":"2024-04-24T23:08:13.469821+0000","last_undegraded":"2024-04-24T23:08:13.469821+0000","last_fullsized":"2024-04-24T23:08:13.469821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'520","last_scrub_stamp":"2024-04-24T23:08:13.469646+0000","last_deep_scrub":"27'520","last_deep_scrub_stamp":"2024-04-24T23:08:13.469646+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.469646+0000","objects_scrubbed":2,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:21.600226+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":574,"num_write_kb":8831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'314","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:18.196634+0000","last_change":"2024-04-24T23:08:18.196754+0000","last_active":"2024-04-24T23:08:18.196634+0000","last_peered":"2024-04-24T23:08:18.196634+0000","last_clean":"2024-04-24T23:08:18.196634+0000","last_became_active":"2024-04-24T23:00:16.449631+0000","last_became_peered":"2024-04-24T23:00:16.449631+0000","last_unstale":"2024-04-24T23:08:18.196634+0000","last_undegraded":"2024-04-24T23:08:18.196634+0000","last_fullsized":"2024-04-24T23:08:18.196634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'314","last_scrub_stamp":"2024-04-24T23:08:18.196421+0000","last_deep_scrub":"27'314","last_deep_scrub_stamp":"2024-04-24T23:08:18.196421+0000","last_clean_scrub_stamp":"2024-04-24T23:08:18.196421+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:08.028734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'1014","reported_seq":1044,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:19.232319+0000","last_change":"2024-04-24T23:08:19.232384+0000","last_active":"2024-04-24T23:08:19.232319+0000","last_peered":"2024-04-24T23:08:19.232319+0000","last_clean":"2024-04-24T23:08:19.232319+0000","last_became_active":"2024-04-24T23:00:20.535916+0000","last_became_peered":"2024-04-24T23:00:20.535916+0000","last_unstale":"2024-04-24T23:08:19.232319+0000","last_undegraded":"2024-04-24T23:08:19.232319+0000","last_fullsized":"2024-04-24T23:08:19.232319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1014","last_scrub_stamp":"2024-04-24T23:08:19.232136+0000","last_deep_scrub":"27'1014","last_deep_scrub_stamp":"2024-04-24T23:08:19.232136+0000","last_clean_scrub_stamp":"2024-04-24T23:08:19.232136+0000","objects_scrubbed":0,"log_size":1014,"log_dups_size":0,"ondisk_log_size":1014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:14.846165+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":7177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'581","reported_seq":620,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:15.269917+0000","last_change":"2024-04-24T23:08:15.269917+0000","last_active":"2024-04-24T23:08:15.269917+0000","last_peered":"2024-04-24T23:08:15.269917+0000","last_clean":"2024-04-24T23:08:15.269917+0000","last_became_active":"2024-04-24T23:00:15.417502+0000","last_became_peered":"2024-04-24T23:00:15.417502+0000","last_unstale":"2024-04-24T23:08:15.269917+0000","last_undegraded":"2024-04-24T23:08:15.269917+0000","last_fullsized":"2024-04-24T23:08:15.269917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'581","last_scrub_stamp":"2024-04-24T23:08:15.269653+0000","last_deep_scrub":"27'581","last_deep_scrub_stamp":"2024-04-24T23:08:15.269653+0000","last_clean_scrub_stamp":"2024-04-24T23:08:15.269653+0000","objects_scrubbed":3,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:11:50.812036+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":611,"num_write_kb":25054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'288","reported_seq":324,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:21.192681+0000","last_change":"2024-04-24T23:08:21.192741+0000","last_active":"2024-04-24T23:08:21.192681+0000","last_peered":"2024-04-24T23:08:21.192681+0000","last_clean":"2024-04-24T23:08:21.192681+0000","last_became_active":"2024-04-24T23:00:16.452212+0000","last_became_peered":"2024-04-24T23:00:16.452212+0000","last_unstale":"2024-04-24T23:08:21.192681+0000","last_undegraded":"2024-04-24T23:08:21.192681+0000","last_fullsized":"2024-04-24T23:08:21.192681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'288","last_scrub_stamp":"2024-04-24T23:08:21.192502+0000","last_deep_scrub":"27'288","last_deep_scrub_stamp":"2024-04-24T23:08:21.192502+0000","last_clean_scrub_stamp":"2024-04-24T23:08:21.192502+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:49.420012+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'1050","reported_seq":1080,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:18.453209+0000","last_change":"2024-04-24T23:08:18.453271+0000","last_active":"2024-04-24T23:08:18.453209+0000","last_peered":"2024-04-24T23:08:18.453209+0000","last_clean":"2024-04-24T23:08:18.453209+0000","last_became_active":"2024-04-24T23:00:20.517975+0000","last_became_peered":"2024-04-24T23:00:20.517975+0000","last_unstale":"2024-04-24T23:08:18.453209+0000","last_undegraded":"2024-04-24T23:08:18.453209+0000","last_fullsized":"2024-04-24T23:08:18.453209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1050","last_scrub_stamp":"2024-04-24T23:08:18.453036+0000","last_deep_scrub":"27'1050","last_deep_scrub_stamp":"2024-04-24T23:08:18.453036+0000","last_clean_scrub_stamp":"2024-04-24T23:08:18.453036+0000","objects_scrubbed":0,"log_size":1050,"log_dups_size":0,"ondisk_log_size":1050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:06:32.420849+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":6799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1038","reported_seq":1076,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.072565+0000","last_change":"2024-04-24T23:08:12.072659+0000","last_active":"2024-04-24T23:08:12.072565+0000","last_peered":"2024-04-24T23:08:12.072565+0000","last_clean":"2024-04-24T23:08:12.072565+0000","last_became_active":"2024-04-24T23:00:15.400064+0000","last_became_peered":"2024-04-24T23:00:15.400064+0000","last_unstale":"2024-04-24T23:08:12.072565+0000","last_undegraded":"2024-04-24T23:08:12.072565+0000","last_fullsized":"2024-04-24T23:08:12.072565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1038","last_scrub_stamp":"2024-04-24T23:08:12.072367+0000","last_deep_scrub":"27'1038","last_deep_scrub_stamp":"2024-04-24T23:08:12.072367+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.072367+0000","objects_scrubbed":4,"log_size":1038,"log_dups_size":0,"ondisk_log_size":1038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:59.543364+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":1068,"num_write_kb":29480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'289","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.662488+0000","last_change":"2024-04-24T23:08:10.662526+0000","last_active":"2024-04-24T23:08:10.662488+0000","last_peered":"2024-04-24T23:08:10.662488+0000","last_clean":"2024-04-24T23:08:10.662488+0000","last_became_active":"2024-04-24T23:00:16.451601+0000","last_became_peered":"2024-04-24T23:00:16.451601+0000","last_unstale":"2024-04-24T23:08:10.662488+0000","last_undegraded":"2024-04-24T23:08:10.662488+0000","last_fullsized":"2024-04-24T23:08:10.662488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'289","last_scrub_stamp":"2024-04-24T23:08:10.662394+0000","last_deep_scrub":"27'289","last_deep_scrub_stamp":"2024-04-24T23:08:10.662394+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.662394+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:10.320209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'993","reported_seq":1023,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:19.450828+0000","last_change":"2024-04-24T23:08:19.450906+0000","last_active":"2024-04-24T23:08:19.450828+0000","last_peered":"2024-04-24T23:08:19.450828+0000","last_clean":"2024-04-24T23:08:19.450828+0000","last_became_active":"2024-04-24T23:00:20.518002+0000","last_became_peered":"2024-04-24T23:00:20.518002+0000","last_unstale":"2024-04-24T23:08:19.450828+0000","last_undegraded":"2024-04-24T23:08:19.450828+0000","last_fullsized":"2024-04-24T23:08:19.450828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'993","last_scrub_stamp":"2024-04-24T23:08:19.450642+0000","last_deep_scrub":"27'993","last_deep_scrub_stamp":"2024-04-24T23:08:19.450642+0000","last_clean_scrub_stamp":"2024-04-24T23:08:19.450642+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:03:13.581849+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":6590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'201","reported_seq":239,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.013839+0000","last_change":"2024-04-24T23:08:11.013907+0000","last_active":"2024-04-24T23:08:11.013839+0000","last_peered":"2024-04-24T23:08:11.013839+0000","last_clean":"2024-04-24T23:08:11.013839+0000","last_became_active":"2024-04-24T23:00:15.395766+0000","last_became_peered":"2024-04-24T23:00:15.395766+0000","last_unstale":"2024-04-24T23:08:11.013839+0000","last_undegraded":"2024-04-24T23:08:11.013839+0000","last_fullsized":"2024-04-24T23:08:11.013839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'201","last_scrub_stamp":"2024-04-24T23:08:11.013657+0000","last_deep_scrub":"27'201","last_deep_scrub_stamp":"2024-04-24T23:08:11.013657+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.013657+0000","objects_scrubbed":1,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.609628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":248,"num_write_kb":4421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'299","reported_seq":334,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.887566+0000","last_change":"2024-04-24T23:08:12.887633+0000","last_active":"2024-04-24T23:08:12.887566+0000","last_peered":"2024-04-24T23:08:12.887566+0000","last_clean":"2024-04-24T23:08:12.887566+0000","last_became_active":"2024-04-24T23:00:16.458237+0000","last_became_peered":"2024-04-24T23:00:16.458237+0000","last_unstale":"2024-04-24T23:08:12.887566+0000","last_undegraded":"2024-04-24T23:08:12.887566+0000","last_fullsized":"2024-04-24T23:08:12.887566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'299","last_scrub_stamp":"2024-04-24T23:08:12.887383+0000","last_deep_scrub":"27'299","last_deep_scrub_stamp":"2024-04-24T23:08:12.887383+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.887383+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:51.888099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'1016","reported_seq":1053,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:21.488062+0000","last_change":"2024-04-24T23:08:21.488202+0000","last_active":"2024-04-24T23:08:21.488062+0000","last_peered":"2024-04-24T23:08:21.488062+0000","last_clean":"2024-04-24T23:08:21.488062+0000","last_became_active":"2024-04-24T23:00:57.664750+0000","last_became_peered":"2024-04-24T23:00:57.664750+0000","last_unstale":"2024-04-24T23:08:21.488062+0000","last_undegraded":"2024-04-24T23:08:21.488062+0000","last_fullsized":"2024-04-24T23:08:21.488062+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1016","last_scrub_stamp":"2024-04-24T23:08:21.487856+0000","last_deep_scrub":"27'1016","last_deep_scrub_stamp":"2024-04-24T23:08:21.487856+0000","last_clean_scrub_stamp":"2024-04-24T23:08:21.487856+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:32:31.713924+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":6657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,4],"acting":[2,6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'326","reported_seq":361,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.918384+0000","last_change":"2024-04-24T23:08:13.918495+0000","last_active":"2024-04-24T23:08:13.918384+0000","last_peered":"2024-04-24T23:08:13.918384+0000","last_clean":"2024-04-24T23:08:13.918384+0000","last_became_active":"2024-04-24T23:00:16.447488+0000","last_became_peered":"2024-04-24T23:00:16.447488+0000","last_unstale":"2024-04-24T23:08:13.918384+0000","last_undegraded":"2024-04-24T23:08:13.918384+0000","last_fullsized":"2024-04-24T23:08:13.918384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'326","last_scrub_stamp":"2024-04-24T23:08:13.918186+0000","last_deep_scrub":"27'326","last_deep_scrub_stamp":"2024-04-24T23:08:13.918186+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.918186+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:14.808386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'771","reported_seq":808,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:18.953903+0000","last_change":"2024-04-24T23:08:18.953969+0000","last_active":"2024-04-24T23:08:18.953903+0000","last_peered":"2024-04-24T23:08:18.953903+0000","last_clean":"2024-04-24T23:08:18.953903+0000","last_became_active":"2024-04-24T23:00:15.408120+0000","last_became_peered":"2024-04-24T23:00:15.408120+0000","last_unstale":"2024-04-24T23:08:18.953903+0000","last_undegraded":"2024-04-24T23:08:18.953903+0000","last_fullsized":"2024-04-24T23:08:18.953903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'771","last_scrub_stamp":"2024-04-24T23:08:18.953731+0000","last_deep_scrub":"27'771","last_deep_scrub_stamp":"2024-04-24T23:08:18.953731+0000","last_clean_scrub_stamp":"2024-04-24T23:08:18.953731+0000","objects_scrubbed":2,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:22:06.217126+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":817,"num_write_kb":21262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":463,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'991","reported_seq":1013,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.896244+0000","last_change":"2024-04-24T23:00:20.503964+0000","last_active":"2024-04-24T23:07:55.896244+0000","last_peered":"2024-04-24T23:07:55.896244+0000","last_clean":"2024-04-24T23:07:55.896244+0000","last_became_active":"2024-04-24T23:00:20.501703+0000","last_became_peered":"2024-04-24T23:00:20.501703+0000","last_unstale":"2024-04-24T23:07:55.896244+0000","last_undegraded":"2024-04-24T23:07:55.896244+0000","last_fullsized":"2024-04-24T23:07:55.896244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":7022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'337","reported_seq":373,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:15.142589+0000","last_change":"2024-04-24T23:08:15.142727+0000","last_active":"2024-04-24T23:08:15.142589+0000","last_peered":"2024-04-24T23:08:15.142589+0000","last_clean":"2024-04-24T23:08:15.142589+0000","last_became_active":"2024-04-24T23:00:16.472226+0000","last_became_peered":"2024-04-24T23:00:16.472226+0000","last_unstale":"2024-04-24T23:08:15.142589+0000","last_undegraded":"2024-04-24T23:08:15.142589+0000","last_fullsized":"2024-04-24T23:08:15.142589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'337","last_scrub_stamp":"2024-04-24T23:08:15.142365+0000","last_deep_scrub":"27'337","last_deep_scrub_stamp":"2024-04-24T23:08:15.142365+0000","last_clean_scrub_stamp":"2024-04-24T23:08:15.142365+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:08.556817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":260,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'311","reported_seq":349,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:09.955987+0000","last_change":"2024-04-24T23:08:09.956056+0000","last_active":"2024-04-24T23:08:09.955987+0000","last_peered":"2024-04-24T23:08:09.955987+0000","last_clean":"2024-04-24T23:08:09.955987+0000","last_became_active":"2024-04-24T23:00:15.422121+0000","last_became_peered":"2024-04-24T23:00:15.422121+0000","last_unstale":"2024-04-24T23:08:09.955987+0000","last_undegraded":"2024-04-24T23:08:09.955987+0000","last_fullsized":"2024-04-24T23:08:09.955987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'311","last_scrub_stamp":"2024-04-24T23:08:09.955819+0000","last_deep_scrub":"27'311","last_deep_scrub_stamp":"2024-04-24T23:08:09.955819+0000","last_clean_scrub_stamp":"2024-04-24T23:08:09.955819+0000","objects_scrubbed":2,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:36:53.873805+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":340,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'1105","reported_seq":1135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:23.974928+0000","last_change":"2024-04-24T23:08:23.975075+0000","last_active":"2024-04-24T23:08:23.974928+0000","last_peered":"2024-04-24T23:08:23.974928+0000","last_clean":"2024-04-24T23:08:23.974928+0000","last_became_active":"2024-04-24T23:00:20.540220+0000","last_became_peered":"2024-04-24T23:00:20.540220+0000","last_unstale":"2024-04-24T23:08:23.974928+0000","last_undegraded":"2024-04-24T23:08:23.974928+0000","last_fullsized":"2024-04-24T23:08:23.974928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1105","last_scrub_stamp":"2024-04-24T23:08:23.974637+0000","last_deep_scrub":"27'1105","last_deep_scrub_stamp":"2024-04-24T23:08:23.974637+0000","last_clean_scrub_stamp":"2024-04-24T23:08:23.974637+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:37.278445+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1391,"num_write_kb":7499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'337","reported_seq":373,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:19.452134+0000","last_change":"2024-04-24T23:08:19.452197+0000","last_active":"2024-04-24T23:08:19.452134+0000","last_peered":"2024-04-24T23:08:19.452134+0000","last_clean":"2024-04-24T23:08:19.452134+0000","last_became_active":"2024-04-24T23:00:16.487476+0000","last_became_peered":"2024-04-24T23:00:16.487476+0000","last_unstale":"2024-04-24T23:08:19.452134+0000","last_undegraded":"2024-04-24T23:08:19.452134+0000","last_fullsized":"2024-04-24T23:08:19.452134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'337","last_scrub_stamp":"2024-04-24T23:08:19.451961+0000","last_deep_scrub":"27'337","last_deep_scrub_stamp":"2024-04-24T23:08:19.451961+0000","last_clean_scrub_stamp":"2024-04-24T23:08:19.451961+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:45:54.430316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'216","reported_seq":254,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:09.519072+0000","last_change":"2024-04-24T23:08:09.519142+0000","last_active":"2024-04-24T23:08:09.519072+0000","last_peered":"2024-04-24T23:08:09.519072+0000","last_clean":"2024-04-24T23:08:09.519072+0000","last_became_active":"2024-04-24T23:00:15.396600+0000","last_became_peered":"2024-04-24T23:00:15.396600+0000","last_unstale":"2024-04-24T23:08:09.519072+0000","last_undegraded":"2024-04-24T23:08:09.519072+0000","last_fullsized":"2024-04-24T23:08:09.519072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'216","last_scrub_stamp":"2024-04-24T23:08:09.518903+0000","last_deep_scrub":"27'216","last_deep_scrub_stamp":"2024-04-24T23:08:09.518903+0000","last_clean_scrub_stamp":"2024-04-24T23:08:09.518903+0000","objects_scrubbed":2,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:35.404257+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":224,"num_write_kb":12479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'989","reported_seq":1019,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:18.211471+0000","last_change":"2024-04-24T23:08:18.211535+0000","last_active":"2024-04-24T23:08:18.211471+0000","last_peered":"2024-04-24T23:08:18.211471+0000","last_clean":"2024-04-24T23:08:18.211471+0000","last_became_active":"2024-04-24T23:00:20.510602+0000","last_became_peered":"2024-04-24T23:00:20.510602+0000","last_unstale":"2024-04-24T23:08:18.211471+0000","last_undegraded":"2024-04-24T23:08:18.211471+0000","last_fullsized":"2024-04-24T23:08:18.211471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'989","last_scrub_stamp":"2024-04-24T23:08:18.211277+0000","last_deep_scrub":"27'989","last_deep_scrub_stamp":"2024-04-24T23:08:18.211277+0000","last_clean_scrub_stamp":"2024-04-24T23:08:18.211277+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:35:24.462113+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1239,"num_write_kb":6767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'349","reported_seq":384,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:27.887965+0000","last_change":"2024-04-24T23:08:27.888092+0000","last_active":"2024-04-24T23:08:27.887965+0000","last_peered":"2024-04-24T23:08:27.887965+0000","last_clean":"2024-04-24T23:08:27.887965+0000","last_became_active":"2024-04-24T23:00:16.483092+0000","last_became_peered":"2024-04-24T23:00:16.483092+0000","last_unstale":"2024-04-24T23:08:27.887965+0000","last_undegraded":"2024-04-24T23:08:27.887965+0000","last_fullsized":"2024-04-24T23:08:27.887965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'349","last_scrub_stamp":"2024-04-24T23:08:27.887774+0000","last_deep_scrub":"27'349","last_deep_scrub_stamp":"2024-04-24T23:08:27.887774+0000","last_clean_scrub_stamp":"2024-04-24T23:08:27.887774+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:43:45.431719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'273","reported_seq":311,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:08.975443+0000","last_change":"2024-04-24T23:08:08.975472+0000","last_active":"2024-04-24T23:08:08.975443+0000","last_peered":"2024-04-24T23:08:08.975443+0000","last_clean":"2024-04-24T23:08:08.975443+0000","last_became_active":"2024-04-24T23:00:15.397638+0000","last_became_peered":"2024-04-24T23:00:15.397638+0000","last_unstale":"2024-04-24T23:08:08.975443+0000","last_undegraded":"2024-04-24T23:08:08.975443+0000","last_fullsized":"2024-04-24T23:08:08.975443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'273","last_scrub_stamp":"2024-04-24T23:08:08.975354+0000","last_deep_scrub":"27'273","last_deep_scrub_stamp":"2024-04-24T23:08:08.975354+0000","last_clean_scrub_stamp":"2024-04-24T23:08:08.975354+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:34:08.997841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":320,"num_write_kb":4474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'934","reported_seq":964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:17.465654+0000","last_change":"2024-04-24T23:08:17.465725+0000","last_active":"2024-04-24T23:08:17.465654+0000","last_peered":"2024-04-24T23:08:17.465654+0000","last_clean":"2024-04-24T23:08:17.465654+0000","last_became_active":"2024-04-24T23:00:20.505532+0000","last_became_peered":"2024-04-24T23:00:20.505532+0000","last_unstale":"2024-04-24T23:08:17.465654+0000","last_undegraded":"2024-04-24T23:08:17.465654+0000","last_fullsized":"2024-04-24T23:08:17.465654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'934","last_scrub_stamp":"2024-04-24T23:08:17.465462+0000","last_deep_scrub":"27'934","last_deep_scrub_stamp":"2024-04-24T23:08:17.465462+0000","last_clean_scrub_stamp":"2024-04-24T23:08:17.465462+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:49.298730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":6588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'333","reported_seq":369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:18.448046+0000","last_change":"2024-04-24T23:08:18.448106+0000","last_active":"2024-04-24T23:08:18.448046+0000","last_peered":"2024-04-24T23:08:18.448046+0000","last_clean":"2024-04-24T23:08:18.448046+0000","last_became_active":"2024-04-24T23:00:16.483585+0000","last_became_peered":"2024-04-24T23:00:16.483585+0000","last_unstale":"2024-04-24T23:08:18.448046+0000","last_undegraded":"2024-04-24T23:08:18.448046+0000","last_fullsized":"2024-04-24T23:08:18.448046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'333","last_scrub_stamp":"2024-04-24T23:08:18.447878+0000","last_deep_scrub":"27'333","last_deep_scrub_stamp":"2024-04-24T23:08:18.447878+0000","last_clean_scrub_stamp":"2024-04-24T23:08:18.447878+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:55.140037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'157","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:22.921959+0000","last_change":"2024-04-24T23:08:22.922019+0000","last_active":"2024-04-24T23:08:22.921959+0000","last_peered":"2024-04-24T23:08:22.921959+0000","last_clean":"2024-04-24T23:08:22.921959+0000","last_became_active":"2024-04-24T23:00:15.420839+0000","last_became_peered":"2024-04-24T23:00:15.420839+0000","last_unstale":"2024-04-24T23:08:22.921959+0000","last_undegraded":"2024-04-24T23:08:22.921959+0000","last_fullsized":"2024-04-24T23:08:22.921959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'157","last_scrub_stamp":"2024-04-24T23:08:22.921792+0000","last_deep_scrub":"27'157","last_deep_scrub_stamp":"2024-04-24T23:08:22.921792+0000","last_clean_scrub_stamp":"2024-04-24T23:08:22.921792+0000","objects_scrubbed":1,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:17.755231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":209,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'1029","reported_seq":1059,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:20.443121+0000","last_change":"2024-04-24T23:08:20.443252+0000","last_active":"2024-04-24T23:08:20.443121+0000","last_peered":"2024-04-24T23:08:20.443121+0000","last_clean":"2024-04-24T23:08:20.443121+0000","last_became_active":"2024-04-24T23:00:20.518470+0000","last_became_peered":"2024-04-24T23:00:20.518470+0000","last_unstale":"2024-04-24T23:08:20.443121+0000","last_undegraded":"2024-04-24T23:08:20.443121+0000","last_fullsized":"2024-04-24T23:08:20.443121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1029","last_scrub_stamp":"2024-04-24T23:08:20.442862+0000","last_deep_scrub":"27'1029","last_deep_scrub_stamp":"2024-04-24T23:08:20.442862+0000","last_clean_scrub_stamp":"2024-04-24T23:08:20.442862+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:45:55.421217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":7455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'291","reported_seq":327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.511751+0000","last_change":"2024-04-24T23:08:14.511810+0000","last_active":"2024-04-24T23:08:14.511751+0000","last_peered":"2024-04-24T23:08:14.511751+0000","last_clean":"2024-04-24T23:08:14.511751+0000","last_became_active":"2024-04-24T23:00:16.463565+0000","last_became_peered":"2024-04-24T23:00:16.463565+0000","last_unstale":"2024-04-24T23:08:14.511751+0000","last_undegraded":"2024-04-24T23:08:14.511751+0000","last_fullsized":"2024-04-24T23:08:14.511751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'291","last_scrub_stamp":"2024-04-24T23:08:14.511571+0000","last_deep_scrub":"27'291","last_deep_scrub_stamp":"2024-04-24T23:08:14.511571+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.511571+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:45:40.361967+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'449","reported_seq":487,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.550265+0000","last_change":"2024-04-24T23:08:10.550392+0000","last_active":"2024-04-24T23:08:10.550265+0000","last_peered":"2024-04-24T23:08:10.550265+0000","last_clean":"2024-04-24T23:08:10.550265+0000","last_became_active":"2024-04-24T23:00:15.397465+0000","last_became_peered":"2024-04-24T23:00:15.397465+0000","last_unstale":"2024-04-24T23:08:10.550265+0000","last_undegraded":"2024-04-24T23:08:10.550265+0000","last_fullsized":"2024-04-24T23:08:10.550265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'449","last_scrub_stamp":"2024-04-24T23:08:10.549979+0000","last_deep_scrub":"27'449","last_deep_scrub_stamp":"2024-04-24T23:08:10.549979+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.549979+0000","objects_scrubbed":3,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:06.352225+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8008961,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1199,"num_write_kb":9322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'1049","reported_seq":1080,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:21.502777+0000","last_change":"2024-04-24T23:08:21.502777+0000","last_active":"2024-04-24T23:08:21.502777+0000","last_peered":"2024-04-24T23:08:21.502777+0000","last_clean":"2024-04-24T23:08:21.502777+0000","last_became_active":"2024-04-24T23:00:20.515972+0000","last_became_peered":"2024-04-24T23:00:20.515972+0000","last_unstale":"2024-04-24T23:08:21.502777+0000","last_undegraded":"2024-04-24T23:08:21.502777+0000","last_fullsized":"2024-04-24T23:08:21.502777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1049","last_scrub_stamp":"2024-04-24T23:08:21.502531+0000","last_deep_scrub":"27'1049","last_deep_scrub_stamp":"2024-04-24T23:08:21.502531+0000","last_clean_scrub_stamp":"2024-04-24T23:08:21.502531+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:11:25.143051+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1319,"num_write_kb":7165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'300","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:18.884698+0000","last_change":"2024-04-24T23:08:18.884767+0000","last_active":"2024-04-24T23:08:18.884698+0000","last_peered":"2024-04-24T23:08:18.884698+0000","last_clean":"2024-04-24T23:08:18.884698+0000","last_became_active":"2024-04-24T23:00:16.480021+0000","last_became_peered":"2024-04-24T23:00:16.480021+0000","last_unstale":"2024-04-24T23:08:18.884698+0000","last_undegraded":"2024-04-24T23:08:18.884698+0000","last_fullsized":"2024-04-24T23:08:18.884698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'300","last_scrub_stamp":"2024-04-24T23:08:18.884512+0000","last_deep_scrub":"27'300","last_deep_scrub_stamp":"2024-04-24T23:08:18.884512+0000","last_clean_scrub_stamp":"2024-04-24T23:08:18.884512+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:42.279627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'298","reported_seq":335,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:15.952268+0000","last_change":"2024-04-24T23:08:15.952306+0000","last_active":"2024-04-24T23:08:15.952268+0000","last_peered":"2024-04-24T23:08:15.952268+0000","last_clean":"2024-04-24T23:08:15.952268+0000","last_became_active":"2024-04-24T23:00:15.428016+0000","last_became_peered":"2024-04-24T23:00:15.428016+0000","last_unstale":"2024-04-24T23:08:15.952268+0000","last_undegraded":"2024-04-24T23:08:15.952268+0000","last_fullsized":"2024-04-24T23:08:15.952268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'298","last_scrub_stamp":"2024-04-24T23:08:15.952178+0000","last_deep_scrub":"27'298","last_deep_scrub_stamp":"2024-04-24T23:08:15.952178+0000","last_clean_scrub_stamp":"2024-04-24T23:08:15.952178+0000","objects_scrubbed":1,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:01:04.618191+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":311,"num_write_kb":16738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'1004","reported_seq":1034,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:20.819221+0000","last_change":"2024-04-24T23:08:20.819357+0000","last_active":"2024-04-24T23:08:20.819221+0000","last_peered":"2024-04-24T23:08:20.819221+0000","last_clean":"2024-04-24T23:08:20.819221+0000","last_became_active":"2024-04-24T23:00:20.524747+0000","last_became_peered":"2024-04-24T23:00:20.524747+0000","last_unstale":"2024-04-24T23:08:20.819221+0000","last_undegraded":"2024-04-24T23:08:20.819221+0000","last_fullsized":"2024-04-24T23:08:20.819221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1004","last_scrub_stamp":"2024-04-24T23:08:20.818961+0000","last_deep_scrub":"27'1004","last_deep_scrub_stamp":"2024-04-24T23:08:20.818961+0000","last_clean_scrub_stamp":"2024-04-24T23:08:20.818961+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:06:34.786774+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1252,"num_write_kb":7166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'319","reported_seq":354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.347119+0000","last_change":"2024-04-24T23:08:11.347179+0000","last_active":"2024-04-24T23:08:11.347119+0000","last_peered":"2024-04-24T23:08:11.347119+0000","last_clean":"2024-04-24T23:08:11.347119+0000","last_became_active":"2024-04-24T23:00:16.456268+0000","last_became_peered":"2024-04-24T23:00:16.456268+0000","last_unstale":"2024-04-24T23:08:11.347119+0000","last_undegraded":"2024-04-24T23:08:11.347119+0000","last_fullsized":"2024-04-24T23:08:11.347119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'319","last_scrub_stamp":"2024-04-24T23:08:11.346931+0000","last_deep_scrub":"27'319","last_deep_scrub_stamp":"2024-04-24T23:08:11.346931+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.346931+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:07.149177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'112","reported_seq":150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:17.191421+0000","last_change":"2024-04-24T23:08:17.191541+0000","last_active":"2024-04-24T23:08:17.191421+0000","last_peered":"2024-04-24T23:08:17.191421+0000","last_clean":"2024-04-24T23:08:17.191421+0000","last_became_active":"2024-04-24T23:00:15.428374+0000","last_became_peered":"2024-04-24T23:00:15.428374+0000","last_unstale":"2024-04-24T23:08:17.191421+0000","last_undegraded":"2024-04-24T23:08:17.191421+0000","last_fullsized":"2024-04-24T23:08:17.191421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'112","last_scrub_stamp":"2024-04-24T23:08:17.191207+0000","last_deep_scrub":"27'112","last_deep_scrub_stamp":"2024-04-24T23:08:17.191207+0000","last_clean_scrub_stamp":"2024-04-24T23:08:17.191207+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:36.242139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":161,"num_write_kb":4386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'1030","reported_seq":1060,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:21.804630+0000","last_change":"2024-04-24T23:08:21.804758+0000","last_active":"2024-04-24T23:08:21.804630+0000","last_peered":"2024-04-24T23:08:21.804630+0000","last_clean":"2024-04-24T23:08:21.804630+0000","last_became_active":"2024-04-24T23:00:20.534430+0000","last_became_peered":"2024-04-24T23:00:20.534430+0000","last_unstale":"2024-04-24T23:08:21.804630+0000","last_undegraded":"2024-04-24T23:08:21.804630+0000","last_fullsized":"2024-04-24T23:08:21.804630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1030","last_scrub_stamp":"2024-04-24T23:08:21.804330+0000","last_deep_scrub":"27'1030","last_deep_scrub_stamp":"2024-04-24T23:08:21.804330+0000","last_clean_scrub_stamp":"2024-04-24T23:08:21.804330+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:03:15.935537+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1288,"num_write_kb":6636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'316","reported_seq":352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.999343+0000","last_change":"2024-04-24T23:08:14.999490+0000","last_active":"2024-04-24T23:08:14.999343+0000","last_peered":"2024-04-24T23:08:14.999343+0000","last_clean":"2024-04-24T23:08:14.999343+0000","last_became_active":"2024-04-24T23:00:16.443620+0000","last_became_peered":"2024-04-24T23:00:16.443620+0000","last_unstale":"2024-04-24T23:08:14.999343+0000","last_undegraded":"2024-04-24T23:08:14.999343+0000","last_fullsized":"2024-04-24T23:08:14.999343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'316","last_scrub_stamp":"2024-04-24T23:08:14.999121+0000","last_deep_scrub":"27'316","last_deep_scrub_stamp":"2024-04-24T23:08:14.999121+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.999121+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:06:28.966934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'514","reported_seq":551,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:23.974947+0000","last_change":"2024-04-24T23:08:23.975003+0000","last_active":"2024-04-24T23:08:23.974947+0000","last_peered":"2024-04-24T23:08:23.974947+0000","last_clean":"2024-04-24T23:08:23.974947+0000","last_became_active":"2024-04-24T23:00:15.422167+0000","last_became_peered":"2024-04-24T23:00:15.422167+0000","last_unstale":"2024-04-24T23:08:23.974947+0000","last_undegraded":"2024-04-24T23:08:23.974947+0000","last_fullsized":"2024-04-24T23:08:23.974947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'514","last_scrub_stamp":"2024-04-24T23:08:23.974850+0000","last_deep_scrub":"27'514","last_deep_scrub_stamp":"2024-04-24T23:08:23.974850+0000","last_clean_scrub_stamp":"2024-04-24T23:08:23.974850+0000","objects_scrubbed":4,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:17:43.024322+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":552,"num_write_kb":25017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'943","reported_seq":973,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:23.746173+0000","last_change":"2024-04-24T23:08:23.746267+0000","last_active":"2024-04-24T23:08:23.746173+0000","last_peered":"2024-04-24T23:08:23.746173+0000","last_clean":"2024-04-24T23:08:23.746173+0000","last_became_active":"2024-04-24T23:00:20.524719+0000","last_became_peered":"2024-04-24T23:00:20.524719+0000","last_unstale":"2024-04-24T23:08:23.746173+0000","last_undegraded":"2024-04-24T23:08:23.746173+0000","last_fullsized":"2024-04-24T23:08:23.746173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'943","last_scrub_stamp":"2024-04-24T23:08:23.745978+0000","last_deep_scrub":"27'943","last_deep_scrub_stamp":"2024-04-24T23:08:23.745978+0000","last_clean_scrub_stamp":"2024-04-24T23:08:23.745978+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:17.872284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'320","reported_seq":357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:23.184237+0000","last_change":"2024-04-24T23:08:23.184352+0000","last_active":"2024-04-24T23:08:23.184237+0000","last_peered":"2024-04-24T23:08:23.184237+0000","last_clean":"2024-04-24T23:08:23.184237+0000","last_became_active":"2024-04-24T23:00:16.469390+0000","last_became_peered":"2024-04-24T23:00:16.469390+0000","last_unstale":"2024-04-24T23:08:23.184237+0000","last_undegraded":"2024-04-24T23:08:23.184237+0000","last_fullsized":"2024-04-24T23:08:23.184237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'320","last_scrub_stamp":"2024-04-24T23:08:23.183969+0000","last_deep_scrub":"27'320","last_deep_scrub_stamp":"2024-04-24T23:08:23.183969+0000","last_clean_scrub_stamp":"2024-04-24T23:08:23.183969+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:26:43.290354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'889","reported_seq":1596,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.153456+0000","last_change":"2024-04-24T23:08:10.153596+0000","last_active":"2024-04-24T23:08:10.153456+0000","last_peered":"2024-04-24T23:08:10.153456+0000","last_clean":"2024-04-24T23:08:10.153456+0000","last_became_active":"2024-04-24T23:00:15.422275+0000","last_became_peered":"2024-04-24T23:00:15.422275+0000","last_unstale":"2024-04-24T23:08:10.153456+0000","last_undegraded":"2024-04-24T23:08:10.153456+0000","last_fullsized":"2024-04-24T23:08:10.153456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'889","last_scrub_stamp":"2024-04-24T23:08:10.153217+0000","last_deep_scrub":"27'889","last_deep_scrub_stamp":"2024-04-24T23:08:10.153217+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.153217+0000","objects_scrubbed":3,"log_size":889,"log_dups_size":0,"ondisk_log_size":889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:16.478294+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9730440,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":691,"num_read_kb":1796,"num_write":947,"num_write_kb":14533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'1020","reported_seq":1050,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:19.867687+0000","last_change":"2024-04-24T23:08:19.867749+0000","last_active":"2024-04-24T23:08:19.867687+0000","last_peered":"2024-04-24T23:08:19.867687+0000","last_clean":"2024-04-24T23:08:19.867687+0000","last_became_active":"2024-04-24T23:00:20.534325+0000","last_became_peered":"2024-04-24T23:00:20.534325+0000","last_unstale":"2024-04-24T23:08:19.867687+0000","last_undegraded":"2024-04-24T23:08:19.867687+0000","last_fullsized":"2024-04-24T23:08:19.867687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1020","last_scrub_stamp":"2024-04-24T23:08:19.867480+0000","last_deep_scrub":"27'1020","last_deep_scrub_stamp":"2024-04-24T23:08:19.867480+0000","last_clean_scrub_stamp":"2024-04-24T23:08:19.867480+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:51.700749+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1281,"num_write_kb":6595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'303","reported_seq":339,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.999325+0000","last_change":"2024-04-24T23:08:12.999385+0000","last_active":"2024-04-24T23:08:12.999325+0000","last_peered":"2024-04-24T23:08:12.999325+0000","last_clean":"2024-04-24T23:08:12.999325+0000","last_became_active":"2024-04-24T23:00:16.451226+0000","last_became_peered":"2024-04-24T23:00:16.451226+0000","last_unstale":"2024-04-24T23:08:12.999325+0000","last_undegraded":"2024-04-24T23:08:12.999325+0000","last_fullsized":"2024-04-24T23:08:12.999325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'303","last_scrub_stamp":"2024-04-24T23:08:12.999150+0000","last_deep_scrub":"27'303","last_deep_scrub_stamp":"2024-04-24T23:08:12.999150+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.999150+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:38.884504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'648","reported_seq":686,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:20.977974+0000","last_change":"2024-04-24T23:08:20.978110+0000","last_active":"2024-04-24T23:08:20.977974+0000","last_peered":"2024-04-24T23:08:20.977974+0000","last_clean":"2024-04-24T23:08:20.977974+0000","last_became_active":"2024-04-24T23:00:15.414224+0000","last_became_peered":"2024-04-24T23:00:15.414224+0000","last_unstale":"2024-04-24T23:08:20.977974+0000","last_undegraded":"2024-04-24T23:08:20.977974+0000","last_fullsized":"2024-04-24T23:08:20.977974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'648","last_scrub_stamp":"2024-04-24T23:08:20.977755+0000","last_deep_scrub":"27'648","last_deep_scrub_stamp":"2024-04-24T23:08:20.977755+0000","last_clean_scrub_stamp":"2024-04-24T23:08:20.977755+0000","objects_scrubbed":1,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:50.744420+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":698,"num_write_kb":16967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'1115","reported_seq":1137,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.897230+0000","last_change":"2024-04-24T23:00:20.531159+0000","last_active":"2024-04-24T23:07:55.897230+0000","last_peered":"2024-04-24T23:07:55.897230+0000","last_clean":"2024-04-24T23:07:55.897230+0000","last_became_active":"2024-04-24T23:00:20.530682+0000","last_became_peered":"2024-04-24T23:00:20.530682+0000","last_unstale":"2024-04-24T23:07:55.897230+0000","last_undegraded":"2024-04-24T23:07:55.897230+0000","last_fullsized":"2024-04-24T23:07:55.897230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1380,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'294","reported_seq":330,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:08.502068+0000","last_change":"2024-04-24T23:08:08.502132+0000","last_active":"2024-04-24T23:08:08.502068+0000","last_peered":"2024-04-24T23:08:08.502068+0000","last_clean":"2024-04-24T23:08:08.502068+0000","last_became_active":"2024-04-24T23:00:16.477192+0000","last_became_peered":"2024-04-24T23:00:16.477192+0000","last_unstale":"2024-04-24T23:08:08.502068+0000","last_undegraded":"2024-04-24T23:08:08.502068+0000","last_fullsized":"2024-04-24T23:08:08.502068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'294","last_scrub_stamp":"2024-04-24T23:08:08.501865+0000","last_deep_scrub":"27'294","last_deep_scrub_stamp":"2024-04-24T23:08:08.501865+0000","last_clean_scrub_stamp":"2024-04-24T23:08:08.501865+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:18:35.679126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'171","reported_seq":208,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:17.967404+0000","last_change":"2024-04-24T23:08:17.967473+0000","last_active":"2024-04-24T23:08:17.967404+0000","last_peered":"2024-04-24T23:08:17.967404+0000","last_clean":"2024-04-24T23:08:17.967404+0000","last_became_active":"2024-04-24T23:00:15.407609+0000","last_became_peered":"2024-04-24T23:00:15.407609+0000","last_unstale":"2024-04-24T23:08:17.967404+0000","last_undegraded":"2024-04-24T23:08:17.967404+0000","last_fullsized":"2024-04-24T23:08:17.967404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'171","last_scrub_stamp":"2024-04-24T23:08:17.967241+0000","last_deep_scrub":"27'171","last_deep_scrub_stamp":"2024-04-24T23:08:17.967241+0000","last_clean_scrub_stamp":"2024-04-24T23:08:17.967241+0000","objects_scrubbed":1,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:57.121465+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":211,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:07.683387+0000","last_change":"2024-04-24T23:08:07.683435+0000","last_active":"2024-04-24T23:08:07.683387+0000","last_peered":"2024-04-24T23:08:07.683387+0000","last_clean":"2024-04-24T23:08:07.683387+0000","last_became_active":"2024-04-24T23:00:03.344074+0000","last_became_peered":"2024-04-24T23:00:03.344074+0000","last_unstale":"2024-04-24T23:08:07.683387+0000","last_undegraded":"2024-04-24T23:08:07.683387+0000","last_fullsized":"2024-04-24T23:08:07.683387+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-24T23:08:07.683292+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-24T23:08:07.683292+0000","last_clean_scrub_stamp":"2024-04-24T23:08:07.683292+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:08.895892+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'994","reported_seq":1010,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.896371+0000","last_change":"2024-04-24T23:00:57.865441+0000","last_active":"2024-04-24T23:07:55.896371+0000","last_peered":"2024-04-24T23:07:55.896371+0000","last_clean":"2024-04-24T23:07:55.896371+0000","last_became_active":"2024-04-24T23:00:57.864235+0000","last_became_peered":"2024-04-24T23:00:57.864235+0000","last_unstale":"2024-04-24T23:07:55.896371+0000","last_undegraded":"2024-04-24T23:07:55.896371+0000","last_fullsized":"2024-04-24T23:07:55.896371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":994,"log_dups_size":0,"ondisk_log_size":994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1231,"num_write_kb":6895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2,0],"acting":[5,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"27'317","reported_seq":352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.846986+0000","last_change":"2024-04-24T23:08:11.847106+0000","last_active":"2024-04-24T23:08:11.846986+0000","last_peered":"2024-04-24T23:08:11.846986+0000","last_clean":"2024-04-24T23:08:11.846986+0000","last_became_active":"2024-04-24T23:00:16.448187+0000","last_became_peered":"2024-04-24T23:00:16.448187+0000","last_unstale":"2024-04-24T23:08:11.846986+0000","last_undegraded":"2024-04-24T23:08:11.846986+0000","last_fullsized":"2024-04-24T23:08:11.846986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'317","last_scrub_stamp":"2024-04-24T23:08:11.846805+0000","last_deep_scrub":"27'317","last_deep_scrub_stamp":"2024-04-24T23:08:11.846805+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.846805+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:05.973112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'233","reported_seq":271,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.977001+0000","last_change":"2024-04-24T23:08:10.977070+0000","last_active":"2024-04-24T23:08:10.977001+0000","last_peered":"2024-04-24T23:08:10.977001+0000","last_clean":"2024-04-24T23:08:10.977001+0000","last_became_active":"2024-04-24T23:00:15.425134+0000","last_became_peered":"2024-04-24T23:00:15.425134+0000","last_unstale":"2024-04-24T23:08:10.977001+0000","last_undegraded":"2024-04-24T23:08:10.977001+0000","last_fullsized":"2024-04-24T23:08:10.977001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'233","last_scrub_stamp":"2024-04-24T23:08:10.976841+0000","last_deep_scrub":"27'233","last_deep_scrub_stamp":"2024-04-24T23:08:10.976841+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.976841+0000","objects_scrubbed":2,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:15:09.256485+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":252,"num_write_kb":12509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'1044","reported_seq":1074,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:15.480728+0000","last_change":"2024-04-24T23:08:15.480770+0000","last_active":"2024-04-24T23:08:15.480728+0000","last_peered":"2024-04-24T23:08:15.480728+0000","last_clean":"2024-04-24T23:08:15.480728+0000","last_became_active":"2024-04-24T23:00:20.500158+0000","last_became_peered":"2024-04-24T23:00:20.500158+0000","last_unstale":"2024-04-24T23:08:15.480728+0000","last_undegraded":"2024-04-24T23:08:15.480728+0000","last_fullsized":"2024-04-24T23:08:15.480728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1044","last_scrub_stamp":"2024-04-24T23:08:15.480624+0000","last_deep_scrub":"27'1044","last_deep_scrub_stamp":"2024-04-24T23:08:15.480624+0000","last_clean_scrub_stamp":"2024-04-24T23:08:15.480624+0000","objects_scrubbed":0,"log_size":1044,"log_dups_size":0,"ondisk_log_size":1044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:02.951621+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1291,"num_write_kb":7061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'349","reported_seq":385,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:21.943857+0000","last_change":"2024-04-24T23:08:21.943894+0000","last_active":"2024-04-24T23:08:21.943857+0000","last_peered":"2024-04-24T23:08:21.943857+0000","last_clean":"2024-04-24T23:08:21.943857+0000","last_became_active":"2024-04-24T23:00:16.471497+0000","last_became_peered":"2024-04-24T23:00:16.471497+0000","last_unstale":"2024-04-24T23:08:21.943857+0000","last_undegraded":"2024-04-24T23:08:21.943857+0000","last_fullsized":"2024-04-24T23:08:21.943857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'349","last_scrub_stamp":"2024-04-24T23:08:21.943759+0000","last_deep_scrub":"27'349","last_deep_scrub_stamp":"2024-04-24T23:08:21.943759+0000","last_clean_scrub_stamp":"2024-04-24T23:08:21.943759+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:47.271878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'527","reported_seq":565,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.239958+0000","last_change":"2024-04-24T23:08:14.240041+0000","last_active":"2024-04-24T23:08:14.239958+0000","last_peered":"2024-04-24T23:08:14.239958+0000","last_clean":"2024-04-24T23:08:14.239958+0000","last_became_active":"2024-04-24T23:00:15.405636+0000","last_became_peered":"2024-04-24T23:00:15.405636+0000","last_unstale":"2024-04-24T23:08:14.239958+0000","last_undegraded":"2024-04-24T23:08:14.239958+0000","last_fullsized":"2024-04-24T23:08:14.239958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'527","last_scrub_stamp":"2024-04-24T23:08:14.239784+0000","last_deep_scrub":"27'527","last_deep_scrub_stamp":"2024-04-24T23:08:14.239784+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.239784+0000","objects_scrubbed":4,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:18.373546+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":558,"num_write_kb":25209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'1010","reported_seq":1040,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:25.140436+0000","last_change":"2024-04-24T23:08:25.140500+0000","last_active":"2024-04-24T23:08:25.140436+0000","last_peered":"2024-04-24T23:08:25.140436+0000","last_clean":"2024-04-24T23:08:25.140436+0000","last_became_active":"2024-04-24T23:00:20.500153+0000","last_became_peered":"2024-04-24T23:00:20.500153+0000","last_unstale":"2024-04-24T23:08:25.140436+0000","last_undegraded":"2024-04-24T23:08:25.140436+0000","last_fullsized":"2024-04-24T23:08:25.140436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1010","last_scrub_stamp":"2024-04-24T23:08:25.140238+0000","last_deep_scrub":"27'1010","last_deep_scrub_stamp":"2024-04-24T23:08:25.140238+0000","last_clean_scrub_stamp":"2024-04-24T23:08:25.140238+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:25.420788+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":6978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'294","reported_seq":330,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:07.980369+0000","last_change":"2024-04-24T23:08:07.980416+0000","last_active":"2024-04-24T23:08:07.980369+0000","last_peered":"2024-04-24T23:08:07.980369+0000","last_clean":"2024-04-24T23:08:07.980369+0000","last_became_active":"2024-04-24T23:00:16.446170+0000","last_became_peered":"2024-04-24T23:00:16.446170+0000","last_unstale":"2024-04-24T23:08:07.980369+0000","last_undegraded":"2024-04-24T23:08:07.980369+0000","last_fullsized":"2024-04-24T23:08:07.980369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'294","last_scrub_stamp":"2024-04-24T23:08:07.980274+0000","last_deep_scrub":"27'294","last_deep_scrub_stamp":"2024-04-24T23:08:07.980274+0000","last_clean_scrub_stamp":"2024-04-24T23:08:07.980274+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:03.782520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'344","reported_seq":382,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.509207+0000","last_change":"2024-04-24T23:08:12.509292+0000","last_active":"2024-04-24T23:08:12.509207+0000","last_peered":"2024-04-24T23:08:12.509207+0000","last_clean":"2024-04-24T23:08:12.509207+0000","last_became_active":"2024-04-24T23:00:15.414863+0000","last_became_peered":"2024-04-24T23:00:15.414863+0000","last_unstale":"2024-04-24T23:08:12.509207+0000","last_undegraded":"2024-04-24T23:08:12.509207+0000","last_fullsized":"2024-04-24T23:08:12.509207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'344","last_scrub_stamp":"2024-04-24T23:08:12.509034+0000","last_deep_scrub":"27'344","last_deep_scrub_stamp":"2024-04-24T23:08:12.509034+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.509034+0000","objects_scrubbed":2,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:25.267931+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":379,"num_write_kb":12861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'1068","reported_seq":1090,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.903240+0000","last_change":"2024-04-24T23:00:20.499277+0000","last_active":"2024-04-24T23:07:55.903240+0000","last_peered":"2024-04-24T23:07:55.903240+0000","last_clean":"2024-04-24T23:07:55.903240+0000","last_became_active":"2024-04-24T23:00:20.498802+0000","last_became_peered":"2024-04-24T23:00:20.498802+0000","last_unstale":"2024-04-24T23:07:55.903240+0000","last_undegraded":"2024-04-24T23:07:55.903240+0000","last_fullsized":"2024-04-24T23:07:55.903240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":7543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'288","reported_seq":323,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:08.343704+0000","last_change":"2024-04-24T23:08:08.343745+0000","last_active":"2024-04-24T23:08:08.343704+0000","last_peered":"2024-04-24T23:08:08.343704+0000","last_clean":"2024-04-24T23:08:08.343704+0000","last_became_active":"2024-04-24T23:00:16.447838+0000","last_became_peered":"2024-04-24T23:00:16.447838+0000","last_unstale":"2024-04-24T23:08:08.343704+0000","last_undegraded":"2024-04-24T23:08:08.343704+0000","last_fullsized":"2024-04-24T23:08:08.343704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'288","last_scrub_stamp":"2024-04-24T23:08:08.343620+0000","last_deep_scrub":"27'288","last_deep_scrub_stamp":"2024-04-24T23:08:08.343620+0000","last_clean_scrub_stamp":"2024-04-24T23:08:08.343620+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:15:06.623264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'305","reported_seq":343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.986182+0000","last_change":"2024-04-24T23:08:13.986246+0000","last_active":"2024-04-24T23:08:13.986182+0000","last_peered":"2024-04-24T23:08:13.986182+0000","last_clean":"2024-04-24T23:08:13.986182+0000","last_became_active":"2024-04-24T23:00:15.420590+0000","last_became_peered":"2024-04-24T23:00:15.420590+0000","last_unstale":"2024-04-24T23:08:13.986182+0000","last_undegraded":"2024-04-24T23:08:13.986182+0000","last_fullsized":"2024-04-24T23:08:13.986182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'305","last_scrub_stamp":"2024-04-24T23:08:13.986021+0000","last_deep_scrub":"27'305","last_deep_scrub_stamp":"2024-04-24T23:08:13.986021+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.986021+0000","objects_scrubbed":1,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:45.819289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":356,"num_write_kb":8611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'1045","reported_seq":1075,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.612612+0000","last_change":"2024-04-24T23:08:13.612684+0000","last_active":"2024-04-24T23:08:13.612612+0000","last_peered":"2024-04-24T23:08:13.612612+0000","last_clean":"2024-04-24T23:08:13.612612+0000","last_became_active":"2024-04-24T23:00:20.493784+0000","last_became_peered":"2024-04-24T23:00:20.493784+0000","last_unstale":"2024-04-24T23:08:13.612612+0000","last_undegraded":"2024-04-24T23:08:13.612612+0000","last_fullsized":"2024-04-24T23:08:13.612612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1045","last_scrub_stamp":"2024-04-24T23:08:13.612397+0000","last_deep_scrub":"27'1045","last_deep_scrub_stamp":"2024-04-24T23:08:13.612397+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.612397+0000","objects_scrubbed":0,"log_size":1045,"log_dups_size":0,"ondisk_log_size":1045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:57.387089+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1330,"num_write_kb":7257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'367","reported_seq":402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:09.797678+0000","last_change":"2024-04-24T23:08:09.797718+0000","last_active":"2024-04-24T23:08:09.797678+0000","last_peered":"2024-04-24T23:08:09.797678+0000","last_clean":"2024-04-24T23:08:09.797678+0000","last_became_active":"2024-04-24T23:00:16.447742+0000","last_became_peered":"2024-04-24T23:00:16.447742+0000","last_unstale":"2024-04-24T23:08:09.797678+0000","last_undegraded":"2024-04-24T23:08:09.797678+0000","last_fullsized":"2024-04-24T23:08:09.797678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'367","last_scrub_stamp":"2024-04-24T23:08:09.797598+0000","last_deep_scrub":"27'367","last_deep_scrub_stamp":"2024-04-24T23:08:09.797598+0000","last_clean_scrub_stamp":"2024-04-24T23:08:09.797598+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:36.105701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'271","reported_seq":309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.520747+0000","last_change":"2024-04-24T23:08:11.520886+0000","last_active":"2024-04-24T23:08:11.520747+0000","last_peered":"2024-04-24T23:08:11.520747+0000","last_clean":"2024-04-24T23:08:11.520747+0000","last_became_active":"2024-04-24T23:00:15.416198+0000","last_became_peered":"2024-04-24T23:00:15.416198+0000","last_unstale":"2024-04-24T23:08:11.520747+0000","last_undegraded":"2024-04-24T23:08:11.520747+0000","last_fullsized":"2024-04-24T23:08:11.520747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'271","last_scrub_stamp":"2024-04-24T23:08:11.520546+0000","last_deep_scrub":"27'271","last_deep_scrub_stamp":"2024-04-24T23:08:11.520546+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.520546+0000","objects_scrubbed":4,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:34:11.543033+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":330,"num_write_kb":8690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'1004","reported_seq":1026,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.845903+0000","last_change":"2024-04-24T23:00:20.526621+0000","last_active":"2024-04-24T23:07:55.845903+0000","last_peered":"2024-04-24T23:07:55.845903+0000","last_clean":"2024-04-24T23:07:55.845903+0000","last_became_active":"2024-04-24T23:00:20.525782+0000","last_became_peered":"2024-04-24T23:00:20.525782+0000","last_unstale":"2024-04-24T23:07:55.845903+0000","last_undegraded":"2024-04-24T23:07:55.845903+0000","last_fullsized":"2024-04-24T23:07:55.845903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":7027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'336","reported_seq":372,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.641520+0000","last_change":"2024-04-24T23:08:12.641579+0000","last_active":"2024-04-24T23:08:12.641520+0000","last_peered":"2024-04-24T23:08:12.641520+0000","last_clean":"2024-04-24T23:08:12.641520+0000","last_became_active":"2024-04-24T23:00:16.454031+0000","last_became_peered":"2024-04-24T23:00:16.454031+0000","last_unstale":"2024-04-24T23:08:12.641520+0000","last_undegraded":"2024-04-24T23:08:12.641520+0000","last_fullsized":"2024-04-24T23:08:12.641520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'336","last_scrub_stamp":"2024-04-24T23:08:12.641351+0000","last_deep_scrub":"27'336","last_deep_scrub_stamp":"2024-04-24T23:08:12.641351+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.641351+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:24.981640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'68","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.978657+0000","last_change":"2024-04-24T23:08:12.978720+0000","last_active":"2024-04-24T23:08:12.978657+0000","last_peered":"2024-04-24T23:08:12.978657+0000","last_clean":"2024-04-24T23:08:12.978657+0000","last_became_active":"2024-04-24T23:00:15.416688+0000","last_became_peered":"2024-04-24T23:00:15.416688+0000","last_unstale":"2024-04-24T23:08:12.978657+0000","last_undegraded":"2024-04-24T23:08:12.978657+0000","last_fullsized":"2024-04-24T23:08:12.978657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'68","last_scrub_stamp":"2024-04-24T23:08:12.978483+0000","last_deep_scrub":"27'68","last_deep_scrub_stamp":"2024-04-24T23:08:12.978483+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.978483+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.373598+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":106,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'996","reported_seq":1026,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:26.167763+0000","last_change":"2024-04-24T23:08:26.167830+0000","last_active":"2024-04-24T23:08:26.167763+0000","last_peered":"2024-04-24T23:08:26.167763+0000","last_clean":"2024-04-24T23:08:26.167763+0000","last_became_active":"2024-04-24T23:00:20.516152+0000","last_became_peered":"2024-04-24T23:00:20.516152+0000","last_unstale":"2024-04-24T23:08:26.167763+0000","last_undegraded":"2024-04-24T23:08:26.167763+0000","last_fullsized":"2024-04-24T23:08:26.167763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'996","last_scrub_stamp":"2024-04-24T23:08:26.167579+0000","last_deep_scrub":"27'996","last_deep_scrub_stamp":"2024-04-24T23:08:26.167579+0000","last_clean_scrub_stamp":"2024-04-24T23:08:26.167579+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:31.251861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":6136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'317","reported_seq":352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.888807+0000","last_change":"2024-04-24T23:08:14.888843+0000","last_active":"2024-04-24T23:08:14.888807+0000","last_peered":"2024-04-24T23:08:14.888807+0000","last_clean":"2024-04-24T23:08:14.888807+0000","last_became_active":"2024-04-24T23:00:16.458081+0000","last_became_peered":"2024-04-24T23:00:16.458081+0000","last_unstale":"2024-04-24T23:08:14.888807+0000","last_undegraded":"2024-04-24T23:08:14.888807+0000","last_fullsized":"2024-04-24T23:08:14.888807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'317","last_scrub_stamp":"2024-04-24T23:08:14.888712+0000","last_deep_scrub":"27'317","last_deep_scrub_stamp":"2024-04-24T23:08:14.888712+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.888712+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:40.216832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'41","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:19.955653+0000","last_change":"2024-04-24T23:08:19.955780+0000","last_active":"2024-04-24T23:08:19.955653+0000","last_peered":"2024-04-24T23:08:19.955653+0000","last_clean":"2024-04-24T23:08:19.955653+0000","last_became_active":"2024-04-24T23:00:15.412847+0000","last_became_peered":"2024-04-24T23:00:15.412847+0000","last_unstale":"2024-04-24T23:08:19.955653+0000","last_undegraded":"2024-04-24T23:08:19.955653+0000","last_fullsized":"2024-04-24T23:08:19.955653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-04-24T23:08:19.955448+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-04-24T23:08:19.955448+0000","last_clean_scrub_stamp":"2024-04-24T23:08:19.955448+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:59:48.502956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":81,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'915","reported_seq":945,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:22.778924+0000","last_change":"2024-04-24T23:08:22.778986+0000","last_active":"2024-04-24T23:08:22.778924+0000","last_peered":"2024-04-24T23:08:22.778924+0000","last_clean":"2024-04-24T23:08:22.778924+0000","last_became_active":"2024-04-24T23:00:20.529427+0000","last_became_peered":"2024-04-24T23:00:20.529427+0000","last_unstale":"2024-04-24T23:08:22.778924+0000","last_undegraded":"2024-04-24T23:08:22.778924+0000","last_fullsized":"2024-04-24T23:08:22.778924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'915","last_scrub_stamp":"2024-04-24T23:08:22.778727+0000","last_deep_scrub":"27'915","last_deep_scrub_stamp":"2024-04-24T23:08:22.778727+0000","last_clean_scrub_stamp":"2024-04-24T23:08:22.778727+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:00.684626+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":6219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'322","reported_seq":358,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:15.901419+0000","last_change":"2024-04-24T23:08:15.901486+0000","last_active":"2024-04-24T23:08:15.901419+0000","last_peered":"2024-04-24T23:08:15.901419+0000","last_clean":"2024-04-24T23:08:15.901419+0000","last_became_active":"2024-04-24T23:00:16.464653+0000","last_became_peered":"2024-04-24T23:00:16.464653+0000","last_unstale":"2024-04-24T23:08:15.901419+0000","last_undegraded":"2024-04-24T23:08:15.901419+0000","last_fullsized":"2024-04-24T23:08:15.901419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'322","last_scrub_stamp":"2024-04-24T23:08:15.901193+0000","last_deep_scrub":"27'322","last_deep_scrub_stamp":"2024-04-24T23:08:15.901193+0000","last_clean_scrub_stamp":"2024-04-24T23:08:15.901193+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:28.660091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'533","reported_seq":571,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.174722+0000","last_change":"2024-04-24T23:08:11.174802+0000","last_active":"2024-04-24T23:08:11.174722+0000","last_peered":"2024-04-24T23:08:11.174722+0000","last_clean":"2024-04-24T23:08:11.174722+0000","last_became_active":"2024-04-24T23:00:15.426641+0000","last_became_peered":"2024-04-24T23:00:15.426641+0000","last_unstale":"2024-04-24T23:08:11.174722+0000","last_undegraded":"2024-04-24T23:08:11.174722+0000","last_fullsized":"2024-04-24T23:08:11.174722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'533","last_scrub_stamp":"2024-04-24T23:08:11.174557+0000","last_deep_scrub":"27'533","last_deep_scrub_stamp":"2024-04-24T23:08:11.174557+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.174557+0000","objects_scrubbed":3,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:37.607367+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":566,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'952","reported_seq":974,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.869155+0000","last_change":"2024-04-24T23:00:20.518479+0000","last_active":"2024-04-24T23:07:55.869155+0000","last_peered":"2024-04-24T23:07:55.869155+0000","last_clean":"2024-04-24T23:07:55.869155+0000","last_became_active":"2024-04-24T23:00:20.517950+0000","last_became_peered":"2024-04-24T23:00:20.517950+0000","last_unstale":"2024-04-24T23:07:55.869155+0000","last_undegraded":"2024-04-24T23:07:55.869155+0000","last_fullsized":"2024-04-24T23:07:55.869155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":7094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'294","reported_seq":330,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:19.879301+0000","last_change":"2024-04-24T23:08:19.879337+0000","last_active":"2024-04-24T23:08:19.879301+0000","last_peered":"2024-04-24T23:08:19.879301+0000","last_clean":"2024-04-24T23:08:19.879301+0000","last_became_active":"2024-04-24T23:00:16.456636+0000","last_became_peered":"2024-04-24T23:00:16.456636+0000","last_unstale":"2024-04-24T23:08:19.879301+0000","last_undegraded":"2024-04-24T23:08:19.879301+0000","last_fullsized":"2024-04-24T23:08:19.879301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'294","last_scrub_stamp":"2024-04-24T23:08:19.879214+0000","last_deep_scrub":"27'294","last_deep_scrub_stamp":"2024-04-24T23:08:19.879214+0000","last_clean_scrub_stamp":"2024-04-24T23:08:19.879214+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:58.879930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'571","reported_seq":608,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:07.410854+0000","last_change":"2024-04-24T23:08:07.410907+0000","last_active":"2024-04-24T23:08:07.410854+0000","last_peered":"2024-04-24T23:08:07.410854+0000","last_clean":"2024-04-24T23:08:07.410854+0000","last_became_active":"2024-04-24T23:00:15.427837+0000","last_became_peered":"2024-04-24T23:00:15.427837+0000","last_unstale":"2024-04-24T23:08:07.410854+0000","last_undegraded":"2024-04-24T23:08:07.410854+0000","last_fullsized":"2024-04-24T23:08:07.410854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'571","last_scrub_stamp":"2024-04-24T23:08:07.410756+0000","last_deep_scrub":"27'571","last_deep_scrub_stamp":"2024-04-24T23:08:07.410756+0000","last_clean_scrub_stamp":"2024-04-24T23:08:07.410756+0000","objects_scrubbed":4,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:36:51.328741+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":635,"num_write_kb":21119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'1015","reported_seq":1052,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:23.528641+0000","last_change":"2024-04-24T23:08:23.528704+0000","last_active":"2024-04-24T23:08:23.528641+0000","last_peered":"2024-04-24T23:08:23.528641+0000","last_clean":"2024-04-24T23:08:23.528641+0000","last_became_active":"2024-04-24T23:00:57.864156+0000","last_became_peered":"2024-04-24T23:00:57.864156+0000","last_unstale":"2024-04-24T23:08:23.528641+0000","last_undegraded":"2024-04-24T23:08:23.528641+0000","last_fullsized":"2024-04-24T23:08:23.528641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1015","last_scrub_stamp":"2024-04-24T23:08:23.528459+0000","last_deep_scrub":"27'1015","last_deep_scrub_stamp":"2024-04-24T23:08:23.528459+0000","last_clean_scrub_stamp":"2024-04-24T23:08:23.528459+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:35:12.171984+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":6923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'298","reported_seq":333,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:08.844059+0000","last_change":"2024-04-24T23:08:08.844090+0000","last_active":"2024-04-24T23:08:08.844059+0000","last_peered":"2024-04-24T23:08:08.844059+0000","last_clean":"2024-04-24T23:08:08.844059+0000","last_became_active":"2024-04-24T23:00:16.453033+0000","last_became_peered":"2024-04-24T23:00:16.453033+0000","last_unstale":"2024-04-24T23:08:08.844059+0000","last_undegraded":"2024-04-24T23:08:08.844059+0000","last_fullsized":"2024-04-24T23:08:08.844059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'298","last_scrub_stamp":"2024-04-24T23:08:08.843968+0000","last_deep_scrub":"27'298","last_deep_scrub_stamp":"2024-04-24T23:08:08.843968+0000","last_clean_scrub_stamp":"2024-04-24T23:08:08.843968+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:45.536127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'669","reported_seq":707,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.157597+0000","last_change":"2024-04-24T23:08:12.157714+0000","last_active":"2024-04-24T23:08:12.157597+0000","last_peered":"2024-04-24T23:08:12.157597+0000","last_clean":"2024-04-24T23:08:12.157597+0000","last_became_active":"2024-04-24T23:00:15.430254+0000","last_became_peered":"2024-04-24T23:00:15.430254+0000","last_unstale":"2024-04-24T23:08:12.157597+0000","last_undegraded":"2024-04-24T23:08:12.157597+0000","last_fullsized":"2024-04-24T23:08:12.157597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'669","last_scrub_stamp":"2024-04-24T23:08:12.157384+0000","last_deep_scrub":"27'669","last_deep_scrub_stamp":"2024-04-24T23:08:12.157384+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.157384+0000","objects_scrubbed":3,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:20:16.460666+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":729,"num_write_kb":21519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'963","reported_seq":993,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:16.482920+0000","last_change":"2024-04-24T23:08:16.482985+0000","last_active":"2024-04-24T23:08:16.482920+0000","last_peered":"2024-04-24T23:08:16.482920+0000","last_clean":"2024-04-24T23:08:16.482920+0000","last_became_active":"2024-04-24T23:00:20.502285+0000","last_became_peered":"2024-04-24T23:00:20.502285+0000","last_unstale":"2024-04-24T23:08:16.482920+0000","last_undegraded":"2024-04-24T23:08:16.482920+0000","last_fullsized":"2024-04-24T23:08:16.482920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'963","last_scrub_stamp":"2024-04-24T23:08:16.482743+0000","last_deep_scrub":"27'963","last_deep_scrub_stamp":"2024-04-24T23:08:16.482743+0000","last_clean_scrub_stamp":"2024-04-24T23:08:16.482743+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:50:48.658196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'299","reported_seq":335,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:20.151424+0000","last_change":"2024-04-24T23:08:20.151488+0000","last_active":"2024-04-24T23:08:20.151424+0000","last_peered":"2024-04-24T23:08:20.151424+0000","last_clean":"2024-04-24T23:08:20.151424+0000","last_became_active":"2024-04-24T23:00:16.451611+0000","last_became_peered":"2024-04-24T23:00:16.451611+0000","last_unstale":"2024-04-24T23:08:20.151424+0000","last_undegraded":"2024-04-24T23:08:20.151424+0000","last_fullsized":"2024-04-24T23:08:20.151424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'299","last_scrub_stamp":"2024-04-24T23:08:20.151250+0000","last_deep_scrub":"27'299","last_deep_scrub_stamp":"2024-04-24T23:08:20.151250+0000","last_clean_scrub_stamp":"2024-04-24T23:08:20.151250+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:27.986721+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'415","reported_seq":453,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.032582+0000","last_change":"2024-04-24T23:08:10.032630+0000","last_active":"2024-04-24T23:08:10.032582+0000","last_peered":"2024-04-24T23:08:10.032582+0000","last_clean":"2024-04-24T23:08:10.032582+0000","last_became_active":"2024-04-24T23:00:15.397253+0000","last_became_peered":"2024-04-24T23:00:15.397253+0000","last_unstale":"2024-04-24T23:08:10.032582+0000","last_undegraded":"2024-04-24T23:08:10.032582+0000","last_fullsized":"2024-04-24T23:08:10.032582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'415","last_scrub_stamp":"2024-04-24T23:08:10.032464+0000","last_deep_scrub":"27'415","last_deep_scrub_stamp":"2024-04-24T23:08:10.032464+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.032464+0000","objects_scrubbed":1,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:34.670281+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":486,"num_write_kb":21108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'1063","reported_seq":1093,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:16.184506+0000","last_change":"2024-04-24T23:08:16.184569+0000","last_active":"2024-04-24T23:08:16.184506+0000","last_peered":"2024-04-24T23:08:16.184506+0000","last_clean":"2024-04-24T23:08:16.184506+0000","last_became_active":"2024-04-24T23:00:20.505504+0000","last_became_peered":"2024-04-24T23:00:20.505504+0000","last_unstale":"2024-04-24T23:08:16.184506+0000","last_undegraded":"2024-04-24T23:08:16.184506+0000","last_fullsized":"2024-04-24T23:08:16.184506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1063","last_scrub_stamp":"2024-04-24T23:08:16.184312+0000","last_deep_scrub":"27'1063","last_deep_scrub_stamp":"2024-04-24T23:08:16.184312+0000","last_clean_scrub_stamp":"2024-04-24T23:08:16.184312+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.069666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1319,"num_write_kb":7863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'344","reported_seq":379,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.351795+0000","last_change":"2024-04-24T23:08:10.351834+0000","last_active":"2024-04-24T23:08:10.351795+0000","last_peered":"2024-04-24T23:08:10.351795+0000","last_clean":"2024-04-24T23:08:10.351795+0000","last_became_active":"2024-04-24T23:00:16.450149+0000","last_became_peered":"2024-04-24T23:00:16.450149+0000","last_unstale":"2024-04-24T23:08:10.351795+0000","last_undegraded":"2024-04-24T23:08:10.351795+0000","last_fullsized":"2024-04-24T23:08:10.351795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'344","last_scrub_stamp":"2024-04-24T23:08:10.351699+0000","last_deep_scrub":"27'344","last_deep_scrub_stamp":"2024-04-24T23:08:10.351699+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.351699+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:36.237053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'69","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:08.690192+0000","last_change":"2024-04-24T23:08:08.690240+0000","last_active":"2024-04-24T23:08:08.690192+0000","last_peered":"2024-04-24T23:08:08.690192+0000","last_clean":"2024-04-24T23:08:08.690192+0000","last_became_active":"2024-04-24T23:00:15.427857+0000","last_became_peered":"2024-04-24T23:00:15.427857+0000","last_unstale":"2024-04-24T23:08:08.690192+0000","last_undegraded":"2024-04-24T23:08:08.690192+0000","last_fullsized":"2024-04-24T23:08:08.690192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'69","last_scrub_stamp":"2024-04-24T23:08:08.690087+0000","last_deep_scrub":"27'69","last_deep_scrub_stamp":"2024-04-24T23:08:08.690087+0000","last_clean_scrub_stamp":"2024-04-24T23:08:08.690087+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:38.861647+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":104,"num_write_kb":4310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'1074","reported_seq":1104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:20.499053+0000","last_change":"2024-04-24T23:08:20.499117+0000","last_active":"2024-04-24T23:08:20.499053+0000","last_peered":"2024-04-24T23:08:20.499053+0000","last_clean":"2024-04-24T23:08:20.499053+0000","last_became_active":"2024-04-24T23:00:20.506257+0000","last_became_peered":"2024-04-24T23:00:20.506257+0000","last_unstale":"2024-04-24T23:08:20.499053+0000","last_undegraded":"2024-04-24T23:08:20.499053+0000","last_fullsized":"2024-04-24T23:08:20.499053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1074","last_scrub_stamp":"2024-04-24T23:08:20.498875+0000","last_deep_scrub":"27'1074","last_deep_scrub_stamp":"2024-04-24T23:08:20.498875+0000","last_clean_scrub_stamp":"2024-04-24T23:08:20.498875+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:14.625182+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":7398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1072","reported_seq":1110,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:24.500921+0000","last_change":"2024-04-24T23:08:24.500993+0000","last_active":"2024-04-24T23:08:24.500921+0000","last_peered":"2024-04-24T23:08:24.500921+0000","last_clean":"2024-04-24T23:08:24.500921+0000","last_became_active":"2024-04-24T23:00:57.865999+0000","last_became_peered":"2024-04-24T23:00:57.865999+0000","last_unstale":"2024-04-24T23:08:24.500921+0000","last_undegraded":"2024-04-24T23:08:24.500921+0000","last_fullsized":"2024-04-24T23:08:24.500921+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1072","last_scrub_stamp":"2024-04-24T23:08:24.500735+0000","last_deep_scrub":"27'1072","last_deep_scrub_stamp":"2024-04-24T23:08:24.500735+0000","last_clean_scrub_stamp":"2024-04-24T23:08:24.500735+0000","objects_scrubbed":0,"log_size":1072,"log_dups_size":0,"ondisk_log_size":1072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:31.641752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1313,"num_write_kb":7137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'327","reported_seq":363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:16.493753+0000","last_change":"2024-04-24T23:08:16.493820+0000","last_active":"2024-04-24T23:08:16.493753+0000","last_peered":"2024-04-24T23:08:16.493753+0000","last_clean":"2024-04-24T23:08:16.493753+0000","last_became_active":"2024-04-24T23:00:16.477474+0000","last_became_peered":"2024-04-24T23:00:16.477474+0000","last_unstale":"2024-04-24T23:08:16.493753+0000","last_undegraded":"2024-04-24T23:08:16.493753+0000","last_fullsized":"2024-04-24T23:08:16.493753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'327","last_scrub_stamp":"2024-04-24T23:08:16.493577+0000","last_deep_scrub":"27'327","last_deep_scrub_stamp":"2024-04-24T23:08:16.493577+0000","last_clean_scrub_stamp":"2024-04-24T23:08:16.493577+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:45:57.777691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'570","reported_seq":607,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:16.972770+0000","last_change":"2024-04-24T23:08:16.972807+0000","last_active":"2024-04-24T23:08:16.972770+0000","last_peered":"2024-04-24T23:08:16.972770+0000","last_clean":"2024-04-24T23:08:16.972770+0000","last_became_active":"2024-04-24T23:00:15.405608+0000","last_became_peered":"2024-04-24T23:00:15.405608+0000","last_unstale":"2024-04-24T23:08:16.972770+0000","last_undegraded":"2024-04-24T23:08:16.972770+0000","last_fullsized":"2024-04-24T23:08:16.972770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'570","last_scrub_stamp":"2024-04-24T23:08:16.972682+0000","last_deep_scrub":"27'570","last_deep_scrub_stamp":"2024-04-24T23:08:16.972682+0000","last_clean_scrub_stamp":"2024-04-24T23:08:16.972682+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:30.276490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":627,"num_write_kb":21153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'936","reported_seq":958,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:07:55.906702+0000","last_change":"2024-04-24T23:00:20.493810+0000","last_active":"2024-04-24T23:07:55.906702+0000","last_peered":"2024-04-24T23:07:55.906702+0000","last_clean":"2024-04-24T23:07:55.906702+0000","last_became_active":"2024-04-24T23:00:20.492303+0000","last_became_peered":"2024-04-24T23:00:20.492303+0000","last_unstale":"2024-04-24T23:07:55.906702+0000","last_undegraded":"2024-04-24T23:07:55.906702+0000","last_fullsized":"2024-04-24T23:07:55.906702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T23:00:19.456282+0000","last_clean_scrub_stamp":"2024-04-24T23:00:19.456282+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":6525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'358","reported_seq":394,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:22.211880+0000","last_change":"2024-04-24T23:08:22.211940+0000","last_active":"2024-04-24T23:08:22.211880+0000","last_peered":"2024-04-24T23:08:22.211880+0000","last_clean":"2024-04-24T23:08:22.211880+0000","last_became_active":"2024-04-24T23:00:16.457311+0000","last_became_peered":"2024-04-24T23:00:16.457311+0000","last_unstale":"2024-04-24T23:08:22.211880+0000","last_undegraded":"2024-04-24T23:08:22.211880+0000","last_fullsized":"2024-04-24T23:08:22.211880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'358","last_scrub_stamp":"2024-04-24T23:08:22.211698+0000","last_deep_scrub":"27'358","last_deep_scrub_stamp":"2024-04-24T23:08:22.211698+0000","last_clean_scrub_stamp":"2024-04-24T23:08:22.211698+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:48:02.503053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":274,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'151","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.979998+0000","last_change":"2024-04-24T23:08:11.980054+0000","last_active":"2024-04-24T23:08:11.979998+0000","last_peered":"2024-04-24T23:08:11.979998+0000","last_clean":"2024-04-24T23:08:11.979998+0000","last_became_active":"2024-04-24T23:00:15.435730+0000","last_became_peered":"2024-04-24T23:00:15.435730+0000","last_unstale":"2024-04-24T23:08:11.979998+0000","last_undegraded":"2024-04-24T23:08:11.979998+0000","last_fullsized":"2024-04-24T23:08:11.979998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'151","last_scrub_stamp":"2024-04-24T23:08:11.979824+0000","last_deep_scrub":"27'151","last_deep_scrub_stamp":"2024-04-24T23:08:11.979824+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.979824+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:18:39.157085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":198,"num_write_kb":4560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'1085","reported_seq":1122,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:21.985263+0000","last_change":"2024-04-24T23:08:21.985328+0000","last_active":"2024-04-24T23:08:21.985263+0000","last_peered":"2024-04-24T23:08:21.985263+0000","last_clean":"2024-04-24T23:08:21.985263+0000","last_became_active":"2024-04-24T23:00:15.417226+0000","last_became_peered":"2024-04-24T23:00:15.417226+0000","last_unstale":"2024-04-24T23:08:21.985263+0000","last_undegraded":"2024-04-24T23:08:21.985263+0000","last_fullsized":"2024-04-24T23:08:21.985263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1085","last_scrub_stamp":"2024-04-24T23:08:21.985099+0000","last_deep_scrub":"27'1085","last_deep_scrub_stamp":"2024-04-24T23:08:21.985099+0000","last_clean_scrub_stamp":"2024-04-24T23:08:21.985099+0000","objects_scrubbed":2,"log_size":1085,"log_dups_size":0,"ondisk_log_size":1085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:45.882971+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":1127,"num_write_kb":29507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'300","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:17.497876+0000","last_change":"2024-04-24T23:08:17.497936+0000","last_active":"2024-04-24T23:08:17.497876+0000","last_peered":"2024-04-24T23:08:17.497876+0000","last_clean":"2024-04-24T23:08:17.497876+0000","last_became_active":"2024-04-24T23:00:16.482676+0000","last_became_peered":"2024-04-24T23:00:16.482676+0000","last_unstale":"2024-04-24T23:08:17.497876+0000","last_undegraded":"2024-04-24T23:08:17.497876+0000","last_fullsized":"2024-04-24T23:08:17.497876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'300","last_scrub_stamp":"2024-04-24T23:08:17.497690+0000","last_deep_scrub":"27'300","last_deep_scrub_stamp":"2024-04-24T23:08:17.497690+0000","last_clean_scrub_stamp":"2024-04-24T23:08:17.497690+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:07.325595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'936","reported_seq":966,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:22.543467+0000","last_change":"2024-04-24T23:08:22.543541+0000","last_active":"2024-04-24T23:08:22.543467+0000","last_peered":"2024-04-24T23:08:22.543467+0000","last_clean":"2024-04-24T23:08:22.543467+0000","last_became_active":"2024-04-24T23:00:20.541822+0000","last_became_peered":"2024-04-24T23:00:20.541822+0000","last_unstale":"2024-04-24T23:08:22.543467+0000","last_undegraded":"2024-04-24T23:08:22.543467+0000","last_fullsized":"2024-04-24T23:08:22.543467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'936","last_scrub_stamp":"2024-04-24T23:08:22.543261+0000","last_deep_scrub":"27'936","last_deep_scrub_stamp":"2024-04-24T23:08:22.543261+0000","last_clean_scrub_stamp":"2024-04-24T23:08:22.543261+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:36:52.069115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":5864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'465","reported_seq":503,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:16.218297+0000","last_change":"2024-04-24T23:08:16.218367+0000","last_active":"2024-04-24T23:08:16.218297+0000","last_peered":"2024-04-24T23:08:16.218297+0000","last_clean":"2024-04-24T23:08:16.218297+0000","last_became_active":"2024-04-24T23:00:15.424739+0000","last_became_peered":"2024-04-24T23:00:15.424739+0000","last_unstale":"2024-04-24T23:08:16.218297+0000","last_undegraded":"2024-04-24T23:08:16.218297+0000","last_fullsized":"2024-04-24T23:08:16.218297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'465","last_scrub_stamp":"2024-04-24T23:08:16.218115+0000","last_deep_scrub":"27'465","last_deep_scrub_stamp":"2024-04-24T23:08:16.218115+0000","last_clean_scrub_stamp":"2024-04-24T23:08:16.218115+0000","objects_scrubbed":1,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:46.476719+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":495,"num_write_kb":8616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'329","reported_seq":365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.631248+0000","last_change":"2024-04-24T23:08:11.631363+0000","last_active":"2024-04-24T23:08:11.631248+0000","last_peered":"2024-04-24T23:08:11.631248+0000","last_clean":"2024-04-24T23:08:11.631248+0000","last_became_active":"2024-04-24T23:00:16.453965+0000","last_became_peered":"2024-04-24T23:00:16.453965+0000","last_unstale":"2024-04-24T23:08:11.631248+0000","last_undegraded":"2024-04-24T23:08:11.631248+0000","last_fullsized":"2024-04-24T23:08:11.631248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'329","last_scrub_stamp":"2024-04-24T23:08:11.631063+0000","last_deep_scrub":"27'329","last_deep_scrub_stamp":"2024-04-24T23:08:11.631063+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.631063+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:17:16.489974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'945","reported_seq":975,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:17.230752+0000","last_change":"2024-04-24T23:08:17.230880+0000","last_active":"2024-04-24T23:08:17.230752+0000","last_peered":"2024-04-24T23:08:17.230752+0000","last_clean":"2024-04-24T23:08:17.230752+0000","last_became_active":"2024-04-24T23:00:20.509269+0000","last_became_peered":"2024-04-24T23:00:20.509269+0000","last_unstale":"2024-04-24T23:08:17.230752+0000","last_undegraded":"2024-04-24T23:08:17.230752+0000","last_fullsized":"2024-04-24T23:08:17.230752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'945","last_scrub_stamp":"2024-04-24T23:08:17.230519+0000","last_deep_scrub":"27'945","last_deep_scrub_stamp":"2024-04-24T23:08:17.230519+0000","last_clean_scrub_stamp":"2024-04-24T23:08:17.230519+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:26.873328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":6611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'351","reported_seq":386,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.349492+0000","last_change":"2024-04-24T23:08:12.349555+0000","last_active":"2024-04-24T23:08:12.349492+0000","last_peered":"2024-04-24T23:08:12.349492+0000","last_clean":"2024-04-24T23:08:12.349492+0000","last_became_active":"2024-04-24T23:00:16.456289+0000","last_became_peered":"2024-04-24T23:00:16.456289+0000","last_unstale":"2024-04-24T23:08:12.349492+0000","last_undegraded":"2024-04-24T23:08:12.349492+0000","last_fullsized":"2024-04-24T23:08:12.349492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'351","last_scrub_stamp":"2024-04-24T23:08:12.349314+0000","last_deep_scrub":"27'351","last_deep_scrub_stamp":"2024-04-24T23:08:12.349314+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.349314+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:34:12.371801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'354","reported_seq":390,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.140221+0000","last_change":"2024-04-24T23:08:13.140281+0000","last_active":"2024-04-24T23:08:13.140221+0000","last_peered":"2024-04-24T23:08:13.140221+0000","last_clean":"2024-04-24T23:08:13.140221+0000","last_became_active":"2024-04-24T23:00:16.466134+0000","last_became_peered":"2024-04-24T23:00:16.466134+0000","last_unstale":"2024-04-24T23:08:13.140221+0000","last_undegraded":"2024-04-24T23:08:13.140221+0000","last_fullsized":"2024-04-24T23:08:13.140221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'354","last_scrub_stamp":"2024-04-24T23:08:13.140043+0000","last_deep_scrub":"27'354","last_deep_scrub_stamp":"2024-04-24T23:08:13.140043+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.140043+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:11.426240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'352","reported_seq":387,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:25.910578+0000","last_change":"2024-04-24T23:08:25.910625+0000","last_active":"2024-04-24T23:08:25.910578+0000","last_peered":"2024-04-24T23:08:25.910578+0000","last_clean":"2024-04-24T23:08:25.910578+0000","last_became_active":"2024-04-24T23:00:16.465659+0000","last_became_peered":"2024-04-24T23:00:16.465659+0000","last_unstale":"2024-04-24T23:08:25.910578+0000","last_undegraded":"2024-04-24T23:08:25.910578+0000","last_fullsized":"2024-04-24T23:08:25.910578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'352","last_scrub_stamp":"2024-04-24T23:08:25.910485+0000","last_deep_scrub":"27'352","last_deep_scrub_stamp":"2024-04-24T23:08:25.910485+0000","last_clean_scrub_stamp":"2024-04-24T23:08:25.910485+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:52:36.173758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'319","reported_seq":355,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:24.153448+0000","last_change":"2024-04-24T23:08:24.153506+0000","last_active":"2024-04-24T23:08:24.153448+0000","last_peered":"2024-04-24T23:08:24.153448+0000","last_clean":"2024-04-24T23:08:24.153448+0000","last_became_active":"2024-04-24T23:00:16.474181+0000","last_became_peered":"2024-04-24T23:00:16.474181+0000","last_unstale":"2024-04-24T23:08:24.153448+0000","last_undegraded":"2024-04-24T23:08:24.153448+0000","last_fullsized":"2024-04-24T23:08:24.153448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'319","last_scrub_stamp":"2024-04-24T23:08:24.153257+0000","last_deep_scrub":"27'319","last_deep_scrub_stamp":"2024-04-24T23:08:24.153257+0000","last_clean_scrub_stamp":"2024-04-24T23:08:24.153257+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:01:37.566741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'298","reported_seq":334,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.936684+0000","last_change":"2024-04-24T23:08:14.936741+0000","last_active":"2024-04-24T23:08:14.936684+0000","last_peered":"2024-04-24T23:08:14.936684+0000","last_clean":"2024-04-24T23:08:14.936684+0000","last_became_active":"2024-04-24T23:00:16.457641+0000","last_became_peered":"2024-04-24T23:00:16.457641+0000","last_unstale":"2024-04-24T23:08:14.936684+0000","last_undegraded":"2024-04-24T23:08:14.936684+0000","last_fullsized":"2024-04-24T23:08:14.936684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'298","last_scrub_stamp":"2024-04-24T23:08:14.936514+0000","last_deep_scrub":"27'298","last_deep_scrub_stamp":"2024-04-24T23:08:14.936514+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.936514+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:34:14.959001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'302","reported_seq":338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:17.920624+0000","last_change":"2024-04-24T23:08:17.920684+0000","last_active":"2024-04-24T23:08:17.920624+0000","last_peered":"2024-04-24T23:08:17.920624+0000","last_clean":"2024-04-24T23:08:17.920624+0000","last_became_active":"2024-04-24T23:00:16.469614+0000","last_became_peered":"2024-04-24T23:00:16.469614+0000","last_unstale":"2024-04-24T23:08:17.920624+0000","last_undegraded":"2024-04-24T23:08:17.920624+0000","last_fullsized":"2024-04-24T23:08:17.920624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'302","last_scrub_stamp":"2024-04-24T23:08:17.920419+0000","last_deep_scrub":"27'302","last_deep_scrub_stamp":"2024-04-24T23:08:17.920419+0000","last_clean_scrub_stamp":"2024-04-24T23:08:17.920419+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:05.391416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'376","reported_seq":411,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:09.354746+0000","last_change":"2024-04-24T23:08:09.354768+0000","last_active":"2024-04-24T23:08:09.354746+0000","last_peered":"2024-04-24T23:08:09.354746+0000","last_clean":"2024-04-24T23:08:09.354746+0000","last_became_active":"2024-04-24T23:00:16.450561+0000","last_became_peered":"2024-04-24T23:00:16.450561+0000","last_unstale":"2024-04-24T23:08:09.354746+0000","last_undegraded":"2024-04-24T23:08:09.354746+0000","last_fullsized":"2024-04-24T23:08:09.354746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'376","last_scrub_stamp":"2024-04-24T23:08:09.354666+0000","last_deep_scrub":"27'376","last_deep_scrub_stamp":"2024-04-24T23:08:09.354666+0000","last_clean_scrub_stamp":"2024-04-24T23:08:09.354666+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:18:36.531927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'354","reported_seq":390,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.158239+0000","last_change":"2024-04-24T23:08:13.158295+0000","last_active":"2024-04-24T23:08:13.158239+0000","last_peered":"2024-04-24T23:08:13.158239+0000","last_clean":"2024-04-24T23:08:13.158239+0000","last_became_active":"2024-04-24T23:00:16.452345+0000","last_became_peered":"2024-04-24T23:00:16.452345+0000","last_unstale":"2024-04-24T23:08:13.158239+0000","last_undegraded":"2024-04-24T23:08:13.158239+0000","last_fullsized":"2024-04-24T23:08:13.158239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'354","last_scrub_stamp":"2024-04-24T23:08:13.158074+0000","last_deep_scrub":"27'354","last_deep_scrub_stamp":"2024-04-24T23:08:13.158074+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.158074+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:39:13.779815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'336","reported_seq":371,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:24.914831+0000","last_change":"2024-04-24T23:08:24.914869+0000","last_active":"2024-04-24T23:08:24.914831+0000","last_peered":"2024-04-24T23:08:24.914831+0000","last_clean":"2024-04-24T23:08:24.914831+0000","last_became_active":"2024-04-24T23:00:16.458402+0000","last_became_peered":"2024-04-24T23:00:16.458402+0000","last_unstale":"2024-04-24T23:08:24.914831+0000","last_undegraded":"2024-04-24T23:08:24.914831+0000","last_fullsized":"2024-04-24T23:08:24.914831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'336","last_scrub_stamp":"2024-04-24T23:08:24.914732+0000","last_deep_scrub":"27'336","last_deep_scrub_stamp":"2024-04-24T23:08:24.914732+0000","last_clean_scrub_stamp":"2024-04-24T23:08:24.914732+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:43:02.904005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'306","reported_seq":342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:09.168551+0000","last_change":"2024-04-24T23:08:09.168669+0000","last_active":"2024-04-24T23:08:09.168551+0000","last_peered":"2024-04-24T23:08:09.168551+0000","last_clean":"2024-04-24T23:08:09.168551+0000","last_became_active":"2024-04-24T23:00:16.453065+0000","last_became_peered":"2024-04-24T23:00:16.453065+0000","last_unstale":"2024-04-24T23:08:09.168551+0000","last_undegraded":"2024-04-24T23:08:09.168551+0000","last_fullsized":"2024-04-24T23:08:09.168551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'306","last_scrub_stamp":"2024-04-24T23:08:09.168341+0000","last_deep_scrub":"27'306","last_deep_scrub_stamp":"2024-04-24T23:08:09.168341+0000","last_clean_scrub_stamp":"2024-04-24T23:08:09.168341+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:36:09.369184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'329","reported_seq":370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.597539+0000","last_change":"2024-04-24T23:08:14.597601+0000","last_active":"2024-04-24T23:08:14.597539+0000","last_peered":"2024-04-24T23:08:14.597539+0000","last_clean":"2024-04-24T23:08:14.597539+0000","last_became_active":"2024-04-24T23:00:57.865894+0000","last_became_peered":"2024-04-24T23:00:57.865894+0000","last_unstale":"2024-04-24T23:08:14.597539+0000","last_undegraded":"2024-04-24T23:08:14.597539+0000","last_fullsized":"2024-04-24T23:08:14.597539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'329","last_scrub_stamp":"2024-04-24T23:08:14.597331+0000","last_deep_scrub":"27'329","last_deep_scrub_stamp":"2024-04-24T23:08:14.597331+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.597331+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:33.745282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'309","reported_seq":345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:15.520247+0000","last_change":"2024-04-24T23:08:15.520348+0000","last_active":"2024-04-24T23:08:15.520247+0000","last_peered":"2024-04-24T23:08:15.520247+0000","last_clean":"2024-04-24T23:08:15.520247+0000","last_became_active":"2024-04-24T23:00:16.477982+0000","last_became_peered":"2024-04-24T23:00:16.477982+0000","last_unstale":"2024-04-24T23:08:15.520247+0000","last_undegraded":"2024-04-24T23:08:15.520247+0000","last_fullsized":"2024-04-24T23:08:15.520247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'309","last_scrub_stamp":"2024-04-24T23:08:15.520061+0000","last_deep_scrub":"27'309","last_deep_scrub_stamp":"2024-04-24T23:08:15.520061+0000","last_clean_scrub_stamp":"2024-04-24T23:08:15.520061+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:50:47.695514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'353","reported_seq":389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:07.012983+0000","last_change":"2024-04-24T23:08:07.013005+0000","last_active":"2024-04-24T23:08:07.012983+0000","last_peered":"2024-04-24T23:08:07.012983+0000","last_clean":"2024-04-24T23:08:07.012983+0000","last_became_active":"2024-04-24T23:00:16.446583+0000","last_became_peered":"2024-04-24T23:00:16.446583+0000","last_unstale":"2024-04-24T23:08:07.012983+0000","last_undegraded":"2024-04-24T23:08:07.012983+0000","last_fullsized":"2024-04-24T23:08:07.012983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'353","last_scrub_stamp":"2024-04-24T23:08:07.012914+0000","last_deep_scrub":"27'353","last_deep_scrub_stamp":"2024-04-24T23:08:07.012914+0000","last_clean_scrub_stamp":"2024-04-24T23:08:07.012914+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:49:46.599567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'307","reported_seq":342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:26.931215+0000","last_change":"2024-04-24T23:08:26.931326+0000","last_active":"2024-04-24T23:08:26.931215+0000","last_peered":"2024-04-24T23:08:26.931215+0000","last_clean":"2024-04-24T23:08:26.931215+0000","last_became_active":"2024-04-24T23:00:16.483079+0000","last_became_peered":"2024-04-24T23:00:16.483079+0000","last_unstale":"2024-04-24T23:08:26.931215+0000","last_undegraded":"2024-04-24T23:08:26.931215+0000","last_fullsized":"2024-04-24T23:08:26.931215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'307","last_scrub_stamp":"2024-04-24T23:08:26.930934+0000","last_deep_scrub":"27'307","last_deep_scrub_stamp":"2024-04-24T23:08:26.930934+0000","last_clean_scrub_stamp":"2024-04-24T23:08:26.930934+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:15:38.084388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'303","reported_seq":339,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.163999+0000","last_change":"2024-04-24T23:08:14.164061+0000","last_active":"2024-04-24T23:08:14.163999+0000","last_peered":"2024-04-24T23:08:14.163999+0000","last_clean":"2024-04-24T23:08:14.163999+0000","last_became_active":"2024-04-24T23:00:16.466076+0000","last_became_peered":"2024-04-24T23:00:16.466076+0000","last_unstale":"2024-04-24T23:08:14.163999+0000","last_undegraded":"2024-04-24T23:08:14.163999+0000","last_fullsized":"2024-04-24T23:08:14.163999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'303","last_scrub_stamp":"2024-04-24T23:08:14.163820+0000","last_deep_scrub":"27'303","last_deep_scrub_stamp":"2024-04-24T23:08:14.163820+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.163820+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:33.311771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'324","reported_seq":359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.812802+0000","last_change":"2024-04-24T23:08:10.812871+0000","last_active":"2024-04-24T23:08:10.812802+0000","last_peered":"2024-04-24T23:08:10.812802+0000","last_clean":"2024-04-24T23:08:10.812802+0000","last_became_active":"2024-04-24T23:00:16.453949+0000","last_became_peered":"2024-04-24T23:00:16.453949+0000","last_unstale":"2024-04-24T23:08:10.812802+0000","last_undegraded":"2024-04-24T23:08:10.812802+0000","last_fullsized":"2024-04-24T23:08:10.812802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'324","last_scrub_stamp":"2024-04-24T23:08:10.812620+0000","last_deep_scrub":"27'324","last_deep_scrub_stamp":"2024-04-24T23:08:10.812620+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.812620+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:48.718519+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'334","reported_seq":369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:07.850824+0000","last_change":"2024-04-24T23:08:07.850872+0000","last_active":"2024-04-24T23:08:07.850824+0000","last_peered":"2024-04-24T23:08:07.850824+0000","last_clean":"2024-04-24T23:08:07.850824+0000","last_became_active":"2024-04-24T23:00:16.445253+0000","last_became_peered":"2024-04-24T23:00:16.445253+0000","last_unstale":"2024-04-24T23:08:07.850824+0000","last_undegraded":"2024-04-24T23:08:07.850824+0000","last_fullsized":"2024-04-24T23:08:07.850824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'334","last_scrub_stamp":"2024-04-24T23:08:07.850716+0000","last_deep_scrub":"27'334","last_deep_scrub_stamp":"2024-04-24T23:08:07.850716+0000","last_clean_scrub_stamp":"2024-04-24T23:08:07.850716+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:50:57.678621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'307","reported_seq":343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.188324+0000","last_change":"2024-04-24T23:08:11.188440+0000","last_active":"2024-04-24T23:08:11.188324+0000","last_peered":"2024-04-24T23:08:11.188324+0000","last_clean":"2024-04-24T23:08:11.188324+0000","last_became_active":"2024-04-24T23:00:16.454953+0000","last_became_peered":"2024-04-24T23:00:16.454953+0000","last_unstale":"2024-04-24T23:08:11.188324+0000","last_undegraded":"2024-04-24T23:08:11.188324+0000","last_fullsized":"2024-04-24T23:08:11.188324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'307","last_scrub_stamp":"2024-04-24T23:08:11.188053+0000","last_deep_scrub":"27'307","last_deep_scrub_stamp":"2024-04-24T23:08:11.188053+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.188053+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:56.463567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'318","reported_seq":354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:16.945354+0000","last_change":"2024-04-24T23:08:16.945425+0000","last_active":"2024-04-24T23:08:16.945354+0000","last_peered":"2024-04-24T23:08:16.945354+0000","last_clean":"2024-04-24T23:08:16.945354+0000","last_became_active":"2024-04-24T23:00:16.467630+0000","last_became_peered":"2024-04-24T23:00:16.467630+0000","last_unstale":"2024-04-24T23:08:16.945354+0000","last_undegraded":"2024-04-24T23:08:16.945354+0000","last_fullsized":"2024-04-24T23:08:16.945354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'318","last_scrub_stamp":"2024-04-24T23:08:16.945155+0000","last_deep_scrub":"27'318","last_deep_scrub_stamp":"2024-04-24T23:08:16.945155+0000","last_clean_scrub_stamp":"2024-04-24T23:08:16.945155+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:25.075736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'309","reported_seq":345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.974126+0000","last_change":"2024-04-24T23:08:13.974189+0000","last_active":"2024-04-24T23:08:13.974126+0000","last_peered":"2024-04-24T23:08:13.974126+0000","last_clean":"2024-04-24T23:08:13.974126+0000","last_became_active":"2024-04-24T23:00:16.455114+0000","last_became_peered":"2024-04-24T23:00:16.455114+0000","last_unstale":"2024-04-24T23:08:13.974126+0000","last_undegraded":"2024-04-24T23:08:13.974126+0000","last_fullsized":"2024-04-24T23:08:13.974126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'309","last_scrub_stamp":"2024-04-24T23:08:13.973955+0000","last_deep_scrub":"27'309","last_deep_scrub_stamp":"2024-04-24T23:08:13.973955+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.973955+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:09.776200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'287","reported_seq":323,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:18.887102+0000","last_change":"2024-04-24T23:08:18.887138+0000","last_active":"2024-04-24T23:08:18.887102+0000","last_peered":"2024-04-24T23:08:18.887102+0000","last_clean":"2024-04-24T23:08:18.887102+0000","last_became_active":"2024-04-24T23:00:16.450466+0000","last_became_peered":"2024-04-24T23:00:16.450466+0000","last_unstale":"2024-04-24T23:08:18.887102+0000","last_undegraded":"2024-04-24T23:08:18.887102+0000","last_fullsized":"2024-04-24T23:08:18.887102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'287","last_scrub_stamp":"2024-04-24T23:08:18.887008+0000","last_deep_scrub":"27'287","last_deep_scrub_stamp":"2024-04-24T23:08:18.887008+0000","last_clean_scrub_stamp":"2024-04-24T23:08:18.887008+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:11:22.527527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'307","reported_seq":343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:17.909464+0000","last_change":"2024-04-24T23:08:17.909503+0000","last_active":"2024-04-24T23:08:17.909464+0000","last_peered":"2024-04-24T23:08:17.909464+0000","last_clean":"2024-04-24T23:08:17.909464+0000","last_became_active":"2024-04-24T23:00:16.450279+0000","last_became_peered":"2024-04-24T23:00:16.450279+0000","last_unstale":"2024-04-24T23:08:17.909464+0000","last_undegraded":"2024-04-24T23:08:17.909464+0000","last_fullsized":"2024-04-24T23:08:17.909464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'307","last_scrub_stamp":"2024-04-24T23:08:17.909370+0000","last_deep_scrub":"27'307","last_deep_scrub_stamp":"2024-04-24T23:08:17.909370+0000","last_clean_scrub_stamp":"2024-04-24T23:08:17.909370+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:12.035676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'298","reported_seq":334,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:15.982861+0000","last_change":"2024-04-24T23:08:15.983004+0000","last_active":"2024-04-24T23:08:15.982861+0000","last_peered":"2024-04-24T23:08:15.982861+0000","last_clean":"2024-04-24T23:08:15.982861+0000","last_became_active":"2024-04-24T23:00:16.446317+0000","last_became_peered":"2024-04-24T23:00:16.446317+0000","last_unstale":"2024-04-24T23:08:15.982861+0000","last_undegraded":"2024-04-24T23:08:15.982861+0000","last_fullsized":"2024-04-24T23:08:15.982861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'298","last_scrub_stamp":"2024-04-24T23:08:15.982614+0000","last_deep_scrub":"27'298","last_deep_scrub_stamp":"2024-04-24T23:08:15.982614+0000","last_clean_scrub_stamp":"2024-04-24T23:08:15.982614+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:03:10.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'337","reported_seq":373,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:09.679656+0000","last_change":"2024-04-24T23:08:09.679700+0000","last_active":"2024-04-24T23:08:09.679656+0000","last_peered":"2024-04-24T23:08:09.679656+0000","last_clean":"2024-04-24T23:08:09.679656+0000","last_became_active":"2024-04-24T23:00:16.445839+0000","last_became_peered":"2024-04-24T23:00:16.445839+0000","last_unstale":"2024-04-24T23:08:09.679656+0000","last_undegraded":"2024-04-24T23:08:09.679656+0000","last_fullsized":"2024-04-24T23:08:09.679656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'337","last_scrub_stamp":"2024-04-24T23:08:09.679548+0000","last_deep_scrub":"27'337","last_deep_scrub_stamp":"2024-04-24T23:08:09.679548+0000","last_clean_scrub_stamp":"2024-04-24T23:08:09.679548+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:45.603686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'273","reported_seq":309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:19.175763+0000","last_change":"2024-04-24T23:08:19.175824+0000","last_active":"2024-04-24T23:08:19.175763+0000","last_peered":"2024-04-24T23:08:19.175763+0000","last_clean":"2024-04-24T23:08:19.175763+0000","last_became_active":"2024-04-24T23:00:16.450293+0000","last_became_peered":"2024-04-24T23:00:16.450293+0000","last_unstale":"2024-04-24T23:08:19.175763+0000","last_undegraded":"2024-04-24T23:08:19.175763+0000","last_fullsized":"2024-04-24T23:08:19.175763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'273","last_scrub_stamp":"2024-04-24T23:08:19.175581+0000","last_deep_scrub":"27'273","last_deep_scrub_stamp":"2024-04-24T23:08:19.175581+0000","last_clean_scrub_stamp":"2024-04-24T23:08:19.175581+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:35.163562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'314","reported_seq":350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:22.947082+0000","last_change":"2024-04-24T23:08:22.947140+0000","last_active":"2024-04-24T23:08:22.947082+0000","last_peered":"2024-04-24T23:08:22.947082+0000","last_clean":"2024-04-24T23:08:22.947082+0000","last_became_active":"2024-04-24T23:00:16.481897+0000","last_became_peered":"2024-04-24T23:00:16.481897+0000","last_unstale":"2024-04-24T23:08:22.947082+0000","last_undegraded":"2024-04-24T23:08:22.947082+0000","last_fullsized":"2024-04-24T23:08:22.947082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'314","last_scrub_stamp":"2024-04-24T23:08:22.946895+0000","last_deep_scrub":"27'314","last_deep_scrub_stamp":"2024-04-24T23:08:22.946895+0000","last_clean_scrub_stamp":"2024-04-24T23:08:22.946895+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:19:43.889022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'318","reported_seq":353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.444436+0000","last_change":"2024-04-24T23:08:14.444471+0000","last_active":"2024-04-24T23:08:14.444436+0000","last_peered":"2024-04-24T23:08:14.444436+0000","last_clean":"2024-04-24T23:08:14.444436+0000","last_became_active":"2024-04-24T23:00:16.481832+0000","last_became_peered":"2024-04-24T23:00:16.481832+0000","last_unstale":"2024-04-24T23:08:14.444436+0000","last_undegraded":"2024-04-24T23:08:14.444436+0000","last_fullsized":"2024-04-24T23:08:14.444436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'318","last_scrub_stamp":"2024-04-24T23:08:14.444344+0000","last_deep_scrub":"27'318","last_deep_scrub_stamp":"2024-04-24T23:08:14.444344+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.444344+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:22.574925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'323","reported_seq":359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:20.901574+0000","last_change":"2024-04-24T23:08:20.901644+0000","last_active":"2024-04-24T23:08:20.901574+0000","last_peered":"2024-04-24T23:08:20.901574+0000","last_clean":"2024-04-24T23:08:20.901574+0000","last_became_active":"2024-04-24T23:00:16.465749+0000","last_became_peered":"2024-04-24T23:00:16.465749+0000","last_unstale":"2024-04-24T23:08:20.901574+0000","last_undegraded":"2024-04-24T23:08:20.901574+0000","last_fullsized":"2024-04-24T23:08:20.901574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'323","last_scrub_stamp":"2024-04-24T23:08:20.901387+0000","last_deep_scrub":"27'323","last_deep_scrub_stamp":"2024-04-24T23:08:20.901387+0000","last_clean_scrub_stamp":"2024-04-24T23:08:20.901387+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:21.791587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'308","reported_seq":344,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.399007+0000","last_change":"2024-04-24T23:08:13.399007+0000","last_active":"2024-04-24T23:08:13.399007+0000","last_peered":"2024-04-24T23:08:13.399007+0000","last_clean":"2024-04-24T23:08:13.399007+0000","last_became_active":"2024-04-24T23:00:16.481381+0000","last_became_peered":"2024-04-24T23:00:16.481381+0000","last_unstale":"2024-04-24T23:08:13.399007+0000","last_undegraded":"2024-04-24T23:08:13.399007+0000","last_fullsized":"2024-04-24T23:08:13.399007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'308","last_scrub_stamp":"2024-04-24T23:08:13.398866+0000","last_deep_scrub":"27'308","last_deep_scrub_stamp":"2024-04-24T23:08:13.398866+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.398866+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:26.157764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'305","reported_seq":341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.157143+0000","last_change":"2024-04-24T23:08:12.157257+0000","last_active":"2024-04-24T23:08:12.157143+0000","last_peered":"2024-04-24T23:08:12.157143+0000","last_clean":"2024-04-24T23:08:12.157143+0000","last_became_active":"2024-04-24T23:00:16.461267+0000","last_became_peered":"2024-04-24T23:00:16.461267+0000","last_unstale":"2024-04-24T23:08:12.157143+0000","last_undegraded":"2024-04-24T23:08:12.157143+0000","last_fullsized":"2024-04-24T23:08:12.157143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'305","last_scrub_stamp":"2024-04-24T23:08:12.156895+0000","last_deep_scrub":"27'305","last_deep_scrub_stamp":"2024-04-24T23:08:12.156895+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.156895+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:40:16.285506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'326","reported_seq":362,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.140034+0000","last_change":"2024-04-24T23:08:10.140109+0000","last_active":"2024-04-24T23:08:10.140034+0000","last_peered":"2024-04-24T23:08:10.140034+0000","last_clean":"2024-04-24T23:08:10.140034+0000","last_became_active":"2024-04-24T23:00:16.459445+0000","last_became_peered":"2024-04-24T23:00:16.459445+0000","last_unstale":"2024-04-24T23:08:10.140034+0000","last_undegraded":"2024-04-24T23:08:10.140034+0000","last_fullsized":"2024-04-24T23:08:10.140034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'326","last_scrub_stamp":"2024-04-24T23:08:10.139849+0000","last_deep_scrub":"27'326","last_deep_scrub_stamp":"2024-04-24T23:08:10.139849+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.139849+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:40:40.178030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'310","reported_seq":346,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:16.955253+0000","last_change":"2024-04-24T23:08:16.955290+0000","last_active":"2024-04-24T23:08:16.955253+0000","last_peered":"2024-04-24T23:08:16.955253+0000","last_clean":"2024-04-24T23:08:16.955253+0000","last_became_active":"2024-04-24T23:00:16.450061+0000","last_became_peered":"2024-04-24T23:00:16.450061+0000","last_unstale":"2024-04-24T23:08:16.955253+0000","last_undegraded":"2024-04-24T23:08:16.955253+0000","last_fullsized":"2024-04-24T23:08:16.955253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'310","last_scrub_stamp":"2024-04-24T23:08:16.955156+0000","last_deep_scrub":"27'310","last_deep_scrub_stamp":"2024-04-24T23:08:16.955156+0000","last_clean_scrub_stamp":"2024-04-24T23:08:16.955156+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:54.861056+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40344,"num_write_kb":220872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32314,"ondisk_log_size":32314,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15318,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20401,"ondisk_log_size":20401,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":156152903,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":1142,"num_read_kb":1796,"num_write":15519,"num_write_kb":443889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5463,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87670784,"data_stored":312305806,"data_compressed":57745618,"data_compressed_allocated":71630848,"data_compressed_original":296329216,"omap_allocated":0,"internal_metadata":0},"log_size":13466,"ondisk_log_size":13466,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509543,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116732,"kb_used_data":9204,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94255108,"statfs":{"total":96636764160,"available":96517230592,"internally_reserved":0,"allocated":9424896,"data_stored":30817518,"data_compressed":5693383,"data_compressed_allocated":7151616,"data_compressed_original":28721152,"omap_allocated":1590,"internal_metadata":110098890},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509543,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112928,"kb_used_data":9624,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94258912,"statfs":{"total":96636764160,"available":96521125888,"internally_reserved":0,"allocated":9854976,"data_stored":37485867,"data_compressed":6753749,"data_compressed_allocated":8212480,"data_compressed_original":36028416,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509544,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133964,"kb_used_data":12612,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94237876,"statfs":{"total":96636764160,"available":96499585024,"internally_reserved":0,"allocated":12914688,"data_stored":46253360,"data_compressed":8519580,"data_compressed_allocated":10514432,"data_compressed_original":44023808,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509544,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89148,"kb_used_data":3828,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94282692,"statfs":{"total":96636764160,"available":96545476608,"internally_reserved":0,"allocated":3919872,"data_stored":12699018,"data_compressed":2449723,"data_compressed_allocated":3092480,"data_compressed_original":12046336,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509544,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113264,"kb_used_data":9896,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94258576,"statfs":{"total":96636764160,"available":96520781824,"internally_reserved":0,"allocated":10133504,"data_stored":34260304,"data_compressed":6393594,"data_compressed_allocated":7995392,"data_compressed_original":32296960,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509543,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131964,"kb_used_data":16180,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94239876,"statfs":{"total":96636764160,"available":96501633024,"internally_reserved":0,"allocated":16568320,"data_stored":58456099,"data_compressed":10542411,"data_compressed_allocated":13033472,"data_compressed_original":55099392,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542248,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91380,"kb_used_data":10220,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94280460,"statfs":{"total":96636764160,"available":96543191040,"internally_reserved":0,"allocated":10465280,"data_stored":37864170,"data_compressed":6877701,"data_compressed_allocated":8454144,"data_compressed_original":36020224,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574952,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119692,"kb_used_data":16388,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94252148,"statfs":{"total":96636764160,"available":96514199552,"internally_reserved":0,"allocated":16781312,"data_stored":56573678,"data_compressed":10582231,"data_compressed_allocated":13266944,"data_compressed_original":53239808,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16285696,"data_stored":58340665,"data_compressed":10542411,"data_compressed_allocated":13033472,"data_compressed_original":55099392,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9785344,"data_stored":33554502,"data_compressed":6360217,"data_compressed_allocated":7950336,"data_compressed_original":31723520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3637248,"data_stored":12583584,"data_compressed":2449723,"data_compressed_allocated":3092480,"data_compressed_original":12046336,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":46137926,"data_compressed":8519580,"data_compressed_allocated":10514432,"data_compressed_original":44023808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9572352,"data_stored":37370433,"data_compressed":6753749,"data_compressed_allocated":8212480,"data_compressed_original":36028416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16433152,"data_stored":55867876,"data_compressed":10548854,"data_compressed_allocated":13221888,"data_compressed_original":52666368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10182656,"data_stored":37748736,"data_compressed":6877701,"data_compressed_allocated":8454144,"data_compressed_original":36020224,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9142272,"data_stored":30702084,"data_compressed":5693383,"data_compressed_allocated":7151616,"data_compressed_original":28721152,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:08:30.396 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:30.396 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:30.396 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:30.397 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:30.397 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:30.397 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:30.397 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-24T23:00:19.456282+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=0, tm_sec=19, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=23, tm_min=8, tm_sec=4, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T23:08:30.398 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T23:08:50.398 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T23:08:50.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.510+0000 7f217ef04640 1 Processor -- start 2024-04-24T23:08:50.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.510+0000 7f217ef04640 1 -- start start 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f217ef04640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2178070d30 0x7f2178072c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f217ef04640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2178141bd0 0x7f21780b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f217ef04640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21780b5ab0 con 0x7f21780b6090 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f217ef04640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2178073170 con 0x7f2178141bd0 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f217ef04640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2178071110 con 0x7f2178070d30 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f2177fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f21780b6090 0x7f21781414c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36634/0 (socket says 172.21.15.43:36634) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f2177fff640 1 -- 172.21.15.43:0/2109544088 learned_addr learned my addr 172.21.15.43:0/2109544088 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f217cca0640 1 --2- 172.21.15.43:0/2109544088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2178070d30 0x7f2178072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f217d4a1640 1 --2- 172.21.15.43:0/2109544088 >> v2:172.21.15.162:3300/0 conn(0x7f2178141bd0 0x7f21780b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 -- 172.21.15.43:0/2109544088 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2105176580 0 0) 0x7f216c001120 con 0x7f21780b6090 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 -- 172.21.15.43:0/2109544088 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2160003530 con 0x7f21780b6090 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 -- 172.21.15.43:0/2109544088 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2763264751 0 0) 0x7f2160003530 con 0x7f21780b6090 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 -- 172.21.15.43:0/2109544088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2178070d30 msgr2=0x7f2178072c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 --2- 172.21.15.43:0/2109544088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2178070d30 0x7f2178072c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 -- 172.21.15.43:0/2109544088 >> v2:172.21.15.162:3300/0 conn(0x7f2178141bd0 msgr2=0x7f21780b64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:50.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 --2- 172.21.15.43:0/2109544088 >> v2:172.21.15.162:3300/0 conn(0x7f2178141bd0 0x7f21780b64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 -- 172.21.15.43:0/2109544088 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21780b4fd0 con 0x7f21780b6090 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 -- 172.21.15.43:0/2109544088 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f216c001850 con 0x7f21780b6090 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 -- 172.21.15.43:0/2109544088 >> v1:172.21.15.43:6789/0 conn(0x7f21780b6090 legacy=0x7f21781414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 --2- 172.21.15.43:0/2109544088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21600039c0 0x7f2160003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 --2- 172.21.15.43:0/2109544088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2160004810 0x7f2160004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 --2- 172.21.15.43:0/2109544088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2178070d30 0x7f21600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 -- 172.21.15.43:0/2109544088 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2178073170 con 0x7f21600039c0 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 -- 172.21.15.43:0/2109544088 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2178071110 con 0x7f2160004810 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f21777fe640 1 -- 172.21.15.43:0/2109544088 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f216000b9d0 con 0x7f2178070d30 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f217cca0640 1 --2- 172.21.15.43:0/2109544088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21600039c0 0x7f2160003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f217cca0640 1 -- 172.21.15.43:0/2109544088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2178070d30 msgr2=0x7f21600051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:50.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f217cca0640 1 --2- 172.21.15.43:0/2109544088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2178070d30 0x7f21600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f217cca0640 1 -- 172.21.15.43:0/2109544088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2160004810 msgr2=0x7f2160004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f217cca0640 1 --2- 172.21.15.43:0/2109544088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2160004810 0x7f2160004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f217cca0640 1 -- 172.21.15.43:0/2109544088 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2160003530 con 0x7f21600039c0 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.514+0000 7f217cca0640 1 --2- 172.21.15.43:0/2109544088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21600039c0 0x7f2160003de0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2168009ac0 tx=0x7f216801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9eeaa16400c3bb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f21777fe640 1 -- 172.21.15.43:0/2109544088 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168009690 con 0x7f21600039c0 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f21777fe640 1 -- 172.21.15.43:0/2109544088 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21680b0400 con 0x7f21600039c0 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f21777fe640 1 -- 172.21.15.43:0/2109544088 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21680b07d0 con 0x7f21600039c0 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 -- 172.21.15.43:0/2109544088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21600039c0 msgr2=0x7f2160003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:50.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 --2- 172.21.15.43:0/2109544088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21600039c0 0x7f2160003de0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2168009ac0 tx=0x7f216801ca90 comp rx=0 tx=0).stop 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217d4a1640 1 -- 172.21.15.43:0/2109544088 reap_dead start 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 -- 172.21.15.43:0/2109544088 shutdown_connections 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 -- 172.21.15.43:0/2109544088 >> 172.21.15.43:0/2109544088 conn(0x7f217806c300 msgr2=0x7f217806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 -- 172.21.15.43:0/2109544088 shutdown_connections 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 -- 172.21.15.43:0/2109544088 wait complete. 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 Processor -- start 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 -- start start 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21600039c0 0x7f21780ba570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21780b9670 0x7f21780b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21780b8800 0x7f21781e3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2178152930 con 0x7f21600039c0 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21781527b0 con 0x7f21780b9670 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2178152ab0 con 0x7f21780b8800 2024-04-24T23:08:50.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217cca0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21600039c0 0x7f21780ba570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217cca0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21600039c0 0x7f21780ba570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33818/0 (socket says 172.21.15.43:33818) 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217cca0640 1 -- 172.21.15.43:0/1689332806 learned_addr learned my addr 172.21.15.43:0/1689332806 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f2177fff640 1 --2- 172.21.15.43:0/1689332806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21780b9670 0x7f21780b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217d4a1640 1 --2- 172.21.15.43:0/1689332806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21780b8800 0x7f21781e3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217cca0640 1 -- 172.21.15.43:0/1689332806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21780b8800 msgr2=0x7f21781e3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217cca0640 1 --2- 172.21.15.43:0/1689332806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21780b8800 0x7f21781e3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217cca0640 1 -- 172.21.15.43:0/1689332806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21780b9670 msgr2=0x7f21780b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217cca0640 1 --2- 172.21.15.43:0/1689332806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21780b9670 0x7f21780b82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217cca0640 1 -- 172.21.15.43:0/1689332806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21780b3ba0 con 0x7f21600039c0 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f2177fff640 1 --2- 172.21.15.43:0/1689332806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21780b9670 0x7f21780b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217cca0640 1 --2- 172.21.15.43:0/1689332806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21600039c0 0x7f21780ba570 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2168009ac0 tx=0x7f2168019830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f21757fa640 1 -- 172.21.15.43:0/1689332806 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21680be070 con 0x7f21600039c0 2024-04-24T23:08:50.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f21757fa640 1 -- 172.21.15.43:0/1689332806 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21680b0c90 con 0x7f21600039c0 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 -- 172.21.15.43:0/1689332806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21780b9b10 con 0x7f21600039c0 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f21757fa640 1 -- 172.21.15.43:0/1689332806 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21680b9610 con 0x7f21600039c0 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.518+0000 7f217ef04640 1 -- 172.21.15.43:0/1689332806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21780b09a0 con 0x7f21600039c0 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.522+0000 7f217ef04640 1 -- 172.21.15.43:0/1689332806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f217804f580 con 0x7f21600039c0 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.522+0000 7f21757fa640 1 -- 172.21.15.43:0/1689332806 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f21680c1070 con 0x7f21600039c0 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.522+0000 7f21757fa640 1 --2- 172.21.15.43:0/1689332806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f21640678c0 0x7f2164069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.522+0000 7f21757fa640 1 -- 172.21.15.43:0/1689332806 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f216811fb10 con 0x7f21600039c0 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.522+0000 7f2177fff640 1 --2- 172.21.15.43:0/1689332806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f21640678c0 0x7f2164069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:50.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.522+0000 7f2177fff640 1 --2- 172.21.15.43:0/1689332806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f21640678c0 0x7f2164069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f216c001300 tx=0x7f216c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:50.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.526+0000 7f21757fa640 1 -- 172.21.15.43:0/1689332806 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f21680b6070 con 0x7f21600039c0 2024-04-24T23:08:50.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.682+0000 7f217ef04640 1 -- 172.21.15.43:0/1689332806 --> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f21780b7c40 con 0x7f21640678c0 2024-04-24T23:08:50.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.694+0000 7f21757fa640 1 -- 172.21.15.43:0/1689332806 <== mgr.4104 v2:172.21.15.43:6832/444634859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335734 (secure 0 0 0) 0x7f21780b7c40 con 0x7f21640678c0 2024-04-24T23:08:50.700 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:08:50.702 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.698+0000 7f217ef04640 1 -- 172.21.15.43:0/1689332806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f21640678c0 msgr2=0x7f2164069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.698+0000 7f217ef04640 1 --2- 172.21.15.43:0/1689332806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f21640678c0 0x7f2164069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f216c001300 tx=0x7f216c009040 comp rx=0 tx=0).stop 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.698+0000 7f217ef04640 1 -- 172.21.15.43:0/1689332806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21600039c0 msgr2=0x7f21780ba570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.698+0000 7f217ef04640 1 --2- 172.21.15.43:0/1689332806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21600039c0 0x7f21780ba570 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2168009ac0 tx=0x7f2168019830 comp rx=0 tx=0).stop 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.698+0000 7f217ef04640 1 -- 172.21.15.43:0/1689332806 shutdown_connections 2024-04-24T23:08:50.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.698+0000 7f217ef04640 1 --2- 172.21.15.43:0/1689332806 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f21640678c0 0x7f2164069d80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.698+0000 7f217ef04640 1 --2- 172.21.15.43:0/1689332806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21780b8800 0x7f21781e3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.698+0000 7f217ef04640 1 --2- 172.21.15.43:0/1689332806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21780b9670 0x7f21780b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.698+0000 7f217ef04640 1 --2- 172.21.15.43:0/1689332806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21600039c0 0x7f21780ba570 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.698+0000 7f217ef04640 1 -- 172.21.15.43:0/1689332806 >> 172.21.15.43:0/1689332806 conn(0x7f217806c300 msgr2=0x7f217813dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.698+0000 7f217ef04640 1 -- 172.21.15.43:0/1689332806 shutdown_connections 2024-04-24T23:08:50.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.698+0000 7f217ef04640 1 -- 172.21.15.43:0/1689332806 wait complete. 2024-04-24T23:08:50.715 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-04-24T23:08:50.402629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":156743271,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":1258,"num_read_kb":1896,"num_write":71340,"num_write_kb":667177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5463,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66300,"ondisk_log_size":66300,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":909072,"kb_used_data":87952,"kb_used_omap":12,"kb_used_meta":821043,"kb_avail":754065648,"statfs":{"total":773094113280,"available":772163223552,"internally_reserved":0,"allocated":90062848,"data_stored":314410014,"data_compressed":57812372,"data_compressed_allocated":71720960,"data_compressed_original":297476096,"omap_allocated":12752,"internal_metadata":840748592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004761"},"pg_stats":[{"pgid":"2.1f","version":"27'520","reported_seq":559,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.469888+0000","last_change":"2024-04-24T23:08:13.469888+0000","last_active":"2024-04-24T23:08:13.469888+0000","last_peered":"2024-04-24T23:08:13.469888+0000","last_clean":"2024-04-24T23:08:13.469888+0000","last_became_active":"2024-04-24T23:00:15.417152+0000","last_became_peered":"2024-04-24T23:00:15.417152+0000","last_unstale":"2024-04-24T23:08:13.469888+0000","last_undegraded":"2024-04-24T23:08:13.469888+0000","last_fullsized":"2024-04-24T23:08:13.469888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'520","last_scrub_stamp":"2024-04-24T23:08:13.469646+0000","last_deep_scrub":"27'520","last_deep_scrub_stamp":"2024-04-24T23:08:13.469646+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.469646+0000","objects_scrubbed":2,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:21.600226+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":574,"num_write_kb":8831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'314","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:18.196634+0000","last_change":"2024-04-24T23:08:18.196754+0000","last_active":"2024-04-24T23:08:18.196634+0000","last_peered":"2024-04-24T23:08:18.196634+0000","last_clean":"2024-04-24T23:08:18.196634+0000","last_became_active":"2024-04-24T23:00:16.449631+0000","last_became_peered":"2024-04-24T23:00:16.449631+0000","last_unstale":"2024-04-24T23:08:18.196634+0000","last_undegraded":"2024-04-24T23:08:18.196634+0000","last_fullsized":"2024-04-24T23:08:18.196634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'314","last_scrub_stamp":"2024-04-24T23:08:18.196421+0000","last_deep_scrub":"27'314","last_deep_scrub_stamp":"2024-04-24T23:08:18.196421+0000","last_clean_scrub_stamp":"2024-04-24T23:08:18.196421+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:08.028734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'1014","reported_seq":1044,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:19.232319+0000","last_change":"2024-04-24T23:08:19.232384+0000","last_active":"2024-04-24T23:08:19.232319+0000","last_peered":"2024-04-24T23:08:19.232319+0000","last_clean":"2024-04-24T23:08:19.232319+0000","last_became_active":"2024-04-24T23:00:20.535916+0000","last_became_peered":"2024-04-24T23:00:20.535916+0000","last_unstale":"2024-04-24T23:08:19.232319+0000","last_undegraded":"2024-04-24T23:08:19.232319+0000","last_fullsized":"2024-04-24T23:08:19.232319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1014","last_scrub_stamp":"2024-04-24T23:08:19.232136+0000","last_deep_scrub":"27'1014","last_deep_scrub_stamp":"2024-04-24T23:08:19.232136+0000","last_clean_scrub_stamp":"2024-04-24T23:08:19.232136+0000","objects_scrubbed":0,"log_size":1014,"log_dups_size":0,"ondisk_log_size":1014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:14.846165+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":7177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'581","reported_seq":620,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:15.269917+0000","last_change":"2024-04-24T23:08:15.269917+0000","last_active":"2024-04-24T23:08:15.269917+0000","last_peered":"2024-04-24T23:08:15.269917+0000","last_clean":"2024-04-24T23:08:15.269917+0000","last_became_active":"2024-04-24T23:00:15.417502+0000","last_became_peered":"2024-04-24T23:00:15.417502+0000","last_unstale":"2024-04-24T23:08:15.269917+0000","last_undegraded":"2024-04-24T23:08:15.269917+0000","last_fullsized":"2024-04-24T23:08:15.269917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'581","last_scrub_stamp":"2024-04-24T23:08:15.269653+0000","last_deep_scrub":"27'581","last_deep_scrub_stamp":"2024-04-24T23:08:15.269653+0000","last_clean_scrub_stamp":"2024-04-24T23:08:15.269653+0000","objects_scrubbed":3,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:11:50.812036+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":611,"num_write_kb":25054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'288","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:21.192741+0000","last_change":"2024-04-24T23:08:21.192741+0000","last_active":"2024-04-24T23:08:21.192741+0000","last_peered":"2024-04-24T23:08:21.192741+0000","last_clean":"2024-04-24T23:08:21.192741+0000","last_became_active":"2024-04-24T23:00:16.452212+0000","last_became_peered":"2024-04-24T23:00:16.452212+0000","last_unstale":"2024-04-24T23:08:21.192741+0000","last_undegraded":"2024-04-24T23:08:21.192741+0000","last_fullsized":"2024-04-24T23:08:21.192741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'288","last_scrub_stamp":"2024-04-24T23:08:21.192502+0000","last_deep_scrub":"27'288","last_deep_scrub_stamp":"2024-04-24T23:08:21.192502+0000","last_clean_scrub_stamp":"2024-04-24T23:08:21.192502+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:49.420012+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'1050","reported_seq":1080,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:18.453209+0000","last_change":"2024-04-24T23:08:18.453271+0000","last_active":"2024-04-24T23:08:18.453209+0000","last_peered":"2024-04-24T23:08:18.453209+0000","last_clean":"2024-04-24T23:08:18.453209+0000","last_became_active":"2024-04-24T23:00:20.517975+0000","last_became_peered":"2024-04-24T23:00:20.517975+0000","last_unstale":"2024-04-24T23:08:18.453209+0000","last_undegraded":"2024-04-24T23:08:18.453209+0000","last_fullsized":"2024-04-24T23:08:18.453209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1050","last_scrub_stamp":"2024-04-24T23:08:18.453036+0000","last_deep_scrub":"27'1050","last_deep_scrub_stamp":"2024-04-24T23:08:18.453036+0000","last_clean_scrub_stamp":"2024-04-24T23:08:18.453036+0000","objects_scrubbed":0,"log_size":1050,"log_dups_size":0,"ondisk_log_size":1050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:06:32.420849+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":6799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1038","reported_seq":1076,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.072565+0000","last_change":"2024-04-24T23:08:12.072659+0000","last_active":"2024-04-24T23:08:12.072565+0000","last_peered":"2024-04-24T23:08:12.072565+0000","last_clean":"2024-04-24T23:08:12.072565+0000","last_became_active":"2024-04-24T23:00:15.400064+0000","last_became_peered":"2024-04-24T23:00:15.400064+0000","last_unstale":"2024-04-24T23:08:12.072565+0000","last_undegraded":"2024-04-24T23:08:12.072565+0000","last_fullsized":"2024-04-24T23:08:12.072565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1038","last_scrub_stamp":"2024-04-24T23:08:12.072367+0000","last_deep_scrub":"27'1038","last_deep_scrub_stamp":"2024-04-24T23:08:12.072367+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.072367+0000","objects_scrubbed":4,"log_size":1038,"log_dups_size":0,"ondisk_log_size":1038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:59.543364+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":1068,"num_write_kb":29480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'289","reported_seq":325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.662488+0000","last_change":"2024-04-24T23:08:10.662526+0000","last_active":"2024-04-24T23:08:10.662488+0000","last_peered":"2024-04-24T23:08:10.662488+0000","last_clean":"2024-04-24T23:08:10.662488+0000","last_became_active":"2024-04-24T23:00:16.451601+0000","last_became_peered":"2024-04-24T23:00:16.451601+0000","last_unstale":"2024-04-24T23:08:10.662488+0000","last_undegraded":"2024-04-24T23:08:10.662488+0000","last_fullsized":"2024-04-24T23:08:10.662488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'289","last_scrub_stamp":"2024-04-24T23:08:10.662394+0000","last_deep_scrub":"27'289","last_deep_scrub_stamp":"2024-04-24T23:08:10.662394+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.662394+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:10.320209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'993","reported_seq":1023,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:19.450828+0000","last_change":"2024-04-24T23:08:19.450906+0000","last_active":"2024-04-24T23:08:19.450828+0000","last_peered":"2024-04-24T23:08:19.450828+0000","last_clean":"2024-04-24T23:08:19.450828+0000","last_became_active":"2024-04-24T23:00:20.518002+0000","last_became_peered":"2024-04-24T23:00:20.518002+0000","last_unstale":"2024-04-24T23:08:19.450828+0000","last_undegraded":"2024-04-24T23:08:19.450828+0000","last_fullsized":"2024-04-24T23:08:19.450828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'993","last_scrub_stamp":"2024-04-24T23:08:19.450642+0000","last_deep_scrub":"27'993","last_deep_scrub_stamp":"2024-04-24T23:08:19.450642+0000","last_clean_scrub_stamp":"2024-04-24T23:08:19.450642+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:03:13.581849+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":6590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'201","reported_seq":239,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.013839+0000","last_change":"2024-04-24T23:08:11.013907+0000","last_active":"2024-04-24T23:08:11.013839+0000","last_peered":"2024-04-24T23:08:11.013839+0000","last_clean":"2024-04-24T23:08:11.013839+0000","last_became_active":"2024-04-24T23:00:15.395766+0000","last_became_peered":"2024-04-24T23:00:15.395766+0000","last_unstale":"2024-04-24T23:08:11.013839+0000","last_undegraded":"2024-04-24T23:08:11.013839+0000","last_fullsized":"2024-04-24T23:08:11.013839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'201","last_scrub_stamp":"2024-04-24T23:08:11.013657+0000","last_deep_scrub":"27'201","last_deep_scrub_stamp":"2024-04-24T23:08:11.013657+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.013657+0000","objects_scrubbed":1,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:09.609628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":248,"num_write_kb":4421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'299","reported_seq":334,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.887566+0000","last_change":"2024-04-24T23:08:12.887633+0000","last_active":"2024-04-24T23:08:12.887566+0000","last_peered":"2024-04-24T23:08:12.887566+0000","last_clean":"2024-04-24T23:08:12.887566+0000","last_became_active":"2024-04-24T23:00:16.458237+0000","last_became_peered":"2024-04-24T23:00:16.458237+0000","last_unstale":"2024-04-24T23:08:12.887566+0000","last_undegraded":"2024-04-24T23:08:12.887566+0000","last_fullsized":"2024-04-24T23:08:12.887566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'299","last_scrub_stamp":"2024-04-24T23:08:12.887383+0000","last_deep_scrub":"27'299","last_deep_scrub_stamp":"2024-04-24T23:08:12.887383+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.887383+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:51.888099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'1016","reported_seq":1053,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:21.488062+0000","last_change":"2024-04-24T23:08:21.488202+0000","last_active":"2024-04-24T23:08:21.488062+0000","last_peered":"2024-04-24T23:08:21.488062+0000","last_clean":"2024-04-24T23:08:21.488062+0000","last_became_active":"2024-04-24T23:00:57.664750+0000","last_became_peered":"2024-04-24T23:00:57.664750+0000","last_unstale":"2024-04-24T23:08:21.488062+0000","last_undegraded":"2024-04-24T23:08:21.488062+0000","last_fullsized":"2024-04-24T23:08:21.488062+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1016","last_scrub_stamp":"2024-04-24T23:08:21.487856+0000","last_deep_scrub":"27'1016","last_deep_scrub_stamp":"2024-04-24T23:08:21.487856+0000","last_clean_scrub_stamp":"2024-04-24T23:08:21.487856+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:32:31.713924+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":6657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,4],"acting":[2,6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'326","reported_seq":361,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.918384+0000","last_change":"2024-04-24T23:08:13.918495+0000","last_active":"2024-04-24T23:08:13.918384+0000","last_peered":"2024-04-24T23:08:13.918384+0000","last_clean":"2024-04-24T23:08:13.918384+0000","last_became_active":"2024-04-24T23:00:16.447488+0000","last_became_peered":"2024-04-24T23:00:16.447488+0000","last_unstale":"2024-04-24T23:08:13.918384+0000","last_undegraded":"2024-04-24T23:08:13.918384+0000","last_fullsized":"2024-04-24T23:08:13.918384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'326","last_scrub_stamp":"2024-04-24T23:08:13.918186+0000","last_deep_scrub":"27'326","last_deep_scrub_stamp":"2024-04-24T23:08:13.918186+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.918186+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:14.808386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'771","reported_seq":808,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:18.953903+0000","last_change":"2024-04-24T23:08:18.953969+0000","last_active":"2024-04-24T23:08:18.953903+0000","last_peered":"2024-04-24T23:08:18.953903+0000","last_clean":"2024-04-24T23:08:18.953903+0000","last_became_active":"2024-04-24T23:00:15.408120+0000","last_became_peered":"2024-04-24T23:00:15.408120+0000","last_unstale":"2024-04-24T23:08:18.953903+0000","last_undegraded":"2024-04-24T23:08:18.953903+0000","last_fullsized":"2024-04-24T23:08:18.953903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'771","last_scrub_stamp":"2024-04-24T23:08:18.953731+0000","last_deep_scrub":"27'771","last_deep_scrub_stamp":"2024-04-24T23:08:18.953731+0000","last_clean_scrub_stamp":"2024-04-24T23:08:18.953731+0000","objects_scrubbed":2,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:22:06.217126+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":817,"num_write_kb":21262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":463,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'991","reported_seq":1021,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:30.922353+0000","last_change":"2024-04-24T23:08:30.922435+0000","last_active":"2024-04-24T23:08:30.922353+0000","last_peered":"2024-04-24T23:08:30.922353+0000","last_clean":"2024-04-24T23:08:30.922353+0000","last_became_active":"2024-04-24T23:00:20.501703+0000","last_became_peered":"2024-04-24T23:00:20.501703+0000","last_unstale":"2024-04-24T23:08:30.922353+0000","last_undegraded":"2024-04-24T23:08:30.922353+0000","last_fullsized":"2024-04-24T23:08:30.922353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'991","last_scrub_stamp":"2024-04-24T23:08:30.922182+0000","last_deep_scrub":"27'991","last_deep_scrub_stamp":"2024-04-24T23:08:30.922182+0000","last_clean_scrub_stamp":"2024-04-24T23:08:30.922182+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:34:27.612450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":7022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'337","reported_seq":373,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:15.142589+0000","last_change":"2024-04-24T23:08:15.142727+0000","last_active":"2024-04-24T23:08:15.142589+0000","last_peered":"2024-04-24T23:08:15.142589+0000","last_clean":"2024-04-24T23:08:15.142589+0000","last_became_active":"2024-04-24T23:00:16.472226+0000","last_became_peered":"2024-04-24T23:00:16.472226+0000","last_unstale":"2024-04-24T23:08:15.142589+0000","last_undegraded":"2024-04-24T23:08:15.142589+0000","last_fullsized":"2024-04-24T23:08:15.142589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'337","last_scrub_stamp":"2024-04-24T23:08:15.142365+0000","last_deep_scrub":"27'337","last_deep_scrub_stamp":"2024-04-24T23:08:15.142365+0000","last_clean_scrub_stamp":"2024-04-24T23:08:15.142365+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:47:08.556817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":260,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'311","reported_seq":349,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:09.955987+0000","last_change":"2024-04-24T23:08:09.956056+0000","last_active":"2024-04-24T23:08:09.955987+0000","last_peered":"2024-04-24T23:08:09.955987+0000","last_clean":"2024-04-24T23:08:09.955987+0000","last_became_active":"2024-04-24T23:00:15.422121+0000","last_became_peered":"2024-04-24T23:00:15.422121+0000","last_unstale":"2024-04-24T23:08:09.955987+0000","last_undegraded":"2024-04-24T23:08:09.955987+0000","last_fullsized":"2024-04-24T23:08:09.955987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'311","last_scrub_stamp":"2024-04-24T23:08:09.955819+0000","last_deep_scrub":"27'311","last_deep_scrub_stamp":"2024-04-24T23:08:09.955819+0000","last_clean_scrub_stamp":"2024-04-24T23:08:09.955819+0000","objects_scrubbed":2,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:36:53.873805+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":340,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'1105","reported_seq":1135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:23.974928+0000","last_change":"2024-04-24T23:08:23.975075+0000","last_active":"2024-04-24T23:08:23.974928+0000","last_peered":"2024-04-24T23:08:23.974928+0000","last_clean":"2024-04-24T23:08:23.974928+0000","last_became_active":"2024-04-24T23:00:20.540220+0000","last_became_peered":"2024-04-24T23:00:20.540220+0000","last_unstale":"2024-04-24T23:08:23.974928+0000","last_undegraded":"2024-04-24T23:08:23.974928+0000","last_fullsized":"2024-04-24T23:08:23.974928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1105","last_scrub_stamp":"2024-04-24T23:08:23.974637+0000","last_deep_scrub":"27'1105","last_deep_scrub_stamp":"2024-04-24T23:08:23.974637+0000","last_clean_scrub_stamp":"2024-04-24T23:08:23.974637+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:37.278445+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1391,"num_write_kb":7499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'337","reported_seq":373,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:19.452134+0000","last_change":"2024-04-24T23:08:19.452197+0000","last_active":"2024-04-24T23:08:19.452134+0000","last_peered":"2024-04-24T23:08:19.452134+0000","last_clean":"2024-04-24T23:08:19.452134+0000","last_became_active":"2024-04-24T23:00:16.487476+0000","last_became_peered":"2024-04-24T23:00:16.487476+0000","last_unstale":"2024-04-24T23:08:19.452134+0000","last_undegraded":"2024-04-24T23:08:19.452134+0000","last_fullsized":"2024-04-24T23:08:19.452134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'337","last_scrub_stamp":"2024-04-24T23:08:19.451961+0000","last_deep_scrub":"27'337","last_deep_scrub_stamp":"2024-04-24T23:08:19.451961+0000","last_clean_scrub_stamp":"2024-04-24T23:08:19.451961+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:45:54.430316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'216","reported_seq":254,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:09.519072+0000","last_change":"2024-04-24T23:08:09.519142+0000","last_active":"2024-04-24T23:08:09.519072+0000","last_peered":"2024-04-24T23:08:09.519072+0000","last_clean":"2024-04-24T23:08:09.519072+0000","last_became_active":"2024-04-24T23:00:15.396600+0000","last_became_peered":"2024-04-24T23:00:15.396600+0000","last_unstale":"2024-04-24T23:08:09.519072+0000","last_undegraded":"2024-04-24T23:08:09.519072+0000","last_fullsized":"2024-04-24T23:08:09.519072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'216","last_scrub_stamp":"2024-04-24T23:08:09.518903+0000","last_deep_scrub":"27'216","last_deep_scrub_stamp":"2024-04-24T23:08:09.518903+0000","last_clean_scrub_stamp":"2024-04-24T23:08:09.518903+0000","objects_scrubbed":2,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:35.404257+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":224,"num_write_kb":12479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'989","reported_seq":1019,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:18.211471+0000","last_change":"2024-04-24T23:08:18.211535+0000","last_active":"2024-04-24T23:08:18.211471+0000","last_peered":"2024-04-24T23:08:18.211471+0000","last_clean":"2024-04-24T23:08:18.211471+0000","last_became_active":"2024-04-24T23:00:20.510602+0000","last_became_peered":"2024-04-24T23:00:20.510602+0000","last_unstale":"2024-04-24T23:08:18.211471+0000","last_undegraded":"2024-04-24T23:08:18.211471+0000","last_fullsized":"2024-04-24T23:08:18.211471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'989","last_scrub_stamp":"2024-04-24T23:08:18.211277+0000","last_deep_scrub":"27'989","last_deep_scrub_stamp":"2024-04-24T23:08:18.211277+0000","last_clean_scrub_stamp":"2024-04-24T23:08:18.211277+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:35:24.462113+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1239,"num_write_kb":6767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'349","reported_seq":384,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:27.887965+0000","last_change":"2024-04-24T23:08:27.888092+0000","last_active":"2024-04-24T23:08:27.887965+0000","last_peered":"2024-04-24T23:08:27.887965+0000","last_clean":"2024-04-24T23:08:27.887965+0000","last_became_active":"2024-04-24T23:00:16.483092+0000","last_became_peered":"2024-04-24T23:00:16.483092+0000","last_unstale":"2024-04-24T23:08:27.887965+0000","last_undegraded":"2024-04-24T23:08:27.887965+0000","last_fullsized":"2024-04-24T23:08:27.887965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'349","last_scrub_stamp":"2024-04-24T23:08:27.887774+0000","last_deep_scrub":"27'349","last_deep_scrub_stamp":"2024-04-24T23:08:27.887774+0000","last_clean_scrub_stamp":"2024-04-24T23:08:27.887774+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:43:45.431719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'273","reported_seq":311,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:08.975443+0000","last_change":"2024-04-24T23:08:08.975472+0000","last_active":"2024-04-24T23:08:08.975443+0000","last_peered":"2024-04-24T23:08:08.975443+0000","last_clean":"2024-04-24T23:08:08.975443+0000","last_became_active":"2024-04-24T23:00:15.397638+0000","last_became_peered":"2024-04-24T23:00:15.397638+0000","last_unstale":"2024-04-24T23:08:08.975443+0000","last_undegraded":"2024-04-24T23:08:08.975443+0000","last_fullsized":"2024-04-24T23:08:08.975443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'273","last_scrub_stamp":"2024-04-24T23:08:08.975354+0000","last_deep_scrub":"27'273","last_deep_scrub_stamp":"2024-04-24T23:08:08.975354+0000","last_clean_scrub_stamp":"2024-04-24T23:08:08.975354+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:34:08.997841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":320,"num_write_kb":4474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'934","reported_seq":964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:17.465654+0000","last_change":"2024-04-24T23:08:17.465725+0000","last_active":"2024-04-24T23:08:17.465654+0000","last_peered":"2024-04-24T23:08:17.465654+0000","last_clean":"2024-04-24T23:08:17.465654+0000","last_became_active":"2024-04-24T23:00:20.505532+0000","last_became_peered":"2024-04-24T23:00:20.505532+0000","last_unstale":"2024-04-24T23:08:17.465654+0000","last_undegraded":"2024-04-24T23:08:17.465654+0000","last_fullsized":"2024-04-24T23:08:17.465654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'934","last_scrub_stamp":"2024-04-24T23:08:17.465462+0000","last_deep_scrub":"27'934","last_deep_scrub_stamp":"2024-04-24T23:08:17.465462+0000","last_clean_scrub_stamp":"2024-04-24T23:08:17.465462+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:49.298730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":6588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'333","reported_seq":369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:18.448046+0000","last_change":"2024-04-24T23:08:18.448106+0000","last_active":"2024-04-24T23:08:18.448046+0000","last_peered":"2024-04-24T23:08:18.448046+0000","last_clean":"2024-04-24T23:08:18.448046+0000","last_became_active":"2024-04-24T23:00:16.483585+0000","last_became_peered":"2024-04-24T23:00:16.483585+0000","last_unstale":"2024-04-24T23:08:18.448046+0000","last_undegraded":"2024-04-24T23:08:18.448046+0000","last_fullsized":"2024-04-24T23:08:18.448046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'333","last_scrub_stamp":"2024-04-24T23:08:18.447878+0000","last_deep_scrub":"27'333","last_deep_scrub_stamp":"2024-04-24T23:08:18.447878+0000","last_clean_scrub_stamp":"2024-04-24T23:08:18.447878+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:55.140037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'157","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:22.921959+0000","last_change":"2024-04-24T23:08:22.922019+0000","last_active":"2024-04-24T23:08:22.921959+0000","last_peered":"2024-04-24T23:08:22.921959+0000","last_clean":"2024-04-24T23:08:22.921959+0000","last_became_active":"2024-04-24T23:00:15.420839+0000","last_became_peered":"2024-04-24T23:00:15.420839+0000","last_unstale":"2024-04-24T23:08:22.921959+0000","last_undegraded":"2024-04-24T23:08:22.921959+0000","last_fullsized":"2024-04-24T23:08:22.921959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'157","last_scrub_stamp":"2024-04-24T23:08:22.921792+0000","last_deep_scrub":"27'157","last_deep_scrub_stamp":"2024-04-24T23:08:22.921792+0000","last_clean_scrub_stamp":"2024-04-24T23:08:22.921792+0000","objects_scrubbed":1,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:17.755231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":209,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'1029","reported_seq":1060,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:20.443252+0000","last_change":"2024-04-24T23:08:20.443252+0000","last_active":"2024-04-24T23:08:20.443252+0000","last_peered":"2024-04-24T23:08:20.443252+0000","last_clean":"2024-04-24T23:08:20.443252+0000","last_became_active":"2024-04-24T23:00:20.518470+0000","last_became_peered":"2024-04-24T23:00:20.518470+0000","last_unstale":"2024-04-24T23:08:20.443252+0000","last_undegraded":"2024-04-24T23:08:20.443252+0000","last_fullsized":"2024-04-24T23:08:20.443252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1029","last_scrub_stamp":"2024-04-24T23:08:20.442862+0000","last_deep_scrub":"27'1029","last_deep_scrub_stamp":"2024-04-24T23:08:20.442862+0000","last_clean_scrub_stamp":"2024-04-24T23:08:20.442862+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:45:55.421217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":7455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'291","reported_seq":327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.511751+0000","last_change":"2024-04-24T23:08:14.511810+0000","last_active":"2024-04-24T23:08:14.511751+0000","last_peered":"2024-04-24T23:08:14.511751+0000","last_clean":"2024-04-24T23:08:14.511751+0000","last_became_active":"2024-04-24T23:00:16.463565+0000","last_became_peered":"2024-04-24T23:00:16.463565+0000","last_unstale":"2024-04-24T23:08:14.511751+0000","last_undegraded":"2024-04-24T23:08:14.511751+0000","last_fullsized":"2024-04-24T23:08:14.511751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'291","last_scrub_stamp":"2024-04-24T23:08:14.511571+0000","last_deep_scrub":"27'291","last_deep_scrub_stamp":"2024-04-24T23:08:14.511571+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.511571+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:45:40.361967+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'449","reported_seq":487,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.550265+0000","last_change":"2024-04-24T23:08:10.550392+0000","last_active":"2024-04-24T23:08:10.550265+0000","last_peered":"2024-04-24T23:08:10.550265+0000","last_clean":"2024-04-24T23:08:10.550265+0000","last_became_active":"2024-04-24T23:00:15.397465+0000","last_became_peered":"2024-04-24T23:00:15.397465+0000","last_unstale":"2024-04-24T23:08:10.550265+0000","last_undegraded":"2024-04-24T23:08:10.550265+0000","last_fullsized":"2024-04-24T23:08:10.550265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'449","last_scrub_stamp":"2024-04-24T23:08:10.549979+0000","last_deep_scrub":"27'449","last_deep_scrub_stamp":"2024-04-24T23:08:10.549979+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.549979+0000","objects_scrubbed":3,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:06.352225+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8008961,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1199,"num_write_kb":9322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'1049","reported_seq":1080,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:21.502777+0000","last_change":"2024-04-24T23:08:21.502777+0000","last_active":"2024-04-24T23:08:21.502777+0000","last_peered":"2024-04-24T23:08:21.502777+0000","last_clean":"2024-04-24T23:08:21.502777+0000","last_became_active":"2024-04-24T23:00:20.515972+0000","last_became_peered":"2024-04-24T23:00:20.515972+0000","last_unstale":"2024-04-24T23:08:21.502777+0000","last_undegraded":"2024-04-24T23:08:21.502777+0000","last_fullsized":"2024-04-24T23:08:21.502777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1049","last_scrub_stamp":"2024-04-24T23:08:21.502531+0000","last_deep_scrub":"27'1049","last_deep_scrub_stamp":"2024-04-24T23:08:21.502531+0000","last_clean_scrub_stamp":"2024-04-24T23:08:21.502531+0000","objects_scrubbed":0,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:11:25.143051+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1319,"num_write_kb":7165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'300","reported_seq":337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:18.884767+0000","last_change":"2024-04-24T23:08:18.884767+0000","last_active":"2024-04-24T23:08:18.884767+0000","last_peered":"2024-04-24T23:08:18.884767+0000","last_clean":"2024-04-24T23:08:18.884767+0000","last_became_active":"2024-04-24T23:00:16.480021+0000","last_became_peered":"2024-04-24T23:00:16.480021+0000","last_unstale":"2024-04-24T23:08:18.884767+0000","last_undegraded":"2024-04-24T23:08:18.884767+0000","last_fullsized":"2024-04-24T23:08:18.884767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'300","last_scrub_stamp":"2024-04-24T23:08:18.884512+0000","last_deep_scrub":"27'300","last_deep_scrub_stamp":"2024-04-24T23:08:18.884512+0000","last_clean_scrub_stamp":"2024-04-24T23:08:18.884512+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:42.279627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'298","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:15.952306+0000","last_change":"2024-04-24T23:08:15.952306+0000","last_active":"2024-04-24T23:08:15.952306+0000","last_peered":"2024-04-24T23:08:15.952306+0000","last_clean":"2024-04-24T23:08:15.952306+0000","last_became_active":"2024-04-24T23:00:15.428016+0000","last_became_peered":"2024-04-24T23:00:15.428016+0000","last_unstale":"2024-04-24T23:08:15.952306+0000","last_undegraded":"2024-04-24T23:08:15.952306+0000","last_fullsized":"2024-04-24T23:08:15.952306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'298","last_scrub_stamp":"2024-04-24T23:08:15.952178+0000","last_deep_scrub":"27'298","last_deep_scrub_stamp":"2024-04-24T23:08:15.952178+0000","last_clean_scrub_stamp":"2024-04-24T23:08:15.952178+0000","objects_scrubbed":1,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:01:04.618191+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":311,"num_write_kb":16738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'1004","reported_seq":1035,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:20.819357+0000","last_change":"2024-04-24T23:08:20.819357+0000","last_active":"2024-04-24T23:08:20.819357+0000","last_peered":"2024-04-24T23:08:20.819357+0000","last_clean":"2024-04-24T23:08:20.819357+0000","last_became_active":"2024-04-24T23:00:20.524747+0000","last_became_peered":"2024-04-24T23:00:20.524747+0000","last_unstale":"2024-04-24T23:08:20.819357+0000","last_undegraded":"2024-04-24T23:08:20.819357+0000","last_fullsized":"2024-04-24T23:08:20.819357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1004","last_scrub_stamp":"2024-04-24T23:08:20.818961+0000","last_deep_scrub":"27'1004","last_deep_scrub_stamp":"2024-04-24T23:08:20.818961+0000","last_clean_scrub_stamp":"2024-04-24T23:08:20.818961+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:06:34.786774+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1252,"num_write_kb":7166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'319","reported_seq":355,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.347179+0000","last_change":"2024-04-24T23:08:11.347179+0000","last_active":"2024-04-24T23:08:11.347179+0000","last_peered":"2024-04-24T23:08:11.347179+0000","last_clean":"2024-04-24T23:08:11.347179+0000","last_became_active":"2024-04-24T23:00:16.456268+0000","last_became_peered":"2024-04-24T23:00:16.456268+0000","last_unstale":"2024-04-24T23:08:11.347179+0000","last_undegraded":"2024-04-24T23:08:11.347179+0000","last_fullsized":"2024-04-24T23:08:11.347179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'319","last_scrub_stamp":"2024-04-24T23:08:11.346931+0000","last_deep_scrub":"27'319","last_deep_scrub_stamp":"2024-04-24T23:08:11.346931+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.346931+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:07.149177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'112","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:17.191541+0000","last_change":"2024-04-24T23:08:17.191541+0000","last_active":"2024-04-24T23:08:17.191541+0000","last_peered":"2024-04-24T23:08:17.191541+0000","last_clean":"2024-04-24T23:08:17.191541+0000","last_became_active":"2024-04-24T23:00:15.428374+0000","last_became_peered":"2024-04-24T23:00:15.428374+0000","last_unstale":"2024-04-24T23:08:17.191541+0000","last_undegraded":"2024-04-24T23:08:17.191541+0000","last_fullsized":"2024-04-24T23:08:17.191541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'112","last_scrub_stamp":"2024-04-24T23:08:17.191207+0000","last_deep_scrub":"27'112","last_deep_scrub_stamp":"2024-04-24T23:08:17.191207+0000","last_clean_scrub_stamp":"2024-04-24T23:08:17.191207+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:38:36.242139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":161,"num_write_kb":4386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'1030","reported_seq":1061,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:21.804758+0000","last_change":"2024-04-24T23:08:21.804758+0000","last_active":"2024-04-24T23:08:21.804758+0000","last_peered":"2024-04-24T23:08:21.804758+0000","last_clean":"2024-04-24T23:08:21.804758+0000","last_became_active":"2024-04-24T23:00:20.534430+0000","last_became_peered":"2024-04-24T23:00:20.534430+0000","last_unstale":"2024-04-24T23:08:21.804758+0000","last_undegraded":"2024-04-24T23:08:21.804758+0000","last_fullsized":"2024-04-24T23:08:21.804758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1030","last_scrub_stamp":"2024-04-24T23:08:21.804330+0000","last_deep_scrub":"27'1030","last_deep_scrub_stamp":"2024-04-24T23:08:21.804330+0000","last_clean_scrub_stamp":"2024-04-24T23:08:21.804330+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:03:15.935537+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1288,"num_write_kb":6636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'316","reported_seq":353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.999490+0000","last_change":"2024-04-24T23:08:14.999490+0000","last_active":"2024-04-24T23:08:14.999490+0000","last_peered":"2024-04-24T23:08:14.999490+0000","last_clean":"2024-04-24T23:08:14.999490+0000","last_became_active":"2024-04-24T23:00:16.443620+0000","last_became_peered":"2024-04-24T23:00:16.443620+0000","last_unstale":"2024-04-24T23:08:14.999490+0000","last_undegraded":"2024-04-24T23:08:14.999490+0000","last_fullsized":"2024-04-24T23:08:14.999490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'316","last_scrub_stamp":"2024-04-24T23:08:14.999121+0000","last_deep_scrub":"27'316","last_deep_scrub_stamp":"2024-04-24T23:08:14.999121+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.999121+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:06:28.966934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'514","reported_seq":552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:23.975003+0000","last_change":"2024-04-24T23:08:23.975003+0000","last_active":"2024-04-24T23:08:23.975003+0000","last_peered":"2024-04-24T23:08:23.975003+0000","last_clean":"2024-04-24T23:08:23.975003+0000","last_became_active":"2024-04-24T23:00:15.422167+0000","last_became_peered":"2024-04-24T23:00:15.422167+0000","last_unstale":"2024-04-24T23:08:23.975003+0000","last_undegraded":"2024-04-24T23:08:23.975003+0000","last_fullsized":"2024-04-24T23:08:23.975003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'514","last_scrub_stamp":"2024-04-24T23:08:23.974850+0000","last_deep_scrub":"27'514","last_deep_scrub_stamp":"2024-04-24T23:08:23.974850+0000","last_clean_scrub_stamp":"2024-04-24T23:08:23.974850+0000","objects_scrubbed":4,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:17:43.024322+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":552,"num_write_kb":25017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'943","reported_seq":974,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:23.746267+0000","last_change":"2024-04-24T23:08:23.746267+0000","last_active":"2024-04-24T23:08:23.746267+0000","last_peered":"2024-04-24T23:08:23.746267+0000","last_clean":"2024-04-24T23:08:23.746267+0000","last_became_active":"2024-04-24T23:00:20.524719+0000","last_became_peered":"2024-04-24T23:00:20.524719+0000","last_unstale":"2024-04-24T23:08:23.746267+0000","last_undegraded":"2024-04-24T23:08:23.746267+0000","last_fullsized":"2024-04-24T23:08:23.746267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'943","last_scrub_stamp":"2024-04-24T23:08:23.745978+0000","last_deep_scrub":"27'943","last_deep_scrub_stamp":"2024-04-24T23:08:23.745978+0000","last_clean_scrub_stamp":"2024-04-24T23:08:23.745978+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:17.872284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'320","reported_seq":357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:23.184237+0000","last_change":"2024-04-24T23:08:23.184352+0000","last_active":"2024-04-24T23:08:23.184237+0000","last_peered":"2024-04-24T23:08:23.184237+0000","last_clean":"2024-04-24T23:08:23.184237+0000","last_became_active":"2024-04-24T23:00:16.469390+0000","last_became_peered":"2024-04-24T23:00:16.469390+0000","last_unstale":"2024-04-24T23:08:23.184237+0000","last_undegraded":"2024-04-24T23:08:23.184237+0000","last_fullsized":"2024-04-24T23:08:23.184237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'320","last_scrub_stamp":"2024-04-24T23:08:23.183969+0000","last_deep_scrub":"27'320","last_deep_scrub_stamp":"2024-04-24T23:08:23.183969+0000","last_clean_scrub_stamp":"2024-04-24T23:08:23.183969+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:26:43.290354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'889","reported_seq":1597,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.153596+0000","last_change":"2024-04-24T23:08:10.153596+0000","last_active":"2024-04-24T23:08:10.153596+0000","last_peered":"2024-04-24T23:08:10.153596+0000","last_clean":"2024-04-24T23:08:10.153596+0000","last_became_active":"2024-04-24T23:00:15.422275+0000","last_became_peered":"2024-04-24T23:00:15.422275+0000","last_unstale":"2024-04-24T23:08:10.153596+0000","last_undegraded":"2024-04-24T23:08:10.153596+0000","last_fullsized":"2024-04-24T23:08:10.153596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'889","last_scrub_stamp":"2024-04-24T23:08:10.153217+0000","last_deep_scrub":"27'889","last_deep_scrub_stamp":"2024-04-24T23:08:10.153217+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.153217+0000","objects_scrubbed":3,"log_size":889,"log_dups_size":0,"ondisk_log_size":889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:16.478294+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9730440,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":691,"num_read_kb":1796,"num_write":947,"num_write_kb":14533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'1020","reported_seq":1050,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:19.867687+0000","last_change":"2024-04-24T23:08:19.867749+0000","last_active":"2024-04-24T23:08:19.867687+0000","last_peered":"2024-04-24T23:08:19.867687+0000","last_clean":"2024-04-24T23:08:19.867687+0000","last_became_active":"2024-04-24T23:00:20.534325+0000","last_became_peered":"2024-04-24T23:00:20.534325+0000","last_unstale":"2024-04-24T23:08:19.867687+0000","last_undegraded":"2024-04-24T23:08:19.867687+0000","last_fullsized":"2024-04-24T23:08:19.867687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1020","last_scrub_stamp":"2024-04-24T23:08:19.867480+0000","last_deep_scrub":"27'1020","last_deep_scrub_stamp":"2024-04-24T23:08:19.867480+0000","last_clean_scrub_stamp":"2024-04-24T23:08:19.867480+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:51.700749+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1281,"num_write_kb":6595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'303","reported_seq":340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.999385+0000","last_change":"2024-04-24T23:08:12.999385+0000","last_active":"2024-04-24T23:08:12.999385+0000","last_peered":"2024-04-24T23:08:12.999385+0000","last_clean":"2024-04-24T23:08:12.999385+0000","last_became_active":"2024-04-24T23:00:16.451226+0000","last_became_peered":"2024-04-24T23:00:16.451226+0000","last_unstale":"2024-04-24T23:08:12.999385+0000","last_undegraded":"2024-04-24T23:08:12.999385+0000","last_fullsized":"2024-04-24T23:08:12.999385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'303","last_scrub_stamp":"2024-04-24T23:08:12.999150+0000","last_deep_scrub":"27'303","last_deep_scrub_stamp":"2024-04-24T23:08:12.999150+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.999150+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:38.884504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'648","reported_seq":686,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:20.977974+0000","last_change":"2024-04-24T23:08:20.978110+0000","last_active":"2024-04-24T23:08:20.977974+0000","last_peered":"2024-04-24T23:08:20.977974+0000","last_clean":"2024-04-24T23:08:20.977974+0000","last_became_active":"2024-04-24T23:00:15.414224+0000","last_became_peered":"2024-04-24T23:00:15.414224+0000","last_unstale":"2024-04-24T23:08:20.977974+0000","last_undegraded":"2024-04-24T23:08:20.977974+0000","last_fullsized":"2024-04-24T23:08:20.977974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'648","last_scrub_stamp":"2024-04-24T23:08:20.977755+0000","last_deep_scrub":"27'648","last_deep_scrub_stamp":"2024-04-24T23:08:20.977755+0000","last_clean_scrub_stamp":"2024-04-24T23:08:20.977755+0000","objects_scrubbed":1,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:50.744420+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":698,"num_write_kb":16967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'1115","reported_seq":1145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:28.086984+0000","last_change":"2024-04-24T23:08:28.087047+0000","last_active":"2024-04-24T23:08:28.086984+0000","last_peered":"2024-04-24T23:08:28.086984+0000","last_clean":"2024-04-24T23:08:28.086984+0000","last_became_active":"2024-04-24T23:00:20.530682+0000","last_became_peered":"2024-04-24T23:00:20.530682+0000","last_unstale":"2024-04-24T23:08:28.086984+0000","last_undegraded":"2024-04-24T23:08:28.086984+0000","last_fullsized":"2024-04-24T23:08:28.086984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1115","last_scrub_stamp":"2024-04-24T23:08:28.086808+0000","last_deep_scrub":"27'1115","last_deep_scrub_stamp":"2024-04-24T23:08:28.086808+0000","last_clean_scrub_stamp":"2024-04-24T23:08:28.086808+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:33:00.481756+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1380,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'294","reported_seq":331,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:08.502132+0000","last_change":"2024-04-24T23:08:08.502132+0000","last_active":"2024-04-24T23:08:08.502132+0000","last_peered":"2024-04-24T23:08:08.502132+0000","last_clean":"2024-04-24T23:08:08.502132+0000","last_became_active":"2024-04-24T23:00:16.477192+0000","last_became_peered":"2024-04-24T23:00:16.477192+0000","last_unstale":"2024-04-24T23:08:08.502132+0000","last_undegraded":"2024-04-24T23:08:08.502132+0000","last_fullsized":"2024-04-24T23:08:08.502132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'294","last_scrub_stamp":"2024-04-24T23:08:08.501865+0000","last_deep_scrub":"27'294","last_deep_scrub_stamp":"2024-04-24T23:08:08.501865+0000","last_clean_scrub_stamp":"2024-04-24T23:08:08.501865+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:18:35.679126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'171","reported_seq":209,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:17.967473+0000","last_change":"2024-04-24T23:08:17.967473+0000","last_active":"2024-04-24T23:08:17.967473+0000","last_peered":"2024-04-24T23:08:17.967473+0000","last_clean":"2024-04-24T23:08:17.967473+0000","last_became_active":"2024-04-24T23:00:15.407609+0000","last_became_peered":"2024-04-24T23:00:15.407609+0000","last_unstale":"2024-04-24T23:08:17.967473+0000","last_undegraded":"2024-04-24T23:08:17.967473+0000","last_fullsized":"2024-04-24T23:08:17.967473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'171","last_scrub_stamp":"2024-04-24T23:08:17.967241+0000","last_deep_scrub":"27'171","last_deep_scrub_stamp":"2024-04-24T23:08:17.967241+0000","last_clean_scrub_stamp":"2024-04-24T23:08:17.967241+0000","objects_scrubbed":1,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:57.121465+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":211,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:07.683387+0000","last_change":"2024-04-24T23:08:07.683435+0000","last_active":"2024-04-24T23:08:07.683387+0000","last_peered":"2024-04-24T23:08:07.683387+0000","last_clean":"2024-04-24T23:08:07.683387+0000","last_became_active":"2024-04-24T23:00:03.344074+0000","last_became_peered":"2024-04-24T23:00:03.344074+0000","last_unstale":"2024-04-24T23:08:07.683387+0000","last_undegraded":"2024-04-24T23:08:07.683387+0000","last_fullsized":"2024-04-24T23:08:07.683387+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-24T23:08:07.683292+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-24T23:08:07.683292+0000","last_clean_scrub_stamp":"2024-04-24T23:08:07.683292+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:08.895892+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'994","reported_seq":1018,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:29.126015+0000","last_change":"2024-04-24T23:08:29.126079+0000","last_active":"2024-04-24T23:08:29.126015+0000","last_peered":"2024-04-24T23:08:29.126015+0000","last_clean":"2024-04-24T23:08:29.126015+0000","last_became_active":"2024-04-24T23:00:57.864235+0000","last_became_peered":"2024-04-24T23:00:57.864235+0000","last_unstale":"2024-04-24T23:08:29.126015+0000","last_undegraded":"2024-04-24T23:08:29.126015+0000","last_fullsized":"2024-04-24T23:08:29.126015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'994","last_scrub_stamp":"2024-04-24T23:08:29.125830+0000","last_deep_scrub":"27'994","last_deep_scrub_stamp":"2024-04-24T23:08:29.125830+0000","last_clean_scrub_stamp":"2024-04-24T23:08:29.125830+0000","objects_scrubbed":0,"log_size":994,"log_dups_size":0,"ondisk_log_size":994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:17:30.213990+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1231,"num_write_kb":6895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2,0],"acting":[5,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"27'317","reported_seq":352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.846986+0000","last_change":"2024-04-24T23:08:11.847106+0000","last_active":"2024-04-24T23:08:11.846986+0000","last_peered":"2024-04-24T23:08:11.846986+0000","last_clean":"2024-04-24T23:08:11.846986+0000","last_became_active":"2024-04-24T23:00:16.448187+0000","last_became_peered":"2024-04-24T23:00:16.448187+0000","last_unstale":"2024-04-24T23:08:11.846986+0000","last_undegraded":"2024-04-24T23:08:11.846986+0000","last_fullsized":"2024-04-24T23:08:11.846986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'317","last_scrub_stamp":"2024-04-24T23:08:11.846805+0000","last_deep_scrub":"27'317","last_deep_scrub_stamp":"2024-04-24T23:08:11.846805+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.846805+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:05.973112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'233","reported_seq":271,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.977001+0000","last_change":"2024-04-24T23:08:10.977070+0000","last_active":"2024-04-24T23:08:10.977001+0000","last_peered":"2024-04-24T23:08:10.977001+0000","last_clean":"2024-04-24T23:08:10.977001+0000","last_became_active":"2024-04-24T23:00:15.425134+0000","last_became_peered":"2024-04-24T23:00:15.425134+0000","last_unstale":"2024-04-24T23:08:10.977001+0000","last_undegraded":"2024-04-24T23:08:10.977001+0000","last_fullsized":"2024-04-24T23:08:10.977001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'233","last_scrub_stamp":"2024-04-24T23:08:10.976841+0000","last_deep_scrub":"27'233","last_deep_scrub_stamp":"2024-04-24T23:08:10.976841+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.976841+0000","objects_scrubbed":2,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:15:09.256485+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":252,"num_write_kb":12509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'1044","reported_seq":1074,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:15.480728+0000","last_change":"2024-04-24T23:08:15.480770+0000","last_active":"2024-04-24T23:08:15.480728+0000","last_peered":"2024-04-24T23:08:15.480728+0000","last_clean":"2024-04-24T23:08:15.480728+0000","last_became_active":"2024-04-24T23:00:20.500158+0000","last_became_peered":"2024-04-24T23:00:20.500158+0000","last_unstale":"2024-04-24T23:08:15.480728+0000","last_undegraded":"2024-04-24T23:08:15.480728+0000","last_fullsized":"2024-04-24T23:08:15.480728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1044","last_scrub_stamp":"2024-04-24T23:08:15.480624+0000","last_deep_scrub":"27'1044","last_deep_scrub_stamp":"2024-04-24T23:08:15.480624+0000","last_clean_scrub_stamp":"2024-04-24T23:08:15.480624+0000","objects_scrubbed":0,"log_size":1044,"log_dups_size":0,"ondisk_log_size":1044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:02.951621+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1291,"num_write_kb":7061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'349","reported_seq":385,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:21.943857+0000","last_change":"2024-04-24T23:08:21.943894+0000","last_active":"2024-04-24T23:08:21.943857+0000","last_peered":"2024-04-24T23:08:21.943857+0000","last_clean":"2024-04-24T23:08:21.943857+0000","last_became_active":"2024-04-24T23:00:16.471497+0000","last_became_peered":"2024-04-24T23:00:16.471497+0000","last_unstale":"2024-04-24T23:08:21.943857+0000","last_undegraded":"2024-04-24T23:08:21.943857+0000","last_fullsized":"2024-04-24T23:08:21.943857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'349","last_scrub_stamp":"2024-04-24T23:08:21.943759+0000","last_deep_scrub":"27'349","last_deep_scrub_stamp":"2024-04-24T23:08:21.943759+0000","last_clean_scrub_stamp":"2024-04-24T23:08:21.943759+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:47.271878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'527","reported_seq":565,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.239958+0000","last_change":"2024-04-24T23:08:14.240041+0000","last_active":"2024-04-24T23:08:14.239958+0000","last_peered":"2024-04-24T23:08:14.239958+0000","last_clean":"2024-04-24T23:08:14.239958+0000","last_became_active":"2024-04-24T23:00:15.405636+0000","last_became_peered":"2024-04-24T23:00:15.405636+0000","last_unstale":"2024-04-24T23:08:14.239958+0000","last_undegraded":"2024-04-24T23:08:14.239958+0000","last_fullsized":"2024-04-24T23:08:14.239958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'527","last_scrub_stamp":"2024-04-24T23:08:14.239784+0000","last_deep_scrub":"27'527","last_deep_scrub_stamp":"2024-04-24T23:08:14.239784+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.239784+0000","objects_scrubbed":4,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:18.373546+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":558,"num_write_kb":25209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'1010","reported_seq":1040,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:25.140436+0000","last_change":"2024-04-24T23:08:25.140500+0000","last_active":"2024-04-24T23:08:25.140436+0000","last_peered":"2024-04-24T23:08:25.140436+0000","last_clean":"2024-04-24T23:08:25.140436+0000","last_became_active":"2024-04-24T23:00:20.500153+0000","last_became_peered":"2024-04-24T23:00:20.500153+0000","last_unstale":"2024-04-24T23:08:25.140436+0000","last_undegraded":"2024-04-24T23:08:25.140436+0000","last_fullsized":"2024-04-24T23:08:25.140436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1010","last_scrub_stamp":"2024-04-24T23:08:25.140238+0000","last_deep_scrub":"27'1010","last_deep_scrub_stamp":"2024-04-24T23:08:25.140238+0000","last_clean_scrub_stamp":"2024-04-24T23:08:25.140238+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:25.420788+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":6978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'294","reported_seq":330,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:07.980369+0000","last_change":"2024-04-24T23:08:07.980416+0000","last_active":"2024-04-24T23:08:07.980369+0000","last_peered":"2024-04-24T23:08:07.980369+0000","last_clean":"2024-04-24T23:08:07.980369+0000","last_became_active":"2024-04-24T23:00:16.446170+0000","last_became_peered":"2024-04-24T23:00:16.446170+0000","last_unstale":"2024-04-24T23:08:07.980369+0000","last_undegraded":"2024-04-24T23:08:07.980369+0000","last_fullsized":"2024-04-24T23:08:07.980369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'294","last_scrub_stamp":"2024-04-24T23:08:07.980274+0000","last_deep_scrub":"27'294","last_deep_scrub_stamp":"2024-04-24T23:08:07.980274+0000","last_clean_scrub_stamp":"2024-04-24T23:08:07.980274+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:03.782520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'344","reported_seq":382,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.509207+0000","last_change":"2024-04-24T23:08:12.509292+0000","last_active":"2024-04-24T23:08:12.509207+0000","last_peered":"2024-04-24T23:08:12.509207+0000","last_clean":"2024-04-24T23:08:12.509207+0000","last_became_active":"2024-04-24T23:00:15.414863+0000","last_became_peered":"2024-04-24T23:00:15.414863+0000","last_unstale":"2024-04-24T23:08:12.509207+0000","last_undegraded":"2024-04-24T23:08:12.509207+0000","last_fullsized":"2024-04-24T23:08:12.509207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'344","last_scrub_stamp":"2024-04-24T23:08:12.509034+0000","last_deep_scrub":"27'344","last_deep_scrub_stamp":"2024-04-24T23:08:12.509034+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.509034+0000","objects_scrubbed":2,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:25.267931+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":379,"num_write_kb":12861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'1068","reported_seq":1098,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:29.961117+0000","last_change":"2024-04-24T23:08:29.961179+0000","last_active":"2024-04-24T23:08:29.961117+0000","last_peered":"2024-04-24T23:08:29.961117+0000","last_clean":"2024-04-24T23:08:29.961117+0000","last_became_active":"2024-04-24T23:00:20.498802+0000","last_became_peered":"2024-04-24T23:00:20.498802+0000","last_unstale":"2024-04-24T23:08:29.961117+0000","last_undegraded":"2024-04-24T23:08:29.961117+0000","last_fullsized":"2024-04-24T23:08:29.961117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1068","last_scrub_stamp":"2024-04-24T23:08:29.960926+0000","last_deep_scrub":"27'1068","last_deep_scrub_stamp":"2024-04-24T23:08:29.960926+0000","last_clean_scrub_stamp":"2024-04-24T23:08:29.960926+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:37.564261+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":7543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'288","reported_seq":323,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:08.343704+0000","last_change":"2024-04-24T23:08:08.343745+0000","last_active":"2024-04-24T23:08:08.343704+0000","last_peered":"2024-04-24T23:08:08.343704+0000","last_clean":"2024-04-24T23:08:08.343704+0000","last_became_active":"2024-04-24T23:00:16.447838+0000","last_became_peered":"2024-04-24T23:00:16.447838+0000","last_unstale":"2024-04-24T23:08:08.343704+0000","last_undegraded":"2024-04-24T23:08:08.343704+0000","last_fullsized":"2024-04-24T23:08:08.343704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'288","last_scrub_stamp":"2024-04-24T23:08:08.343620+0000","last_deep_scrub":"27'288","last_deep_scrub_stamp":"2024-04-24T23:08:08.343620+0000","last_clean_scrub_stamp":"2024-04-24T23:08:08.343620+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:15:06.623264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'305","reported_seq":343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.986182+0000","last_change":"2024-04-24T23:08:13.986246+0000","last_active":"2024-04-24T23:08:13.986182+0000","last_peered":"2024-04-24T23:08:13.986182+0000","last_clean":"2024-04-24T23:08:13.986182+0000","last_became_active":"2024-04-24T23:00:15.420590+0000","last_became_peered":"2024-04-24T23:00:15.420590+0000","last_unstale":"2024-04-24T23:08:13.986182+0000","last_undegraded":"2024-04-24T23:08:13.986182+0000","last_fullsized":"2024-04-24T23:08:13.986182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'305","last_scrub_stamp":"2024-04-24T23:08:13.986021+0000","last_deep_scrub":"27'305","last_deep_scrub_stamp":"2024-04-24T23:08:13.986021+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.986021+0000","objects_scrubbed":1,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:45.819289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":356,"num_write_kb":8611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'1045","reported_seq":1075,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.612612+0000","last_change":"2024-04-24T23:08:13.612684+0000","last_active":"2024-04-24T23:08:13.612612+0000","last_peered":"2024-04-24T23:08:13.612612+0000","last_clean":"2024-04-24T23:08:13.612612+0000","last_became_active":"2024-04-24T23:00:20.493784+0000","last_became_peered":"2024-04-24T23:00:20.493784+0000","last_unstale":"2024-04-24T23:08:13.612612+0000","last_undegraded":"2024-04-24T23:08:13.612612+0000","last_fullsized":"2024-04-24T23:08:13.612612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1045","last_scrub_stamp":"2024-04-24T23:08:13.612397+0000","last_deep_scrub":"27'1045","last_deep_scrub_stamp":"2024-04-24T23:08:13.612397+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.612397+0000","objects_scrubbed":0,"log_size":1045,"log_dups_size":0,"ondisk_log_size":1045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:57.387089+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1330,"num_write_kb":7257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'367","reported_seq":402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:09.797678+0000","last_change":"2024-04-24T23:08:09.797718+0000","last_active":"2024-04-24T23:08:09.797678+0000","last_peered":"2024-04-24T23:08:09.797678+0000","last_clean":"2024-04-24T23:08:09.797678+0000","last_became_active":"2024-04-24T23:00:16.447742+0000","last_became_peered":"2024-04-24T23:00:16.447742+0000","last_unstale":"2024-04-24T23:08:09.797678+0000","last_undegraded":"2024-04-24T23:08:09.797678+0000","last_fullsized":"2024-04-24T23:08:09.797678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'367","last_scrub_stamp":"2024-04-24T23:08:09.797598+0000","last_deep_scrub":"27'367","last_deep_scrub_stamp":"2024-04-24T23:08:09.797598+0000","last_clean_scrub_stamp":"2024-04-24T23:08:09.797598+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:36.105701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'271","reported_seq":309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.520747+0000","last_change":"2024-04-24T23:08:11.520886+0000","last_active":"2024-04-24T23:08:11.520747+0000","last_peered":"2024-04-24T23:08:11.520747+0000","last_clean":"2024-04-24T23:08:11.520747+0000","last_became_active":"2024-04-24T23:00:15.416198+0000","last_became_peered":"2024-04-24T23:00:15.416198+0000","last_unstale":"2024-04-24T23:08:11.520747+0000","last_undegraded":"2024-04-24T23:08:11.520747+0000","last_fullsized":"2024-04-24T23:08:11.520747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'271","last_scrub_stamp":"2024-04-24T23:08:11.520546+0000","last_deep_scrub":"27'271","last_deep_scrub_stamp":"2024-04-24T23:08:11.520546+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.520546+0000","objects_scrubbed":4,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:34:11.543033+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":330,"num_write_kb":8690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'1004","reported_seq":1034,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:27.119428+0000","last_change":"2024-04-24T23:08:27.119498+0000","last_active":"2024-04-24T23:08:27.119428+0000","last_peered":"2024-04-24T23:08:27.119428+0000","last_clean":"2024-04-24T23:08:27.119428+0000","last_became_active":"2024-04-24T23:00:20.525782+0000","last_became_peered":"2024-04-24T23:00:20.525782+0000","last_unstale":"2024-04-24T23:08:27.119428+0000","last_undegraded":"2024-04-24T23:08:27.119428+0000","last_fullsized":"2024-04-24T23:08:27.119428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1004","last_scrub_stamp":"2024-04-24T23:08:27.119239+0000","last_deep_scrub":"27'1004","last_deep_scrub_stamp":"2024-04-24T23:08:27.119239+0000","last_clean_scrub_stamp":"2024-04-24T23:08:27.119239+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:08:50.020933+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":7027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'336","reported_seq":372,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.641520+0000","last_change":"2024-04-24T23:08:12.641579+0000","last_active":"2024-04-24T23:08:12.641520+0000","last_peered":"2024-04-24T23:08:12.641520+0000","last_clean":"2024-04-24T23:08:12.641520+0000","last_became_active":"2024-04-24T23:00:16.454031+0000","last_became_peered":"2024-04-24T23:00:16.454031+0000","last_unstale":"2024-04-24T23:08:12.641520+0000","last_undegraded":"2024-04-24T23:08:12.641520+0000","last_fullsized":"2024-04-24T23:08:12.641520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'336","last_scrub_stamp":"2024-04-24T23:08:12.641351+0000","last_deep_scrub":"27'336","last_deep_scrub_stamp":"2024-04-24T23:08:12.641351+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.641351+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:24.981640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'68","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.978657+0000","last_change":"2024-04-24T23:08:12.978720+0000","last_active":"2024-04-24T23:08:12.978657+0000","last_peered":"2024-04-24T23:08:12.978657+0000","last_clean":"2024-04-24T23:08:12.978657+0000","last_became_active":"2024-04-24T23:00:15.416688+0000","last_became_peered":"2024-04-24T23:00:15.416688+0000","last_unstale":"2024-04-24T23:08:12.978657+0000","last_undegraded":"2024-04-24T23:08:12.978657+0000","last_fullsized":"2024-04-24T23:08:12.978657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'68","last_scrub_stamp":"2024-04-24T23:08:12.978483+0000","last_deep_scrub":"27'68","last_deep_scrub_stamp":"2024-04-24T23:08:12.978483+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.978483+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:36.373598+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":106,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'996","reported_seq":1026,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:26.167763+0000","last_change":"2024-04-24T23:08:26.167830+0000","last_active":"2024-04-24T23:08:26.167763+0000","last_peered":"2024-04-24T23:08:26.167763+0000","last_clean":"2024-04-24T23:08:26.167763+0000","last_became_active":"2024-04-24T23:00:20.516152+0000","last_became_peered":"2024-04-24T23:00:20.516152+0000","last_unstale":"2024-04-24T23:08:26.167763+0000","last_undegraded":"2024-04-24T23:08:26.167763+0000","last_fullsized":"2024-04-24T23:08:26.167763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'996","last_scrub_stamp":"2024-04-24T23:08:26.167579+0000","last_deep_scrub":"27'996","last_deep_scrub_stamp":"2024-04-24T23:08:26.167579+0000","last_clean_scrub_stamp":"2024-04-24T23:08:26.167579+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:33:31.251861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":6136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'317","reported_seq":352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.888807+0000","last_change":"2024-04-24T23:08:14.888843+0000","last_active":"2024-04-24T23:08:14.888807+0000","last_peered":"2024-04-24T23:08:14.888807+0000","last_clean":"2024-04-24T23:08:14.888807+0000","last_became_active":"2024-04-24T23:00:16.458081+0000","last_became_peered":"2024-04-24T23:00:16.458081+0000","last_unstale":"2024-04-24T23:08:14.888807+0000","last_undegraded":"2024-04-24T23:08:14.888807+0000","last_fullsized":"2024-04-24T23:08:14.888807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'317","last_scrub_stamp":"2024-04-24T23:08:14.888712+0000","last_deep_scrub":"27'317","last_deep_scrub_stamp":"2024-04-24T23:08:14.888712+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.888712+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:40.216832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'41","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:19.955653+0000","last_change":"2024-04-24T23:08:19.955780+0000","last_active":"2024-04-24T23:08:19.955653+0000","last_peered":"2024-04-24T23:08:19.955653+0000","last_clean":"2024-04-24T23:08:19.955653+0000","last_became_active":"2024-04-24T23:00:15.412847+0000","last_became_peered":"2024-04-24T23:00:15.412847+0000","last_unstale":"2024-04-24T23:08:19.955653+0000","last_undegraded":"2024-04-24T23:08:19.955653+0000","last_fullsized":"2024-04-24T23:08:19.955653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-04-24T23:08:19.955448+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-04-24T23:08:19.955448+0000","last_clean_scrub_stamp":"2024-04-24T23:08:19.955448+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:59:48.502956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":81,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'915","reported_seq":945,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:22.778924+0000","last_change":"2024-04-24T23:08:22.778986+0000","last_active":"2024-04-24T23:08:22.778924+0000","last_peered":"2024-04-24T23:08:22.778924+0000","last_clean":"2024-04-24T23:08:22.778924+0000","last_became_active":"2024-04-24T23:00:20.529427+0000","last_became_peered":"2024-04-24T23:00:20.529427+0000","last_unstale":"2024-04-24T23:08:22.778924+0000","last_undegraded":"2024-04-24T23:08:22.778924+0000","last_fullsized":"2024-04-24T23:08:22.778924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'915","last_scrub_stamp":"2024-04-24T23:08:22.778727+0000","last_deep_scrub":"27'915","last_deep_scrub_stamp":"2024-04-24T23:08:22.778727+0000","last_clean_scrub_stamp":"2024-04-24T23:08:22.778727+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:00.684626+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":6219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'322","reported_seq":358,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:15.901419+0000","last_change":"2024-04-24T23:08:15.901486+0000","last_active":"2024-04-24T23:08:15.901419+0000","last_peered":"2024-04-24T23:08:15.901419+0000","last_clean":"2024-04-24T23:08:15.901419+0000","last_became_active":"2024-04-24T23:00:16.464653+0000","last_became_peered":"2024-04-24T23:00:16.464653+0000","last_unstale":"2024-04-24T23:08:15.901419+0000","last_undegraded":"2024-04-24T23:08:15.901419+0000","last_fullsized":"2024-04-24T23:08:15.901419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'322","last_scrub_stamp":"2024-04-24T23:08:15.901193+0000","last_deep_scrub":"27'322","last_deep_scrub_stamp":"2024-04-24T23:08:15.901193+0000","last_clean_scrub_stamp":"2024-04-24T23:08:15.901193+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:28.660091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'533","reported_seq":571,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.174722+0000","last_change":"2024-04-24T23:08:11.174802+0000","last_active":"2024-04-24T23:08:11.174722+0000","last_peered":"2024-04-24T23:08:11.174722+0000","last_clean":"2024-04-24T23:08:11.174722+0000","last_became_active":"2024-04-24T23:00:15.426641+0000","last_became_peered":"2024-04-24T23:00:15.426641+0000","last_unstale":"2024-04-24T23:08:11.174722+0000","last_undegraded":"2024-04-24T23:08:11.174722+0000","last_fullsized":"2024-04-24T23:08:11.174722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'533","last_scrub_stamp":"2024-04-24T23:08:11.174557+0000","last_deep_scrub":"27'533","last_deep_scrub_stamp":"2024-04-24T23:08:11.174557+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.174557+0000","objects_scrubbed":3,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:04:37.607367+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":566,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'952","reported_seq":982,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:31.877139+0000","last_change":"2024-04-24T23:08:31.877296+0000","last_active":"2024-04-24T23:08:31.877139+0000","last_peered":"2024-04-24T23:08:31.877139+0000","last_clean":"2024-04-24T23:08:31.877139+0000","last_became_active":"2024-04-24T23:00:20.517950+0000","last_became_peered":"2024-04-24T23:00:20.517950+0000","last_unstale":"2024-04-24T23:08:31.877139+0000","last_undegraded":"2024-04-24T23:08:31.877139+0000","last_fullsized":"2024-04-24T23:08:31.877139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'952","last_scrub_stamp":"2024-04-24T23:08:31.876903+0000","last_deep_scrub":"27'952","last_deep_scrub_stamp":"2024-04-24T23:08:31.876903+0000","last_clean_scrub_stamp":"2024-04-24T23:08:31.876903+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:15.830566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":7094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'294","reported_seq":330,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:19.879301+0000","last_change":"2024-04-24T23:08:19.879337+0000","last_active":"2024-04-24T23:08:19.879301+0000","last_peered":"2024-04-24T23:08:19.879301+0000","last_clean":"2024-04-24T23:08:19.879301+0000","last_became_active":"2024-04-24T23:00:16.456636+0000","last_became_peered":"2024-04-24T23:00:16.456636+0000","last_unstale":"2024-04-24T23:08:19.879301+0000","last_undegraded":"2024-04-24T23:08:19.879301+0000","last_fullsized":"2024-04-24T23:08:19.879301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'294","last_scrub_stamp":"2024-04-24T23:08:19.879214+0000","last_deep_scrub":"27'294","last_deep_scrub_stamp":"2024-04-24T23:08:19.879214+0000","last_clean_scrub_stamp":"2024-04-24T23:08:19.879214+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:47:58.879930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'571","reported_seq":608,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:07.410854+0000","last_change":"2024-04-24T23:08:07.410907+0000","last_active":"2024-04-24T23:08:07.410854+0000","last_peered":"2024-04-24T23:08:07.410854+0000","last_clean":"2024-04-24T23:08:07.410854+0000","last_became_active":"2024-04-24T23:00:15.427837+0000","last_became_peered":"2024-04-24T23:00:15.427837+0000","last_unstale":"2024-04-24T23:08:07.410854+0000","last_undegraded":"2024-04-24T23:08:07.410854+0000","last_fullsized":"2024-04-24T23:08:07.410854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'571","last_scrub_stamp":"2024-04-24T23:08:07.410756+0000","last_deep_scrub":"27'571","last_deep_scrub_stamp":"2024-04-24T23:08:07.410756+0000","last_clean_scrub_stamp":"2024-04-24T23:08:07.410756+0000","objects_scrubbed":4,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:36:51.328741+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":635,"num_write_kb":21119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'1015","reported_seq":1052,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:23.528641+0000","last_change":"2024-04-24T23:08:23.528704+0000","last_active":"2024-04-24T23:08:23.528641+0000","last_peered":"2024-04-24T23:08:23.528641+0000","last_clean":"2024-04-24T23:08:23.528641+0000","last_became_active":"2024-04-24T23:00:57.864156+0000","last_became_peered":"2024-04-24T23:00:57.864156+0000","last_unstale":"2024-04-24T23:08:23.528641+0000","last_undegraded":"2024-04-24T23:08:23.528641+0000","last_fullsized":"2024-04-24T23:08:23.528641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1015","last_scrub_stamp":"2024-04-24T23:08:23.528459+0000","last_deep_scrub":"27'1015","last_deep_scrub_stamp":"2024-04-24T23:08:23.528459+0000","last_clean_scrub_stamp":"2024-04-24T23:08:23.528459+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:35:12.171984+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":6923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,0],"acting":[4,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'298","reported_seq":333,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:08.844059+0000","last_change":"2024-04-24T23:08:08.844090+0000","last_active":"2024-04-24T23:08:08.844059+0000","last_peered":"2024-04-24T23:08:08.844059+0000","last_clean":"2024-04-24T23:08:08.844059+0000","last_became_active":"2024-04-24T23:00:16.453033+0000","last_became_peered":"2024-04-24T23:00:16.453033+0000","last_unstale":"2024-04-24T23:08:08.844059+0000","last_undegraded":"2024-04-24T23:08:08.844059+0000","last_fullsized":"2024-04-24T23:08:08.844059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'298","last_scrub_stamp":"2024-04-24T23:08:08.843968+0000","last_deep_scrub":"27'298","last_deep_scrub_stamp":"2024-04-24T23:08:08.843968+0000","last_clean_scrub_stamp":"2024-04-24T23:08:08.843968+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:45.536127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'669","reported_seq":707,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.157597+0000","last_change":"2024-04-24T23:08:12.157714+0000","last_active":"2024-04-24T23:08:12.157597+0000","last_peered":"2024-04-24T23:08:12.157597+0000","last_clean":"2024-04-24T23:08:12.157597+0000","last_became_active":"2024-04-24T23:00:15.430254+0000","last_became_peered":"2024-04-24T23:00:15.430254+0000","last_unstale":"2024-04-24T23:08:12.157597+0000","last_undegraded":"2024-04-24T23:08:12.157597+0000","last_fullsized":"2024-04-24T23:08:12.157597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'669","last_scrub_stamp":"2024-04-24T23:08:12.157384+0000","last_deep_scrub":"27'669","last_deep_scrub_stamp":"2024-04-24T23:08:12.157384+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.157384+0000","objects_scrubbed":3,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:20:16.460666+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":729,"num_write_kb":21519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'963","reported_seq":993,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:16.482920+0000","last_change":"2024-04-24T23:08:16.482985+0000","last_active":"2024-04-24T23:08:16.482920+0000","last_peered":"2024-04-24T23:08:16.482920+0000","last_clean":"2024-04-24T23:08:16.482920+0000","last_became_active":"2024-04-24T23:00:20.502285+0000","last_became_peered":"2024-04-24T23:00:20.502285+0000","last_unstale":"2024-04-24T23:08:16.482920+0000","last_undegraded":"2024-04-24T23:08:16.482920+0000","last_fullsized":"2024-04-24T23:08:16.482920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'963","last_scrub_stamp":"2024-04-24T23:08:16.482743+0000","last_deep_scrub":"27'963","last_deep_scrub_stamp":"2024-04-24T23:08:16.482743+0000","last_clean_scrub_stamp":"2024-04-24T23:08:16.482743+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:50:48.658196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'299","reported_seq":335,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:20.151424+0000","last_change":"2024-04-24T23:08:20.151488+0000","last_active":"2024-04-24T23:08:20.151424+0000","last_peered":"2024-04-24T23:08:20.151424+0000","last_clean":"2024-04-24T23:08:20.151424+0000","last_became_active":"2024-04-24T23:00:16.451611+0000","last_became_peered":"2024-04-24T23:00:16.451611+0000","last_unstale":"2024-04-24T23:08:20.151424+0000","last_undegraded":"2024-04-24T23:08:20.151424+0000","last_fullsized":"2024-04-24T23:08:20.151424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'299","last_scrub_stamp":"2024-04-24T23:08:20.151250+0000","last_deep_scrub":"27'299","last_deep_scrub_stamp":"2024-04-24T23:08:20.151250+0000","last_clean_scrub_stamp":"2024-04-24T23:08:20.151250+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:27.986721+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'415","reported_seq":453,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.032582+0000","last_change":"2024-04-24T23:08:10.032630+0000","last_active":"2024-04-24T23:08:10.032582+0000","last_peered":"2024-04-24T23:08:10.032582+0000","last_clean":"2024-04-24T23:08:10.032582+0000","last_became_active":"2024-04-24T23:00:15.397253+0000","last_became_peered":"2024-04-24T23:00:15.397253+0000","last_unstale":"2024-04-24T23:08:10.032582+0000","last_undegraded":"2024-04-24T23:08:10.032582+0000","last_fullsized":"2024-04-24T23:08:10.032582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'415","last_scrub_stamp":"2024-04-24T23:08:10.032464+0000","last_deep_scrub":"27'415","last_deep_scrub_stamp":"2024-04-24T23:08:10.032464+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.032464+0000","objects_scrubbed":1,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:34.670281+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":486,"num_write_kb":21108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'1063","reported_seq":1093,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:16.184506+0000","last_change":"2024-04-24T23:08:16.184569+0000","last_active":"2024-04-24T23:08:16.184506+0000","last_peered":"2024-04-24T23:08:16.184506+0000","last_clean":"2024-04-24T23:08:16.184506+0000","last_became_active":"2024-04-24T23:00:20.505504+0000","last_became_peered":"2024-04-24T23:00:20.505504+0000","last_unstale":"2024-04-24T23:08:16.184506+0000","last_undegraded":"2024-04-24T23:08:16.184506+0000","last_fullsized":"2024-04-24T23:08:16.184506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1063","last_scrub_stamp":"2024-04-24T23:08:16.184312+0000","last_deep_scrub":"27'1063","last_deep_scrub_stamp":"2024-04-24T23:08:16.184312+0000","last_clean_scrub_stamp":"2024-04-24T23:08:16.184312+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:42.069666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1319,"num_write_kb":7863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'344","reported_seq":379,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.351795+0000","last_change":"2024-04-24T23:08:10.351834+0000","last_active":"2024-04-24T23:08:10.351795+0000","last_peered":"2024-04-24T23:08:10.351795+0000","last_clean":"2024-04-24T23:08:10.351795+0000","last_became_active":"2024-04-24T23:00:16.450149+0000","last_became_peered":"2024-04-24T23:00:16.450149+0000","last_unstale":"2024-04-24T23:08:10.351795+0000","last_undegraded":"2024-04-24T23:08:10.351795+0000","last_fullsized":"2024-04-24T23:08:10.351795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'344","last_scrub_stamp":"2024-04-24T23:08:10.351699+0000","last_deep_scrub":"27'344","last_deep_scrub_stamp":"2024-04-24T23:08:10.351699+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.351699+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:36.237053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'69","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:08.690192+0000","last_change":"2024-04-24T23:08:08.690240+0000","last_active":"2024-04-24T23:08:08.690192+0000","last_peered":"2024-04-24T23:08:08.690192+0000","last_clean":"2024-04-24T23:08:08.690192+0000","last_became_active":"2024-04-24T23:00:15.427857+0000","last_became_peered":"2024-04-24T23:00:15.427857+0000","last_unstale":"2024-04-24T23:08:08.690192+0000","last_undegraded":"2024-04-24T23:08:08.690192+0000","last_fullsized":"2024-04-24T23:08:08.690192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'69","last_scrub_stamp":"2024-04-24T23:08:08.690087+0000","last_deep_scrub":"27'69","last_deep_scrub_stamp":"2024-04-24T23:08:08.690087+0000","last_clean_scrub_stamp":"2024-04-24T23:08:08.690087+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:38.861647+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":104,"num_write_kb":4310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'1074","reported_seq":1104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:20.499053+0000","last_change":"2024-04-24T23:08:20.499117+0000","last_active":"2024-04-24T23:08:20.499053+0000","last_peered":"2024-04-24T23:08:20.499053+0000","last_clean":"2024-04-24T23:08:20.499053+0000","last_became_active":"2024-04-24T23:00:20.506257+0000","last_became_peered":"2024-04-24T23:00:20.506257+0000","last_unstale":"2024-04-24T23:08:20.499053+0000","last_undegraded":"2024-04-24T23:08:20.499053+0000","last_fullsized":"2024-04-24T23:08:20.499053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1074","last_scrub_stamp":"2024-04-24T23:08:20.498875+0000","last_deep_scrub":"27'1074","last_deep_scrub_stamp":"2024-04-24T23:08:20.498875+0000","last_clean_scrub_stamp":"2024-04-24T23:08:20.498875+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:14.625182+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":7398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1072","reported_seq":1110,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:24.500921+0000","last_change":"2024-04-24T23:08:24.500993+0000","last_active":"2024-04-24T23:08:24.500921+0000","last_peered":"2024-04-24T23:08:24.500921+0000","last_clean":"2024-04-24T23:08:24.500921+0000","last_became_active":"2024-04-24T23:00:57.865999+0000","last_became_peered":"2024-04-24T23:00:57.865999+0000","last_unstale":"2024-04-24T23:08:24.500921+0000","last_undegraded":"2024-04-24T23:08:24.500921+0000","last_fullsized":"2024-04-24T23:08:24.500921+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1072","last_scrub_stamp":"2024-04-24T23:08:24.500735+0000","last_deep_scrub":"27'1072","last_deep_scrub_stamp":"2024-04-24T23:08:24.500735+0000","last_clean_scrub_stamp":"2024-04-24T23:08:24.500735+0000","objects_scrubbed":0,"log_size":1072,"log_dups_size":0,"ondisk_log_size":1072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:31.641752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1313,"num_write_kb":7137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5,3],"acting":[4,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'327","reported_seq":363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:16.493753+0000","last_change":"2024-04-24T23:08:16.493820+0000","last_active":"2024-04-24T23:08:16.493753+0000","last_peered":"2024-04-24T23:08:16.493753+0000","last_clean":"2024-04-24T23:08:16.493753+0000","last_became_active":"2024-04-24T23:00:16.477474+0000","last_became_peered":"2024-04-24T23:00:16.477474+0000","last_unstale":"2024-04-24T23:08:16.493753+0000","last_undegraded":"2024-04-24T23:08:16.493753+0000","last_fullsized":"2024-04-24T23:08:16.493753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'327","last_scrub_stamp":"2024-04-24T23:08:16.493577+0000","last_deep_scrub":"27'327","last_deep_scrub_stamp":"2024-04-24T23:08:16.493577+0000","last_clean_scrub_stamp":"2024-04-24T23:08:16.493577+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:45:57.777691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'570","reported_seq":607,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:16.972770+0000","last_change":"2024-04-24T23:08:16.972807+0000","last_active":"2024-04-24T23:08:16.972770+0000","last_peered":"2024-04-24T23:08:16.972770+0000","last_clean":"2024-04-24T23:08:16.972770+0000","last_became_active":"2024-04-24T23:00:15.405608+0000","last_became_peered":"2024-04-24T23:00:15.405608+0000","last_unstale":"2024-04-24T23:08:16.972770+0000","last_undegraded":"2024-04-24T23:08:16.972770+0000","last_fullsized":"2024-04-24T23:08:16.972770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'570","last_scrub_stamp":"2024-04-24T23:08:16.972682+0000","last_deep_scrub":"27'570","last_deep_scrub_stamp":"2024-04-24T23:08:16.972682+0000","last_clean_scrub_stamp":"2024-04-24T23:08:16.972682+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:30.276490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":627,"num_write_kb":21153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'936","reported_seq":967,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:28.933207+0000","last_change":"2024-04-24T23:08:28.933207+0000","last_active":"2024-04-24T23:08:28.933207+0000","last_peered":"2024-04-24T23:08:28.933207+0000","last_clean":"2024-04-24T23:08:28.933207+0000","last_became_active":"2024-04-24T23:00:20.492303+0000","last_became_peered":"2024-04-24T23:00:20.492303+0000","last_unstale":"2024-04-24T23:08:28.933207+0000","last_undegraded":"2024-04-24T23:08:28.933207+0000","last_fullsized":"2024-04-24T23:08:28.933207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'936","last_scrub_stamp":"2024-04-24T23:08:28.933058+0000","last_deep_scrub":"27'936","last_deep_scrub_stamp":"2024-04-24T23:08:28.933058+0000","last_clean_scrub_stamp":"2024-04-24T23:08:28.933058+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:23.232564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":6525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'358","reported_seq":394,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:22.211880+0000","last_change":"2024-04-24T23:08:22.211940+0000","last_active":"2024-04-24T23:08:22.211880+0000","last_peered":"2024-04-24T23:08:22.211880+0000","last_clean":"2024-04-24T23:08:22.211880+0000","last_became_active":"2024-04-24T23:00:16.457311+0000","last_became_peered":"2024-04-24T23:00:16.457311+0000","last_unstale":"2024-04-24T23:08:22.211880+0000","last_undegraded":"2024-04-24T23:08:22.211880+0000","last_fullsized":"2024-04-24T23:08:22.211880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'358","last_scrub_stamp":"2024-04-24T23:08:22.211698+0000","last_deep_scrub":"27'358","last_deep_scrub_stamp":"2024-04-24T23:08:22.211698+0000","last_clean_scrub_stamp":"2024-04-24T23:08:22.211698+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:48:02.503053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":274,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'151","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.979998+0000","last_change":"2024-04-24T23:08:11.980054+0000","last_active":"2024-04-24T23:08:11.979998+0000","last_peered":"2024-04-24T23:08:11.979998+0000","last_clean":"2024-04-24T23:08:11.979998+0000","last_became_active":"2024-04-24T23:00:15.435730+0000","last_became_peered":"2024-04-24T23:00:15.435730+0000","last_unstale":"2024-04-24T23:08:11.979998+0000","last_undegraded":"2024-04-24T23:08:11.979998+0000","last_fullsized":"2024-04-24T23:08:11.979998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'151","last_scrub_stamp":"2024-04-24T23:08:11.979824+0000","last_deep_scrub":"27'151","last_deep_scrub_stamp":"2024-04-24T23:08:11.979824+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.979824+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:18:39.157085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":198,"num_write_kb":4560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'1085","reported_seq":1122,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:21.985263+0000","last_change":"2024-04-24T23:08:21.985328+0000","last_active":"2024-04-24T23:08:21.985263+0000","last_peered":"2024-04-24T23:08:21.985263+0000","last_clean":"2024-04-24T23:08:21.985263+0000","last_became_active":"2024-04-24T23:00:15.417226+0000","last_became_peered":"2024-04-24T23:00:15.417226+0000","last_unstale":"2024-04-24T23:08:21.985263+0000","last_undegraded":"2024-04-24T23:08:21.985263+0000","last_fullsized":"2024-04-24T23:08:21.985263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1085","last_scrub_stamp":"2024-04-24T23:08:21.985099+0000","last_deep_scrub":"27'1085","last_deep_scrub_stamp":"2024-04-24T23:08:21.985099+0000","last_clean_scrub_stamp":"2024-04-24T23:08:21.985099+0000","objects_scrubbed":2,"log_size":1085,"log_dups_size":0,"ondisk_log_size":1085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:45.882971+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":1127,"num_write_kb":29507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'300","reported_seq":336,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:17.497876+0000","last_change":"2024-04-24T23:08:17.497936+0000","last_active":"2024-04-24T23:08:17.497876+0000","last_peered":"2024-04-24T23:08:17.497876+0000","last_clean":"2024-04-24T23:08:17.497876+0000","last_became_active":"2024-04-24T23:00:16.482676+0000","last_became_peered":"2024-04-24T23:00:16.482676+0000","last_unstale":"2024-04-24T23:08:17.497876+0000","last_undegraded":"2024-04-24T23:08:17.497876+0000","last_fullsized":"2024-04-24T23:08:17.497876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'300","last_scrub_stamp":"2024-04-24T23:08:17.497690+0000","last_deep_scrub":"27'300","last_deep_scrub_stamp":"2024-04-24T23:08:17.497690+0000","last_clean_scrub_stamp":"2024-04-24T23:08:17.497690+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:07.325595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'936","reported_seq":966,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:22.543467+0000","last_change":"2024-04-24T23:08:22.543541+0000","last_active":"2024-04-24T23:08:22.543467+0000","last_peered":"2024-04-24T23:08:22.543467+0000","last_clean":"2024-04-24T23:08:22.543467+0000","last_became_active":"2024-04-24T23:00:20.541822+0000","last_became_peered":"2024-04-24T23:00:20.541822+0000","last_unstale":"2024-04-24T23:08:22.543467+0000","last_undegraded":"2024-04-24T23:08:22.543467+0000","last_fullsized":"2024-04-24T23:08:22.543467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'936","last_scrub_stamp":"2024-04-24T23:08:22.543261+0000","last_deep_scrub":"27'936","last_deep_scrub_stamp":"2024-04-24T23:08:22.543261+0000","last_clean_scrub_stamp":"2024-04-24T23:08:22.543261+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:36:52.069115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":5864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'465","reported_seq":503,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:16.218297+0000","last_change":"2024-04-24T23:08:16.218367+0000","last_active":"2024-04-24T23:08:16.218297+0000","last_peered":"2024-04-24T23:08:16.218297+0000","last_clean":"2024-04-24T23:08:16.218297+0000","last_became_active":"2024-04-24T23:00:15.424739+0000","last_became_peered":"2024-04-24T23:00:15.424739+0000","last_unstale":"2024-04-24T23:08:16.218297+0000","last_undegraded":"2024-04-24T23:08:16.218297+0000","last_fullsized":"2024-04-24T23:08:16.218297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'465","last_scrub_stamp":"2024-04-24T23:08:16.218115+0000","last_deep_scrub":"27'465","last_deep_scrub_stamp":"2024-04-24T23:08:16.218115+0000","last_clean_scrub_stamp":"2024-04-24T23:08:16.218115+0000","objects_scrubbed":1,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:46.476719+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":495,"num_write_kb":8616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'329","reported_seq":365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.631248+0000","last_change":"2024-04-24T23:08:11.631363+0000","last_active":"2024-04-24T23:08:11.631248+0000","last_peered":"2024-04-24T23:08:11.631248+0000","last_clean":"2024-04-24T23:08:11.631248+0000","last_became_active":"2024-04-24T23:00:16.453965+0000","last_became_peered":"2024-04-24T23:00:16.453965+0000","last_unstale":"2024-04-24T23:08:11.631248+0000","last_undegraded":"2024-04-24T23:08:11.631248+0000","last_fullsized":"2024-04-24T23:08:11.631248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'329","last_scrub_stamp":"2024-04-24T23:08:11.631063+0000","last_deep_scrub":"27'329","last_deep_scrub_stamp":"2024-04-24T23:08:11.631063+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.631063+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:17:16.489974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'945","reported_seq":975,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:17.230752+0000","last_change":"2024-04-24T23:08:17.230880+0000","last_active":"2024-04-24T23:08:17.230752+0000","last_peered":"2024-04-24T23:08:17.230752+0000","last_clean":"2024-04-24T23:08:17.230752+0000","last_became_active":"2024-04-24T23:00:20.509269+0000","last_became_peered":"2024-04-24T23:00:20.509269+0000","last_unstale":"2024-04-24T23:08:17.230752+0000","last_undegraded":"2024-04-24T23:08:17.230752+0000","last_fullsized":"2024-04-24T23:08:17.230752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'945","last_scrub_stamp":"2024-04-24T23:08:17.230519+0000","last_deep_scrub":"27'945","last_deep_scrub_stamp":"2024-04-24T23:08:17.230519+0000","last_clean_scrub_stamp":"2024-04-24T23:08:17.230519+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:26.873328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":6611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'351","reported_seq":387,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.349555+0000","last_change":"2024-04-24T23:08:12.349555+0000","last_active":"2024-04-24T23:08:12.349555+0000","last_peered":"2024-04-24T23:08:12.349555+0000","last_clean":"2024-04-24T23:08:12.349555+0000","last_became_active":"2024-04-24T23:00:16.456289+0000","last_became_peered":"2024-04-24T23:00:16.456289+0000","last_unstale":"2024-04-24T23:08:12.349555+0000","last_undegraded":"2024-04-24T23:08:12.349555+0000","last_fullsized":"2024-04-24T23:08:12.349555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'351","last_scrub_stamp":"2024-04-24T23:08:12.349314+0000","last_deep_scrub":"27'351","last_deep_scrub_stamp":"2024-04-24T23:08:12.349314+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.349314+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:34:12.371801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'354","reported_seq":391,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.140281+0000","last_change":"2024-04-24T23:08:13.140281+0000","last_active":"2024-04-24T23:08:13.140281+0000","last_peered":"2024-04-24T23:08:13.140281+0000","last_clean":"2024-04-24T23:08:13.140281+0000","last_became_active":"2024-04-24T23:00:16.466134+0000","last_became_peered":"2024-04-24T23:00:16.466134+0000","last_unstale":"2024-04-24T23:08:13.140281+0000","last_undegraded":"2024-04-24T23:08:13.140281+0000","last_fullsized":"2024-04-24T23:08:13.140281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'354","last_scrub_stamp":"2024-04-24T23:08:13.140043+0000","last_deep_scrub":"27'354","last_deep_scrub_stamp":"2024-04-24T23:08:13.140043+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.140043+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:11.426240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'352","reported_seq":388,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:25.910625+0000","last_change":"2024-04-24T23:08:25.910625+0000","last_active":"2024-04-24T23:08:25.910625+0000","last_peered":"2024-04-24T23:08:25.910625+0000","last_clean":"2024-04-24T23:08:25.910625+0000","last_became_active":"2024-04-24T23:00:16.465659+0000","last_became_peered":"2024-04-24T23:00:16.465659+0000","last_unstale":"2024-04-24T23:08:25.910625+0000","last_undegraded":"2024-04-24T23:08:25.910625+0000","last_fullsized":"2024-04-24T23:08:25.910625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'352","last_scrub_stamp":"2024-04-24T23:08:25.910485+0000","last_deep_scrub":"27'352","last_deep_scrub_stamp":"2024-04-24T23:08:25.910485+0000","last_clean_scrub_stamp":"2024-04-24T23:08:25.910485+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:52:36.173758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'319","reported_seq":356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:24.153506+0000","last_change":"2024-04-24T23:08:24.153506+0000","last_active":"2024-04-24T23:08:24.153506+0000","last_peered":"2024-04-24T23:08:24.153506+0000","last_clean":"2024-04-24T23:08:24.153506+0000","last_became_active":"2024-04-24T23:00:16.474181+0000","last_became_peered":"2024-04-24T23:00:16.474181+0000","last_unstale":"2024-04-24T23:08:24.153506+0000","last_undegraded":"2024-04-24T23:08:24.153506+0000","last_fullsized":"2024-04-24T23:08:24.153506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'319","last_scrub_stamp":"2024-04-24T23:08:24.153257+0000","last_deep_scrub":"27'319","last_deep_scrub_stamp":"2024-04-24T23:08:24.153257+0000","last_clean_scrub_stamp":"2024-04-24T23:08:24.153257+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:01:37.566741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'298","reported_seq":334,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.936684+0000","last_change":"2024-04-24T23:08:14.936741+0000","last_active":"2024-04-24T23:08:14.936684+0000","last_peered":"2024-04-24T23:08:14.936684+0000","last_clean":"2024-04-24T23:08:14.936684+0000","last_became_active":"2024-04-24T23:00:16.457641+0000","last_became_peered":"2024-04-24T23:00:16.457641+0000","last_unstale":"2024-04-24T23:08:14.936684+0000","last_undegraded":"2024-04-24T23:08:14.936684+0000","last_fullsized":"2024-04-24T23:08:14.936684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'298","last_scrub_stamp":"2024-04-24T23:08:14.936514+0000","last_deep_scrub":"27'298","last_deep_scrub_stamp":"2024-04-24T23:08:14.936514+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.936514+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:34:14.959001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'302","reported_seq":338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:17.920624+0000","last_change":"2024-04-24T23:08:17.920684+0000","last_active":"2024-04-24T23:08:17.920624+0000","last_peered":"2024-04-24T23:08:17.920624+0000","last_clean":"2024-04-24T23:08:17.920624+0000","last_became_active":"2024-04-24T23:00:16.469614+0000","last_became_peered":"2024-04-24T23:00:16.469614+0000","last_unstale":"2024-04-24T23:08:17.920624+0000","last_undegraded":"2024-04-24T23:08:17.920624+0000","last_fullsized":"2024-04-24T23:08:17.920624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'302","last_scrub_stamp":"2024-04-24T23:08:17.920419+0000","last_deep_scrub":"27'302","last_deep_scrub_stamp":"2024-04-24T23:08:17.920419+0000","last_clean_scrub_stamp":"2024-04-24T23:08:17.920419+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:05.391416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'376","reported_seq":411,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:09.354746+0000","last_change":"2024-04-24T23:08:09.354768+0000","last_active":"2024-04-24T23:08:09.354746+0000","last_peered":"2024-04-24T23:08:09.354746+0000","last_clean":"2024-04-24T23:08:09.354746+0000","last_became_active":"2024-04-24T23:00:16.450561+0000","last_became_peered":"2024-04-24T23:00:16.450561+0000","last_unstale":"2024-04-24T23:08:09.354746+0000","last_undegraded":"2024-04-24T23:08:09.354746+0000","last_fullsized":"2024-04-24T23:08:09.354746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'376","last_scrub_stamp":"2024-04-24T23:08:09.354666+0000","last_deep_scrub":"27'376","last_deep_scrub_stamp":"2024-04-24T23:08:09.354666+0000","last_clean_scrub_stamp":"2024-04-24T23:08:09.354666+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:18:36.531927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'354","reported_seq":390,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.158239+0000","last_change":"2024-04-24T23:08:13.158295+0000","last_active":"2024-04-24T23:08:13.158239+0000","last_peered":"2024-04-24T23:08:13.158239+0000","last_clean":"2024-04-24T23:08:13.158239+0000","last_became_active":"2024-04-24T23:00:16.452345+0000","last_became_peered":"2024-04-24T23:00:16.452345+0000","last_unstale":"2024-04-24T23:08:13.158239+0000","last_undegraded":"2024-04-24T23:08:13.158239+0000","last_fullsized":"2024-04-24T23:08:13.158239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'354","last_scrub_stamp":"2024-04-24T23:08:13.158074+0000","last_deep_scrub":"27'354","last_deep_scrub_stamp":"2024-04-24T23:08:13.158074+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.158074+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:39:13.779815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'336","reported_seq":371,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:24.914831+0000","last_change":"2024-04-24T23:08:24.914869+0000","last_active":"2024-04-24T23:08:24.914831+0000","last_peered":"2024-04-24T23:08:24.914831+0000","last_clean":"2024-04-24T23:08:24.914831+0000","last_became_active":"2024-04-24T23:00:16.458402+0000","last_became_peered":"2024-04-24T23:00:16.458402+0000","last_unstale":"2024-04-24T23:08:24.914831+0000","last_undegraded":"2024-04-24T23:08:24.914831+0000","last_fullsized":"2024-04-24T23:08:24.914831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'336","last_scrub_stamp":"2024-04-24T23:08:24.914732+0000","last_deep_scrub":"27'336","last_deep_scrub_stamp":"2024-04-24T23:08:24.914732+0000","last_clean_scrub_stamp":"2024-04-24T23:08:24.914732+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:43:02.904005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'306","reported_seq":342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:09.168551+0000","last_change":"2024-04-24T23:08:09.168669+0000","last_active":"2024-04-24T23:08:09.168551+0000","last_peered":"2024-04-24T23:08:09.168551+0000","last_clean":"2024-04-24T23:08:09.168551+0000","last_became_active":"2024-04-24T23:00:16.453065+0000","last_became_peered":"2024-04-24T23:00:16.453065+0000","last_unstale":"2024-04-24T23:08:09.168551+0000","last_undegraded":"2024-04-24T23:08:09.168551+0000","last_fullsized":"2024-04-24T23:08:09.168551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'306","last_scrub_stamp":"2024-04-24T23:08:09.168341+0000","last_deep_scrub":"27'306","last_deep_scrub_stamp":"2024-04-24T23:08:09.168341+0000","last_clean_scrub_stamp":"2024-04-24T23:08:09.168341+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:36:09.369184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'329","reported_seq":370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.597539+0000","last_change":"2024-04-24T23:08:14.597601+0000","last_active":"2024-04-24T23:08:14.597539+0000","last_peered":"2024-04-24T23:08:14.597539+0000","last_clean":"2024-04-24T23:08:14.597539+0000","last_became_active":"2024-04-24T23:00:57.865894+0000","last_became_peered":"2024-04-24T23:00:57.865894+0000","last_unstale":"2024-04-24T23:08:14.597539+0000","last_undegraded":"2024-04-24T23:08:14.597539+0000","last_fullsized":"2024-04-24T23:08:14.597539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'329","last_scrub_stamp":"2024-04-24T23:08:14.597331+0000","last_deep_scrub":"27'329","last_deep_scrub_stamp":"2024-04-24T23:08:14.597331+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.597331+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:33.745282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'309","reported_seq":345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:15.520247+0000","last_change":"2024-04-24T23:08:15.520348+0000","last_active":"2024-04-24T23:08:15.520247+0000","last_peered":"2024-04-24T23:08:15.520247+0000","last_clean":"2024-04-24T23:08:15.520247+0000","last_became_active":"2024-04-24T23:00:16.477982+0000","last_became_peered":"2024-04-24T23:00:16.477982+0000","last_unstale":"2024-04-24T23:08:15.520247+0000","last_undegraded":"2024-04-24T23:08:15.520247+0000","last_fullsized":"2024-04-24T23:08:15.520247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'309","last_scrub_stamp":"2024-04-24T23:08:15.520061+0000","last_deep_scrub":"27'309","last_deep_scrub_stamp":"2024-04-24T23:08:15.520061+0000","last_clean_scrub_stamp":"2024-04-24T23:08:15.520061+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:50:47.695514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'353","reported_seq":389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:07.012983+0000","last_change":"2024-04-24T23:08:07.013005+0000","last_active":"2024-04-24T23:08:07.012983+0000","last_peered":"2024-04-24T23:08:07.012983+0000","last_clean":"2024-04-24T23:08:07.012983+0000","last_became_active":"2024-04-24T23:00:16.446583+0000","last_became_peered":"2024-04-24T23:00:16.446583+0000","last_unstale":"2024-04-24T23:08:07.012983+0000","last_undegraded":"2024-04-24T23:08:07.012983+0000","last_fullsized":"2024-04-24T23:08:07.012983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'353","last_scrub_stamp":"2024-04-24T23:08:07.012914+0000","last_deep_scrub":"27'353","last_deep_scrub_stamp":"2024-04-24T23:08:07.012914+0000","last_clean_scrub_stamp":"2024-04-24T23:08:07.012914+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:49:46.599567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'307","reported_seq":342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:26.931215+0000","last_change":"2024-04-24T23:08:26.931326+0000","last_active":"2024-04-24T23:08:26.931215+0000","last_peered":"2024-04-24T23:08:26.931215+0000","last_clean":"2024-04-24T23:08:26.931215+0000","last_became_active":"2024-04-24T23:00:16.483079+0000","last_became_peered":"2024-04-24T23:00:16.483079+0000","last_unstale":"2024-04-24T23:08:26.931215+0000","last_undegraded":"2024-04-24T23:08:26.931215+0000","last_fullsized":"2024-04-24T23:08:26.931215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'307","last_scrub_stamp":"2024-04-24T23:08:26.930934+0000","last_deep_scrub":"27'307","last_deep_scrub_stamp":"2024-04-24T23:08:26.930934+0000","last_clean_scrub_stamp":"2024-04-24T23:08:26.930934+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:15:38.084388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'303","reported_seq":339,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.163999+0000","last_change":"2024-04-24T23:08:14.164061+0000","last_active":"2024-04-24T23:08:14.163999+0000","last_peered":"2024-04-24T23:08:14.163999+0000","last_clean":"2024-04-24T23:08:14.163999+0000","last_became_active":"2024-04-24T23:00:16.466076+0000","last_became_peered":"2024-04-24T23:00:16.466076+0000","last_unstale":"2024-04-24T23:08:14.163999+0000","last_undegraded":"2024-04-24T23:08:14.163999+0000","last_fullsized":"2024-04-24T23:08:14.163999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'303","last_scrub_stamp":"2024-04-24T23:08:14.163820+0000","last_deep_scrub":"27'303","last_deep_scrub_stamp":"2024-04-24T23:08:14.163820+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.163820+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:33.311771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'324","reported_seq":359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.812802+0000","last_change":"2024-04-24T23:08:10.812871+0000","last_active":"2024-04-24T23:08:10.812802+0000","last_peered":"2024-04-24T23:08:10.812802+0000","last_clean":"2024-04-24T23:08:10.812802+0000","last_became_active":"2024-04-24T23:00:16.453949+0000","last_became_peered":"2024-04-24T23:00:16.453949+0000","last_unstale":"2024-04-24T23:08:10.812802+0000","last_undegraded":"2024-04-24T23:08:10.812802+0000","last_fullsized":"2024-04-24T23:08:10.812802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'324","last_scrub_stamp":"2024-04-24T23:08:10.812620+0000","last_deep_scrub":"27'324","last_deep_scrub_stamp":"2024-04-24T23:08:10.812620+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.812620+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:48.718519+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'334","reported_seq":369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:07.850824+0000","last_change":"2024-04-24T23:08:07.850872+0000","last_active":"2024-04-24T23:08:07.850824+0000","last_peered":"2024-04-24T23:08:07.850824+0000","last_clean":"2024-04-24T23:08:07.850824+0000","last_became_active":"2024-04-24T23:00:16.445253+0000","last_became_peered":"2024-04-24T23:00:16.445253+0000","last_unstale":"2024-04-24T23:08:07.850824+0000","last_undegraded":"2024-04-24T23:08:07.850824+0000","last_fullsized":"2024-04-24T23:08:07.850824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'334","last_scrub_stamp":"2024-04-24T23:08:07.850716+0000","last_deep_scrub":"27'334","last_deep_scrub_stamp":"2024-04-24T23:08:07.850716+0000","last_clean_scrub_stamp":"2024-04-24T23:08:07.850716+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:50:57.678621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'307","reported_seq":343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:11.188324+0000","last_change":"2024-04-24T23:08:11.188440+0000","last_active":"2024-04-24T23:08:11.188324+0000","last_peered":"2024-04-24T23:08:11.188324+0000","last_clean":"2024-04-24T23:08:11.188324+0000","last_became_active":"2024-04-24T23:00:16.454953+0000","last_became_peered":"2024-04-24T23:00:16.454953+0000","last_unstale":"2024-04-24T23:08:11.188324+0000","last_undegraded":"2024-04-24T23:08:11.188324+0000","last_fullsized":"2024-04-24T23:08:11.188324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'307","last_scrub_stamp":"2024-04-24T23:08:11.188053+0000","last_deep_scrub":"27'307","last_deep_scrub_stamp":"2024-04-24T23:08:11.188053+0000","last_clean_scrub_stamp":"2024-04-24T23:08:11.188053+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:56.463567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'318","reported_seq":354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:16.945354+0000","last_change":"2024-04-24T23:08:16.945425+0000","last_active":"2024-04-24T23:08:16.945354+0000","last_peered":"2024-04-24T23:08:16.945354+0000","last_clean":"2024-04-24T23:08:16.945354+0000","last_became_active":"2024-04-24T23:00:16.467630+0000","last_became_peered":"2024-04-24T23:00:16.467630+0000","last_unstale":"2024-04-24T23:08:16.945354+0000","last_undegraded":"2024-04-24T23:08:16.945354+0000","last_fullsized":"2024-04-24T23:08:16.945354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'318","last_scrub_stamp":"2024-04-24T23:08:16.945155+0000","last_deep_scrub":"27'318","last_deep_scrub_stamp":"2024-04-24T23:08:16.945155+0000","last_clean_scrub_stamp":"2024-04-24T23:08:16.945155+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:25.075736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'309","reported_seq":345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.974126+0000","last_change":"2024-04-24T23:08:13.974189+0000","last_active":"2024-04-24T23:08:13.974126+0000","last_peered":"2024-04-24T23:08:13.974126+0000","last_clean":"2024-04-24T23:08:13.974126+0000","last_became_active":"2024-04-24T23:00:16.455114+0000","last_became_peered":"2024-04-24T23:00:16.455114+0000","last_unstale":"2024-04-24T23:08:13.974126+0000","last_undegraded":"2024-04-24T23:08:13.974126+0000","last_fullsized":"2024-04-24T23:08:13.974126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'309","last_scrub_stamp":"2024-04-24T23:08:13.973955+0000","last_deep_scrub":"27'309","last_deep_scrub_stamp":"2024-04-24T23:08:13.973955+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.973955+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:09.776200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'287","reported_seq":323,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:18.887102+0000","last_change":"2024-04-24T23:08:18.887138+0000","last_active":"2024-04-24T23:08:18.887102+0000","last_peered":"2024-04-24T23:08:18.887102+0000","last_clean":"2024-04-24T23:08:18.887102+0000","last_became_active":"2024-04-24T23:00:16.450466+0000","last_became_peered":"2024-04-24T23:00:16.450466+0000","last_unstale":"2024-04-24T23:08:18.887102+0000","last_undegraded":"2024-04-24T23:08:18.887102+0000","last_fullsized":"2024-04-24T23:08:18.887102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'287","last_scrub_stamp":"2024-04-24T23:08:18.887008+0000","last_deep_scrub":"27'287","last_deep_scrub_stamp":"2024-04-24T23:08:18.887008+0000","last_clean_scrub_stamp":"2024-04-24T23:08:18.887008+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:11:22.527527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'307","reported_seq":343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:17.909464+0000","last_change":"2024-04-24T23:08:17.909503+0000","last_active":"2024-04-24T23:08:17.909464+0000","last_peered":"2024-04-24T23:08:17.909464+0000","last_clean":"2024-04-24T23:08:17.909464+0000","last_became_active":"2024-04-24T23:00:16.450279+0000","last_became_peered":"2024-04-24T23:00:16.450279+0000","last_unstale":"2024-04-24T23:08:17.909464+0000","last_undegraded":"2024-04-24T23:08:17.909464+0000","last_fullsized":"2024-04-24T23:08:17.909464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'307","last_scrub_stamp":"2024-04-24T23:08:17.909370+0000","last_deep_scrub":"27'307","last_deep_scrub_stamp":"2024-04-24T23:08:17.909370+0000","last_clean_scrub_stamp":"2024-04-24T23:08:17.909370+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:12.035676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'298","reported_seq":334,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:15.982861+0000","last_change":"2024-04-24T23:08:15.983004+0000","last_active":"2024-04-24T23:08:15.982861+0000","last_peered":"2024-04-24T23:08:15.982861+0000","last_clean":"2024-04-24T23:08:15.982861+0000","last_became_active":"2024-04-24T23:00:16.446317+0000","last_became_peered":"2024-04-24T23:00:16.446317+0000","last_unstale":"2024-04-24T23:08:15.982861+0000","last_undegraded":"2024-04-24T23:08:15.982861+0000","last_fullsized":"2024-04-24T23:08:15.982861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'298","last_scrub_stamp":"2024-04-24T23:08:15.982614+0000","last_deep_scrub":"27'298","last_deep_scrub_stamp":"2024-04-24T23:08:15.982614+0000","last_clean_scrub_stamp":"2024-04-24T23:08:15.982614+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:03:10.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'337","reported_seq":373,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:09.679656+0000","last_change":"2024-04-24T23:08:09.679700+0000","last_active":"2024-04-24T23:08:09.679656+0000","last_peered":"2024-04-24T23:08:09.679656+0000","last_clean":"2024-04-24T23:08:09.679656+0000","last_became_active":"2024-04-24T23:00:16.445839+0000","last_became_peered":"2024-04-24T23:00:16.445839+0000","last_unstale":"2024-04-24T23:08:09.679656+0000","last_undegraded":"2024-04-24T23:08:09.679656+0000","last_fullsized":"2024-04-24T23:08:09.679656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'337","last_scrub_stamp":"2024-04-24T23:08:09.679548+0000","last_deep_scrub":"27'337","last_deep_scrub_stamp":"2024-04-24T23:08:09.679548+0000","last_clean_scrub_stamp":"2024-04-24T23:08:09.679548+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:45.603686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'273","reported_seq":309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:19.175763+0000","last_change":"2024-04-24T23:08:19.175824+0000","last_active":"2024-04-24T23:08:19.175763+0000","last_peered":"2024-04-24T23:08:19.175763+0000","last_clean":"2024-04-24T23:08:19.175763+0000","last_became_active":"2024-04-24T23:00:16.450293+0000","last_became_peered":"2024-04-24T23:00:16.450293+0000","last_unstale":"2024-04-24T23:08:19.175763+0000","last_undegraded":"2024-04-24T23:08:19.175763+0000","last_fullsized":"2024-04-24T23:08:19.175763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'273","last_scrub_stamp":"2024-04-24T23:08:19.175581+0000","last_deep_scrub":"27'273","last_deep_scrub_stamp":"2024-04-24T23:08:19.175581+0000","last_clean_scrub_stamp":"2024-04-24T23:08:19.175581+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:35.163562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'314","reported_seq":350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:22.947082+0000","last_change":"2024-04-24T23:08:22.947140+0000","last_active":"2024-04-24T23:08:22.947082+0000","last_peered":"2024-04-24T23:08:22.947082+0000","last_clean":"2024-04-24T23:08:22.947082+0000","last_became_active":"2024-04-24T23:00:16.481897+0000","last_became_peered":"2024-04-24T23:00:16.481897+0000","last_unstale":"2024-04-24T23:08:22.947082+0000","last_undegraded":"2024-04-24T23:08:22.947082+0000","last_fullsized":"2024-04-24T23:08:22.947082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'314","last_scrub_stamp":"2024-04-24T23:08:22.946895+0000","last_deep_scrub":"27'314","last_deep_scrub_stamp":"2024-04-24T23:08:22.946895+0000","last_clean_scrub_stamp":"2024-04-24T23:08:22.946895+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:19:43.889022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'318","reported_seq":353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:14.444436+0000","last_change":"2024-04-24T23:08:14.444471+0000","last_active":"2024-04-24T23:08:14.444436+0000","last_peered":"2024-04-24T23:08:14.444436+0000","last_clean":"2024-04-24T23:08:14.444436+0000","last_became_active":"2024-04-24T23:00:16.481832+0000","last_became_peered":"2024-04-24T23:00:16.481832+0000","last_unstale":"2024-04-24T23:08:14.444436+0000","last_undegraded":"2024-04-24T23:08:14.444436+0000","last_fullsized":"2024-04-24T23:08:14.444436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'318","last_scrub_stamp":"2024-04-24T23:08:14.444344+0000","last_deep_scrub":"27'318","last_deep_scrub_stamp":"2024-04-24T23:08:14.444344+0000","last_clean_scrub_stamp":"2024-04-24T23:08:14.444344+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:22.574925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'323","reported_seq":359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:20.901574+0000","last_change":"2024-04-24T23:08:20.901644+0000","last_active":"2024-04-24T23:08:20.901574+0000","last_peered":"2024-04-24T23:08:20.901574+0000","last_clean":"2024-04-24T23:08:20.901574+0000","last_became_active":"2024-04-24T23:00:16.465749+0000","last_became_peered":"2024-04-24T23:00:16.465749+0000","last_unstale":"2024-04-24T23:08:20.901574+0000","last_undegraded":"2024-04-24T23:08:20.901574+0000","last_fullsized":"2024-04-24T23:08:20.901574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'323","last_scrub_stamp":"2024-04-24T23:08:20.901387+0000","last_deep_scrub":"27'323","last_deep_scrub_stamp":"2024-04-24T23:08:20.901387+0000","last_clean_scrub_stamp":"2024-04-24T23:08:20.901387+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:21.791587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'308","reported_seq":344,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:13.399007+0000","last_change":"2024-04-24T23:08:13.399007+0000","last_active":"2024-04-24T23:08:13.399007+0000","last_peered":"2024-04-24T23:08:13.399007+0000","last_clean":"2024-04-24T23:08:13.399007+0000","last_became_active":"2024-04-24T23:00:16.481381+0000","last_became_peered":"2024-04-24T23:00:16.481381+0000","last_unstale":"2024-04-24T23:08:13.399007+0000","last_undegraded":"2024-04-24T23:08:13.399007+0000","last_fullsized":"2024-04-24T23:08:13.399007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'308","last_scrub_stamp":"2024-04-24T23:08:13.398866+0000","last_deep_scrub":"27'308","last_deep_scrub_stamp":"2024-04-24T23:08:13.398866+0000","last_clean_scrub_stamp":"2024-04-24T23:08:13.398866+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:26.157764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'305","reported_seq":342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:12.157257+0000","last_change":"2024-04-24T23:08:12.157257+0000","last_active":"2024-04-24T23:08:12.157257+0000","last_peered":"2024-04-24T23:08:12.157257+0000","last_clean":"2024-04-24T23:08:12.157257+0000","last_became_active":"2024-04-24T23:00:16.461267+0000","last_became_peered":"2024-04-24T23:00:16.461267+0000","last_unstale":"2024-04-24T23:08:12.157257+0000","last_undegraded":"2024-04-24T23:08:12.157257+0000","last_fullsized":"2024-04-24T23:08:12.157257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'305","last_scrub_stamp":"2024-04-24T23:08:12.156895+0000","last_deep_scrub":"27'305","last_deep_scrub_stamp":"2024-04-24T23:08:12.156895+0000","last_clean_scrub_stamp":"2024-04-24T23:08:12.156895+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:40:16.285506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'326","reported_seq":363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:10.140109+0000","last_change":"2024-04-24T23:08:10.140109+0000","last_active":"2024-04-24T23:08:10.140109+0000","last_peered":"2024-04-24T23:08:10.140109+0000","last_clean":"2024-04-24T23:08:10.140109+0000","last_became_active":"2024-04-24T23:00:16.459445+0000","last_became_peered":"2024-04-24T23:00:16.459445+0000","last_unstale":"2024-04-24T23:08:10.140109+0000","last_undegraded":"2024-04-24T23:08:10.140109+0000","last_fullsized":"2024-04-24T23:08:10.140109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'326","last_scrub_stamp":"2024-04-24T23:08:10.139849+0000","last_deep_scrub":"27'326","last_deep_scrub_stamp":"2024-04-24T23:08:10.139849+0000","last_clean_scrub_stamp":"2024-04-24T23:08:10.139849+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:40:40.178030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'310","reported_seq":347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-24T23:08:16.955290+0000","last_change":"2024-04-24T23:08:16.955290+0000","last_active":"2024-04-24T23:08:16.955290+0000","last_peered":"2024-04-24T23:08:16.955290+0000","last_clean":"2024-04-24T23:08:16.955290+0000","last_became_active":"2024-04-24T23:00:16.450061+0000","last_became_peered":"2024-04-24T23:00:16.450061+0000","last_unstale":"2024-04-24T23:08:16.955290+0000","last_undegraded":"2024-04-24T23:08:16.955290+0000","last_fullsized":"2024-04-24T23:08:16.955290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'310","last_scrub_stamp":"2024-04-24T23:08:16.955156+0000","last_deep_scrub":"27'310","last_deep_scrub_stamp":"2024-04-24T23:08:16.955156+0000","last_clean_scrub_stamp":"2024-04-24T23:08:16.955156+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:54.861056+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40344,"num_write_kb":220872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32314,"ondisk_log_size":32314,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15318,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20401,"ondisk_log_size":20401,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":156152903,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":1142,"num_read_kb":1796,"num_write":15519,"num_write_kb":443889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5463,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87670784,"data_stored":312305806,"data_compressed":57745618,"data_compressed_allocated":71630848,"data_compressed_original":296329216,"omap_allocated":0,"internal_metadata":0},"log_size":13466,"ondisk_log_size":13466,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66754,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509547,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116732,"kb_used_data":9204,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94255108,"statfs":{"total":96636764160,"available":96517230592,"internally_reserved":0,"allocated":9424896,"data_stored":30817518,"data_compressed":5693383,"data_compressed_allocated":7151616,"data_compressed_original":28721152,"omap_allocated":1590,"internal_metadata":110098890},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509547,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112928,"kb_used_data":9624,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94258912,"statfs":{"total":96636764160,"available":96521125888,"internally_reserved":0,"allocated":9854976,"data_stored":37485867,"data_compressed":6753749,"data_compressed_allocated":8212480,"data_compressed_original":36028416,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509548,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133964,"kb_used_data":12612,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94237876,"statfs":{"total":96636764160,"available":96499585024,"internally_reserved":0,"allocated":12914688,"data_stored":46253360,"data_compressed":8519580,"data_compressed_allocated":10514432,"data_compressed_original":44023808,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509548,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89148,"kb_used_data":3828,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94282692,"statfs":{"total":96636764160,"available":96545476608,"internally_reserved":0,"allocated":3919872,"data_stored":12699018,"data_compressed":2449723,"data_compressed_allocated":3092480,"data_compressed_original":12046336,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509548,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113264,"kb_used_data":9896,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94258576,"statfs":{"total":96636764160,"available":96520781824,"internally_reserved":0,"allocated":10133504,"data_stored":34260304,"data_compressed":6393594,"data_compressed_allocated":7995392,"data_compressed_original":32296960,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509547,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131964,"kb_used_data":16180,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94239876,"statfs":{"total":96636764160,"available":96501633024,"internally_reserved":0,"allocated":16568320,"data_stored":58456099,"data_compressed":10542411,"data_compressed_allocated":13033472,"data_compressed_original":55099392,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542252,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91380,"kb_used_data":10220,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94280460,"statfs":{"total":96636764160,"available":96543191040,"internally_reserved":0,"allocated":10465280,"data_stored":37864170,"data_compressed":6877701,"data_compressed_allocated":8454144,"data_compressed_original":36020224,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574956,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119692,"kb_used_data":16388,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94252148,"statfs":{"total":96636764160,"available":96514199552,"internally_reserved":0,"allocated":16781312,"data_stored":56573678,"data_compressed":10582231,"data_compressed_allocated":13266944,"data_compressed_original":53239808,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33377,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16285696,"data_stored":58340665,"data_compressed":10542411,"data_compressed_allocated":13033472,"data_compressed_original":55099392,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9785344,"data_stored":33554502,"data_compressed":6360217,"data_compressed_allocated":7950336,"data_compressed_original":31723520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3637248,"data_stored":12583584,"data_compressed":2449723,"data_compressed_allocated":3092480,"data_compressed_original":12046336,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":46137926,"data_compressed":8519580,"data_compressed_allocated":10514432,"data_compressed_original":44023808,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9572352,"data_stored":37370433,"data_compressed":6753749,"data_compressed_allocated":8212480,"data_compressed_original":36028416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16433152,"data_stored":55867876,"data_compressed":10548854,"data_compressed_allocated":13221888,"data_compressed_original":52666368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10182656,"data_stored":37748736,"data_compressed":6877701,"data_compressed_allocated":8454144,"data_compressed_original":36020224,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9142272,"data_stored":30702084,"data_compressed":5693383,"data_compressed_allocated":7151616,"data_compressed_original":28721152,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T23:08:50.723 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e90ac640 1 Processor -- start 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e90ac640 1 -- start start 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e90ac640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20e4072c30 0x7f20e41414c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e90ac640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f20e4141a00 0x7f20e4151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e90ac640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20e40b5ab0 con 0x7f20e4070d30 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e90ac640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f20e4141e70 con 0x7f20e4141a00 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e90ac640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f20e4071110 con 0x7f20e4072c30 2024-04-24T23:08:50.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e2d9d640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f20e4070d30 0x7f20e40b6090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36642/0 (socket says 172.21.15.43:36642) 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e2d9d640 1 -- 172.21.15.43:0/2208087315 learned_addr learned my addr 172.21.15.43:0/2208087315 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e259c640 1 --2- 172.21.15.43:0/2208087315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20e4072c30 0x7f20e41414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e359e640 1 --2- 172.21.15.43:0/2208087315 >> v2:172.21.15.162:3300/0 conn(0x7f20e4141a00 0x7f20e4151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 -- 172.21.15.43:0/2208087315 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1616887933 0 0) 0x7f20d4001120 con 0x7f20e4070d30 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 -- 172.21.15.43:0/2208087315 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20cc003530 con 0x7f20e4070d30 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 -- 172.21.15.43:0/2208087315 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 677225454 0 0) 0x7f20cc003530 con 0x7f20e4070d30 2024-04-24T23:08:50.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 -- 172.21.15.43:0/2208087315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20e4072c30 msgr2=0x7f20e41414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 --2- 172.21.15.43:0/2208087315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20e4072c30 0x7f20e41414c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 -- 172.21.15.43:0/2208087315 >> v2:172.21.15.162:3300/0 conn(0x7f20e4141a00 msgr2=0x7f20e4151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 --2- 172.21.15.43:0/2208087315 >> v2:172.21.15.162:3300/0 conn(0x7f20e4141a00 0x7f20e4151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 -- 172.21.15.43:0/2208087315 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e40b4fd0 con 0x7f20e4070d30 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 -- 172.21.15.43:0/2208087315 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f20d4001850 con 0x7f20e4070d30 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 -- 172.21.15.43:0/2208087315 >> v1:172.21.15.43:6789/0 conn(0x7f20e4070d30 legacy=0x7f20e40b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 --2- 172.21.15.43:0/2208087315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20cc0039c0 0x7f20cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 --2- 172.21.15.43:0/2208087315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20cc004810 0x7f20cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 --2- 172.21.15.43:0/2208087315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20cc0051d0 0x7f20cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 -- 172.21.15.43:0/2208087315 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f20e4141e70 con 0x7f20cc0039c0 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 -- 172.21.15.43:0/2208087315 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f20e4071110 con 0x7f20cc0051d0 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e1d9b640 1 -- 172.21.15.43:0/2208087315 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f20cc00bf40 con 0x7f20cc004810 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e259c640 1 --2- 172.21.15.43:0/2208087315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20e4072c30 0x7f20e41414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:08:50.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e2d9d640 1 --2- 172.21.15.43:0/2208087315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20cc0039c0 0x7f20cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e2d9d640 1 -- 172.21.15.43:0/2208087315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20cc004810 msgr2=0x7f20cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e2d9d640 1 --2- 172.21.15.43:0/2208087315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20cc004810 0x7f20cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e359e640 1 --2- 172.21.15.43:0/2208087315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20cc0051d0 0x7f20cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e2d9d640 1 -- 172.21.15.43:0/2208087315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20cc0051d0 msgr2=0x7f20cc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e2d9d640 1 --2- 172.21.15.43:0/2208087315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20cc0051d0 0x7f20cc00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.870+0000 7f20e2d9d640 1 -- 172.21.15.43:0/2208087315 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20cc003530 con 0x7f20cc0039c0 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e2d9d640 1 --2- 172.21.15.43:0/2208087315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20cc0039c0 0x7f20cc003de0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f20d400c4c0 tx=0x7f20d401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec27a6728db1c18 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e1d9b640 1 -- 172.21.15.43:0/2208087315 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d400c0e0 con 0x7f20cc0039c0 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e1d9b640 1 -- 172.21.15.43:0/2208087315 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d40a9020 con 0x7f20cc0039c0 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e1d9b640 1 -- 172.21.15.43:0/2208087315 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d4005ae0 con 0x7f20cc0039c0 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e90ac640 1 -- 172.21.15.43:0/2208087315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20cc0039c0 msgr2=0x7f20cc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e90ac640 1 --2- 172.21.15.43:0/2208087315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20cc0039c0 0x7f20cc003de0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f20d400c4c0 tx=0x7f20d401cca0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e359e640 1 -- 172.21.15.43:0/2208087315 reap_dead start 2024-04-24T23:08:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e90ac640 1 -- 172.21.15.43:0/2208087315 shutdown_connections 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e90ac640 1 -- 172.21.15.43:0/2208087315 >> 172.21.15.43:0/2208087315 conn(0x7f20e406c300 msgr2=0x7f20e406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e90ac640 1 -- 172.21.15.43:0/2208087315 shutdown_connections 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e90ac640 1 -- 172.21.15.43:0/2208087315 wait complete. 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e90ac640 1 Processor -- start 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e90ac640 1 -- start start 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e90ac640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20e414c270 0x7f20e414d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e90ac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20e4151690 0x7f20e41e3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e90ac640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20e4151af0 0x7f20e41e4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e90ac640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f20e4073190 con 0x7f20e4151690 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e90ac640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f20e4073010 con 0x7f20e414c270 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e90ac640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f20e4073540 con 0x7f20e4151af0 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20e4151690 0x7f20e41e3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:50.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20e4151690 0x7f20e41e3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33840/0 (socket says 172.21.15.43:33840) 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e259c640 1 -- 172.21.15.43:0/1613320705 learned_addr learned my addr 172.21.15.43:0/1613320705 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e359e640 1 --2- 172.21.15.43:0/1613320705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20e4151af0 0x7f20e41e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.874+0000 7f20e2d9d640 1 --2- 172.21.15.43:0/1613320705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20e414c270 0x7f20e414d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20e259c640 1 -- 172.21.15.43:0/1613320705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20e4151af0 msgr2=0x7f20e41e4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20e259c640 1 --2- 172.21.15.43:0/1613320705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20e4151af0 0x7f20e41e4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20e259c640 1 -- 172.21.15.43:0/1613320705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20e414c270 msgr2=0x7f20e414d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20e259c640 1 --2- 172.21.15.43:0/1613320705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20e414c270 0x7f20e414d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20e259c640 1 -- 172.21.15.43:0/1613320705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e414c650 con 0x7f20e4151690 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20e2d9d640 1 --2- 172.21.15.43:0/1613320705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20e414c270 0x7f20e414d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20e259c640 1 --2- 172.21.15.43:0/1613320705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20e4151690 0x7f20e41e3ae0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f20d800e5c0 tx=0x7f20d800ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20cb7fe640 1 -- 172.21.15.43:0/1613320705 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8017070 con 0x7f20e4151690 2024-04-24T23:08:50.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20cb7fe640 1 -- 172.21.15.43:0/1613320705 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d8013610 con 0x7f20e4151690 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20e90ac640 1 -- 172.21.15.43:0/1613320705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e41e4560 con 0x7f20e4151690 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20cb7fe640 1 -- 172.21.15.43:0/1613320705 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d800f040 con 0x7f20e4151690 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20e90ac640 1 -- 172.21.15.43:0/1613320705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e414d090 con 0x7f20e4151690 2024-04-24T23:08:50.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20e90ac640 1 -- 172.21.15.43:0/1613320705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e404f580 con 0x7f20e4151690 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20cb7fe640 1 -- 172.21.15.43:0/1613320705 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f20d801a070 con 0x7f20e4151690 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20cb7fe640 1 --2- 172.21.15.43:0/1613320705 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f20d00678f0 0x7f20d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20cb7fe640 1 -- 172.21.15.43:0/1613320705 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f20d8085e70 con 0x7f20e4151690 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20e2d9d640 1 --2- 172.21.15.43:0/1613320705 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f20d00678f0 0x7f20d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.878+0000 7f20e2d9d640 1 --2- 172.21.15.43:0/1613320705 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f20d00678f0 0x7f20d0069db0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f20d400c4c0 tx=0x7f20e4072700 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:50.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:50.882+0000 7f20cb7fe640 1 -- 172.21.15.43:0/1613320705 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f20d8056750 con 0x7f20e4151690 2024-04-24T23:08:51.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.038+0000 7f20e90ac640 1 -- 172.21.15.43:0/1613320705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f20e40ba5c0 con 0x7f20e4151690 2024-04-24T23:08:51.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.046+0000 7f20cb7fe640 1 -- 172.21.15.43:0/1613320705 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f20d8056050 con 0x7f20e4151690 2024-04-24T23:08:51.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.046+0000 7f20cb7fe640 1 -- 172.21.15.43:0/1613320705 <== mon.0 v2:172.21.15.43:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f20d805a400 con 0x7f20e4151690 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.050+0000 7f20e90ac640 1 -- 172.21.15.43:0/1613320705 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f20d00678f0 msgr2=0x7f20d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.050+0000 7f20e90ac640 1 --2- 172.21.15.43:0/1613320705 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f20d00678f0 0x7f20d0069db0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f20d400c4c0 tx=0x7f20e4072700 comp rx=0 tx=0).stop 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.050+0000 7f20e90ac640 1 -- 172.21.15.43:0/1613320705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20e4151690 msgr2=0x7f20e41e3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.050+0000 7f20e90ac640 1 --2- 172.21.15.43:0/1613320705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20e4151690 0x7f20e41e3ae0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f20d800e5c0 tx=0x7f20d800ea80 comp rx=0 tx=0).stop 2024-04-24T23:08:51.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.050+0000 7f20e90ac640 1 -- 172.21.15.43:0/1613320705 shutdown_connections 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.050+0000 7f20e90ac640 1 --2- 172.21.15.43:0/1613320705 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f20d00678f0 0x7f20d0069db0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.050+0000 7f20e90ac640 1 --2- 172.21.15.43:0/1613320705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20e4151af0 0x7f20e41e4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.050+0000 7f20e90ac640 1 --2- 172.21.15.43:0/1613320705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20e4151690 0x7f20e41e3ae0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.050+0000 7f20e90ac640 1 --2- 172.21.15.43:0/1613320705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20e414c270 0x7f20e414d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.050+0000 7f20e90ac640 1 -- 172.21.15.43:0/1613320705 >> 172.21.15.43:0/1613320705 conn(0x7f20e406c300 msgr2=0x7f20e413ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.050+0000 7f20e90ac640 1 -- 172.21.15.43:0/1613320705 shutdown_connections 2024-04-24T23:08:51.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.050+0000 7f20e90ac640 1 -- 172.21.15.43:0/1613320705 wait complete. 2024-04-24T23:08:51.067 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-24T23:08:51.067 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.170+0000 7fa68ce2c640 1 Processor -- start 2024-04-24T23:08:51.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.170+0000 7fa68ce2c640 1 -- start start 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68ce2c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa6880b57a0 0x7fa68806f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68ce2c640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa68806f440 con 0x7fa68806fda0 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68ce2c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa688141de0 con 0x7fa688141a00 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68ce2c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa6880b71d0 con 0x7fa6880b57a0 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa686d9d640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa68806fda0 0x7fa688152150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36650/0 (socket says 172.21.15.43:36650) 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa686d9d640 1 -- 172.21.15.43:0/360821406 learned_addr learned my addr 172.21.15.43:0/360821406 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa685d9b640 1 --2- 172.21.15.43:0/360821406 >> v2:172.21.15.162:3300/0 conn(0x7fa6880b57a0 0x7fa68806f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68559a640 1 -- 172.21.15.43:0/360821406 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3989162705 0 0) 0x7fa68806f440 con 0x7fa68806fda0 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68559a640 1 -- 172.21.15.43:0/360821406 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa670003530 con 0x7fa68806fda0 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68559a640 1 -- 172.21.15.43:0/360821406 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2417349240 0 0) 0x7fa670003530 con 0x7fa68806fda0 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68559a640 1 -- 172.21.15.43:0/360821406 >> v2:172.21.15.162:3300/0 conn(0x7fa6880b57a0 msgr2=0x7fa68806f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:51.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68559a640 1 --2- 172.21.15.43:0/360821406 >> v2:172.21.15.162:3300/0 conn(0x7fa6880b57a0 0x7fa68806f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68559a640 1 -- 172.21.15.43:0/360821406 >> v1:172.21.15.162:6789/0 conn(0x7fa688141a00 legacy=0x7fa688072b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68559a640 1 -- 172.21.15.43:0/360821406 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6880b6ef0 con 0x7fa68806fda0 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68559a640 1 -- 172.21.15.43:0/360821406 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7fa680001a00 con 0x7fa68806fda0 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68559a640 1 -- 172.21.15.43:0/360821406 >> v1:172.21.15.43:6789/0 conn(0x7fa68806fda0 legacy=0x7fa688152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68559a640 1 --2- 172.21.15.43:0/360821406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6700039c0 0x7fa670003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68559a640 1 --2- 172.21.15.43:0/360821406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa670004810 0x7fa670004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68559a640 1 --2- 172.21.15.43:0/360821406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6700051d0 0x7fa67000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68559a640 1 -- 172.21.15.43:0/360821406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa6880b71d0 con 0x7fa6700039c0 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68559a640 1 -- 172.21.15.43:0/360821406 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa67000c170 con 0x7fa670004810 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68559a640 1 -- 172.21.15.43:0/360821406 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa67000c370 con 0x7fa6700051d0 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68659c640 1 --2- 172.21.15.43:0/360821406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6700039c0 0x7fa670003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68659c640 1 -- 172.21.15.43:0/360821406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6700051d0 msgr2=0x7fa67000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68659c640 1 --2- 172.21.15.43:0/360821406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6700051d0 0x7fa67000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68659c640 1 -- 172.21.15.43:0/360821406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa670004810 msgr2=0x7fa670004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa685d9b640 1 --2- 172.21.15.43:0/360821406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa670004810 0x7fa670004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68659c640 1 --2- 172.21.15.43:0/360821406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa670004810 0x7fa670004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa68659c640 1 -- 172.21.15.43:0/360821406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa670003530 con 0x7fa6700039c0 2024-04-24T23:08:51.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.174+0000 7fa686d9d640 1 -- 172.21.15.43:0/360821406 reap_dead start 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68659c640 1 --2- 172.21.15.43:0/360821406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6700039c0 0x7fa670003de0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa678001780 tx=0x7fa67801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8148ef6fb4734e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68559a640 1 -- 172.21.15.43:0/360821406 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6780013a0 con 0x7fa6700039c0 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68559a640 1 -- 172.21.15.43:0/360821406 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa6780052f0 con 0x7fa6700039c0 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68559a640 1 -- 172.21.15.43:0/360821406 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678003860 con 0x7fa6700039c0 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 -- 172.21.15.43:0/360821406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6700039c0 msgr2=0x7fa670003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 --2- 172.21.15.43:0/360821406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6700039c0 0x7fa670003de0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa678001780 tx=0x7fa67801c420 comp rx=0 tx=0).stop 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 -- 172.21.15.43:0/360821406 shutdown_connections 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 --2- 172.21.15.43:0/360821406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6700039c0 0x7fa670003de0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 -- 172.21.15.43:0/360821406 >> 172.21.15.43:0/360821406 conn(0x7fa6880b78a0 msgr2=0x7fa6880b7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 -- 172.21.15.43:0/360821406 shutdown_connections 2024-04-24T23:08:51.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 -- 172.21.15.43:0/360821406 wait complete. 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 Processor -- start 2024-04-24T23:08:51.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 -- start start 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6700039c0 0x7fa688140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6881427c0 0x7fa688143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa688143590 0x7fa688139f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa68809ee70 con 0x7fa6881427c0 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa6880b6400 con 0x7fa688143590 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa68809eff0 con 0x7fa6700039c0 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa685d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6881427c0 0x7fa688143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa685d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6881427c0 0x7fa688143050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33858/0 (socket says 172.21.15.43:33858) 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa685d9b640 1 -- 172.21.15.43:0/2609307266 learned_addr learned my addr 172.21.15.43:0/2609307266 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68659c640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6700039c0 0x7fa688140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa686d9d640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa688143590 0x7fa688139f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa685d9b640 1 -- 172.21.15.43:0/2609307266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6700039c0 msgr2=0x7fa688140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa685d9b640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6700039c0 0x7fa688140c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa685d9b640 1 -- 172.21.15.43:0/2609307266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa688143590 msgr2=0x7fa688139f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa685d9b640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa688143590 0x7fa688139f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa685d9b640 1 -- 172.21.15.43:0/2609307266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6881424c0 con 0x7fa6881427c0 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68659c640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6700039c0 0x7fa688140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa686d9d640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa688143590 0x7fa688139f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa685d9b640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6881427c0 0x7fa688143050 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa67c010830 tx=0x7fa67c010cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa676ffd640 1 -- 172.21.15.43:0/2609307266 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c00f040 con 0x7fa6881427c0 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa676ffd640 1 -- 172.21.15.43:0/2609307266 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa67c00eb00 con 0x7fa6881427c0 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 -- 172.21.15.43:0/2609307266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68813ddd0 con 0x7fa6881427c0 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa676ffd640 1 -- 172.21.15.43:0/2609307266 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c01c400 con 0x7fa6881427c0 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.178+0000 7fa68ce2c640 1 -- 172.21.15.43:0/2609307266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa688145060 con 0x7fa6881427c0 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.182+0000 7fa68ce2c640 1 -- 172.21.15.43:0/2609307266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa68804f580 con 0x7fa6881427c0 2024-04-24T23:08:51.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.182+0000 7fa676ffd640 1 -- 172.21.15.43:0/2609307266 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa67c01c5a0 con 0x7fa6881427c0 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.182+0000 7fa676ffd640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa6680678f0 0x7fa668069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.182+0000 7fa676ffd640 1 -- 172.21.15.43:0/2609307266 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fa67c086480 con 0x7fa6881427c0 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.182+0000 7fa68659c640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa6680678f0 0x7fa668069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.182+0000 7fa68659c640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa6680678f0 0x7fa668069db0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa678001750 tx=0x7fa6780011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:51.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.186+0000 7fa676ffd640 1 -- 172.21.15.43:0/2609307266 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa67c018030 con 0x7fa6881427c0 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.374+0000 7fa68ce2c640 1 -- 172.21.15.43:0/2609307266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa68814bf00 con 0x7fa6881427c0 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.374+0000 7fa676ffd640 1 -- 172.21.15.43:0/2609307266 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3529 (secure 0 0 0) 0x7fa67c056c80 con 0x7fa6881427c0 2024-04-24T23:08:51.376 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:08:51.377 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/2236776475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2236776475},{"type":"v1","addr":"172.21.15.162:6833","nonce":2236776475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:00:15.762941+0000","modified":"2024-04-24T23:00:32.909117+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6835/152091432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":152091432},{"type":"v1","addr":"172.21.15.43:6835","nonce":152091432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-04-24T23:08:51.377 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.378+0000 7fa68ce2c640 1 -- 172.21.15.43:0/2609307266 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa6680678f0 msgr2=0x7fa668069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.378+0000 7fa68ce2c640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa6680678f0 0x7fa668069db0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa678001750 tx=0x7fa6780011a0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.378+0000 7fa68ce2c640 1 -- 172.21.15.43:0/2609307266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6881427c0 msgr2=0x7fa688143050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.378+0000 7fa68ce2c640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6881427c0 0x7fa688143050 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa67c010830 tx=0x7fa67c010cf0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.378+0000 7fa68ce2c640 1 -- 172.21.15.43:0/2609307266 shutdown_connections 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.378+0000 7fa68ce2c640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fa6680678f0 0x7fa668069db0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.378+0000 7fa68ce2c640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa688143590 0x7fa688139f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.378+0000 7fa68ce2c640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6881427c0 0x7fa688143050 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.378+0000 7fa68ce2c640 1 --2- 172.21.15.43:0/2609307266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6700039c0 0x7fa688140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.378+0000 7fa68ce2c640 1 -- 172.21.15.43:0/2609307266 >> 172.21.15.43:0/2609307266 conn(0x7fa6880b78a0 msgr2=0x7fa688074170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.378+0000 7fa68ce2c640 1 -- 172.21.15.43:0/2609307266 shutdown_connections 2024-04-24T23:08:51.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.378+0000 7fa68ce2c640 1 -- 172.21.15.43:0/2609307266 wait complete. 2024-04-24T23:08:51.400 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.510+0000 7fc851a54640 1 Processor -- start 2024-04-24T23:08:51.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.510+0000 7fc851a54640 1 -- start start 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc851a54640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc84c06be60 0x7fc84c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc851a54640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc84c145c10 0x7fc84c0b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc851a54640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc84c0b5720 con 0x7fc84c072f40 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc851a54640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc84c0b61c0 con 0x7fc84c145c10 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc851a54640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc84c0b5d30 con 0x7fc84c06be60 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc84b7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc84c145c10 0x7fc84c0b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc84b7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc84c145c10 0x7fc84c0b39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33866/0 (socket says 172.21.15.43:33866) 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc84b7fe640 1 -- 172.21.15.43:0/1677449968 learned_addr learned my addr 172.21.15.43:0/1677449968 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc84a7fc640 1 --2- 172.21.15.43:0/1677449968 >> v2:172.21.15.162:3300/0 conn(0x7fc84c06be60 0x7fc84c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc84b7fe640 1 -- 172.21.15.43:0/1677449968 >> v2:172.21.15.162:3300/0 conn(0x7fc84c06be60 msgr2=0x7fc84c0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:51.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc84b7fe640 1 --2- 172.21.15.43:0/1677449968 >> v2:172.21.15.162:3300/0 conn(0x7fc84c06be60 0x7fc84c0b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc84b7fe640 1 -- 172.21.15.43:0/1677449968 >> v1:172.21.15.162:6789/0 conn(0x7fc84c072f40 legacy=0x7fc84c145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc84b7fe640 1 -- 172.21.15.43:0/1677449968 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84c073320 con 0x7fc84c145c10 2024-04-24T23:08:51.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc84a7fc640 1 --2- 172.21.15.43:0/1677449968 >> v2:172.21.15.162:3300/0 conn(0x7fc84c06be60 0x7fc84c0b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc84b7fe640 1 --2- 172.21.15.43:0/1677449968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc84c145c10 0x7fc84c0b39c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc84c146630 tx=0x7fc84401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e15610b02fb26c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc849ffb640 1 -- 172.21.15.43:0/1677449968 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8440ab610 con 0x7fc84c145c10 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc849ffb640 1 -- 172.21.15.43:0/1677449968 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc8440b0070 con 0x7fc84c145c10 2024-04-24T23:08:51.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc849ffb640 1 -- 172.21.15.43:0/1677449968 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8440ab9f0 con 0x7fc84c145c10 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc851a54640 1 -- 172.21.15.43:0/1677449968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc84c145c10 msgr2=0x7fc84c0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc851a54640 1 --2- 172.21.15.43:0/1677449968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc84c145c10 0x7fc84c0b39c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc84c146630 tx=0x7fc84401c450 comp rx=0 tx=0).stop 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc851a54640 1 -- 172.21.15.43:0/1677449968 shutdown_connections 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc851a54640 1 --2- 172.21.15.43:0/1677449968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc84c145c10 0x7fc84c0b39c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc851a54640 1 --2- 172.21.15.43:0/1677449968 >> v2:172.21.15.162:3300/0 conn(0x7fc84c06be60 0x7fc84c0b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc851a54640 1 -- 172.21.15.43:0/1677449968 >> 172.21.15.43:0/1677449968 conn(0x7fc84c06c300 msgr2=0x7fc84c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc851a54640 1 -- 172.21.15.43:0/1677449968 shutdown_connections 2024-04-24T23:08:51.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.514+0000 7fc851a54640 1 -- 172.21.15.43:0/1677449968 wait complete. 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc851a54640 1 Processor -- start 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc851a54640 1 -- start start 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc851a54640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc84c06be60 0x7fc84c13aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc851a54640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc84c072f40 0x7fc84c13e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc851a54640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc84c145c10 0x7fc84c132c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc851a54640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c152970 con 0x7fc84c145c10 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc851a54640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c1527f0 con 0x7fc84c072f40 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc851a54640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc84c152af0 con 0x7fc84c06be60 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc84b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc84c145c10 0x7fc84c132c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc84b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc84c145c10 0x7fc84c132c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33880/0 (socket says 172.21.15.43:33880) 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc84b7fe640 1 -- 172.21.15.43:0/1058958282 learned_addr learned my addr 172.21.15.43:0/1058958282 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc84a7fc640 1 --2- 172.21.15.43:0/1058958282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc84c072f40 0x7fc84c13e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc84b7fe640 1 -- 172.21.15.43:0/1058958282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc84c06be60 msgr2=0x7fc84c13aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc84b7fe640 1 --2- 172.21.15.43:0/1058958282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc84c06be60 0x7fc84c13aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc84b7fe640 1 -- 172.21.15.43:0/1058958282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc84c072f40 msgr2=0x7fc84c13e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc84b7fe640 1 --2- 172.21.15.43:0/1058958282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc84c072f40 0x7fc84c13e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc84b7fe640 1 -- 172.21.15.43:0/1058958282 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84c13df50 con 0x7fc84c145c10 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc84b7fe640 1 --2- 172.21.15.43:0/1058958282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc84c145c10 0x7fc84c132c90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc8440ad040 tx=0x7fc84401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:51.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc833fff640 1 -- 172.21.15.43:0/1058958282 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8440b4800 con 0x7fc84c145c10 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc833fff640 1 -- 172.21.15.43:0/1058958282 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc8440abe50 con 0x7fc84c145c10 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc851a54640 1 -- 172.21.15.43:0/1058958282 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84c13e230 con 0x7fc84c145c10 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc833fff640 1 -- 172.21.15.43:0/1058958282 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8440b4c00 con 0x7fc84c145c10 2024-04-24T23:08:51.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc851a54640 1 -- 172.21.15.43:0/1058958282 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc84c13c790 con 0x7fc84c145c10 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc851a54640 1 -- 172.21.15.43:0/1058958282 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc84c04f580 con 0x7fc84c145c10 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc833fff640 1 -- 172.21.15.43:0/1058958282 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc8440c8420 con 0x7fc84c145c10 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.518+0000 7fc833fff640 1 --2- 172.21.15.43:0/1058958282 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc8380678c0 0x7fc838069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.522+0000 7fc833fff640 1 -- 172.21.15.43:0/1058958282 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fc8441209e0 con 0x7fc84c145c10 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.522+0000 7fc84affd640 1 --2- 172.21.15.43:0/1058958282 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc8380678c0 0x7fc838069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.522+0000 7fc84affd640 1 --2- 172.21.15.43:0/1058958282 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc8380678c0 0x7fc838069d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc83c007fd0 tx=0x7fc83c007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:51.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.526+0000 7fc833fff640 1 -- 172.21.15.43:0/1058958282 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc8440c4060 con 0x7fc84c145c10 2024-04-24T23:08:51.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.718+0000 7fc851a54640 1 -- 172.21.15.43:0/1058958282 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc84c0b1940 con 0x7fc84c145c10 2024-04-24T23:08:51.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.718+0000 7fc833fff640 1 -- 172.21.15.43:0/1058958282 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3529 (secure 0 0 0) 0x7fc8440a8050 con 0x7fc84c145c10 2024-04-24T23:08:51.720 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:08:51.720 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/2236776475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2236776475},{"type":"v1","addr":"172.21.15.162:6833","nonce":2236776475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-24T23:00:15.762941+0000","modified":"2024-04-24T23:00:32.909117+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6835/152091432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":152091432},{"type":"v1","addr":"172.21.15.43:6835","nonce":152091432}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-04-24T23:08:51.720 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-04-24T23:08:51.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.718+0000 7fc851a54640 1 -- 172.21.15.43:0/1058958282 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc8380678c0 msgr2=0x7fc838069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.718+0000 7fc851a54640 1 --2- 172.21.15.43:0/1058958282 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc8380678c0 0x7fc838069d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc83c007fd0 tx=0x7fc83c007d40 comp rx=0 tx=0).stop 2024-04-24T23:08:51.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.722+0000 7fc851a54640 1 -- 172.21.15.43:0/1058958282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc84c145c10 msgr2=0x7fc84c132c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.722+0000 7fc851a54640 1 --2- 172.21.15.43:0/1058958282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc84c145c10 0x7fc84c132c90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc8440ad040 tx=0x7fc84401ac90 comp rx=0 tx=0).stop 2024-04-24T23:08:51.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.722+0000 7fc851a54640 1 -- 172.21.15.43:0/1058958282 shutdown_connections 2024-04-24T23:08:51.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.722+0000 7fc851a54640 1 --2- 172.21.15.43:0/1058958282 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fc8380678c0 0x7fc838069d80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.722+0000 7fc851a54640 1 --2- 172.21.15.43:0/1058958282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc84c145c10 0x7fc84c132c90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.722+0000 7fc851a54640 1 --2- 172.21.15.43:0/1058958282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc84c072f40 0x7fc84c13e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.722+0000 7fc851a54640 1 --2- 172.21.15.43:0/1058958282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc84c06be60 0x7fc84c13aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.722+0000 7fc851a54640 1 -- 172.21.15.43:0/1058958282 >> 172.21.15.43:0/1058958282 conn(0x7fc84c06c300 msgr2=0x7fc84c0b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:51.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.722+0000 7fc851a54640 1 -- 172.21.15.43:0/1058958282 shutdown_connections 2024-04-24T23:08:51.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.722+0000 7fc851a54640 1 -- 172.21.15.43:0/1058958282 wait complete. 2024-04-24T23:08:51.737 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbc02591640 1 Processor -- start 2024-04-24T23:08:51.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbc02591640 1 -- start start 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbc02591640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbfc0b6d40 0x7fbbfc071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbc02591640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbbfc0b63b0 0x7fbbfc144220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbc02591640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbfc0711a0 con 0x7fbbfc070a40 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbc02591640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fbbfc0716d0 con 0x7fbbfc0b63b0 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbc02591640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbbfc0b7120 con 0x7fbbfc0b6d40 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbbfb7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbbfc0b63b0 0x7fbbfc144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbc00b2e640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fbbfc070a40 0x7fbbfc141200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36652/0 (socket says 172.21.15.43:36652) 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbc00b2e640 1 -- 172.21.15.43:0/1930157368 learned_addr learned my addr 172.21.15.43:0/1930157368 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbbfbfff640 1 --2- 172.21.15.43:0/1930157368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbfc0b6d40 0x7fbbfc071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbbfb7fe640 1 -- 172.21.15.43:0/1930157368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbfc0b6d40 msgr2=0x7fbbfc071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbbfb7fe640 1 --2- 172.21.15.43:0/1930157368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbfc0b6d40 0x7fbbfc071e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbbfb7fe640 1 -- 172.21.15.43:0/1930157368 >> v1:172.21.15.43:6789/0 conn(0x7fbbfc070a40 legacy=0x7fbbfc141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbbfaffd640 1 -- 172.21.15.43:0/1930157368 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4199375775 0 0) 0x7fbbfc0711a0 con 0x7fbbfc070a40 2024-04-24T23:08:51.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbbfb7fe640 1 -- 172.21.15.43:0/1930157368 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbfc070ed0 con 0x7fbbfc0b63b0 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbbfb7fe640 1 --2- 172.21.15.43:0/1930157368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc0b63b0 0x7fbbfc144220 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbbf00097c0 tx=0x7fbbf001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527d8dd917e266f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:51.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbbfaffd640 1 -- 172.21.15.43:0/1930157368 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf00b0070 con 0x7fbbfc0b63b0 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbbfaffd640 1 -- 172.21.15.43:0/1930157368 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbbf00ab600 con 0x7fbbfc0b63b0 2024-04-24T23:08:51.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.846+0000 7fbbfaffd640 1 -- 172.21.15.43:0/1930157368 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf00ab9f0 con 0x7fbbfc0b63b0 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 -- 172.21.15.43:0/1930157368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc0b63b0 msgr2=0x7fbbfc144220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 --2- 172.21.15.43:0/1930157368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc0b63b0 0x7fbbfc144220 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbbf00097c0 tx=0x7fbbf001c380 comp rx=0 tx=0).stop 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 -- 172.21.15.43:0/1930157368 shutdown_connections 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 --2- 172.21.15.43:0/1930157368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc0b63b0 0x7fbbfc144220 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 --2- 172.21.15.43:0/1930157368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbfc0b6d40 0x7fbbfc071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 -- 172.21.15.43:0/1930157368 >> 172.21.15.43:0/1930157368 conn(0x7fbbfc06c4d0 msgr2=0x7fbbfc06c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 -- 172.21.15.43:0/1930157368 shutdown_connections 2024-04-24T23:08:51.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 -- 172.21.15.43:0/1930157368 wait complete. 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 Processor -- start 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 -- start start 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc070a40 0x7fbbfc13aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbfc0b63b0 0x7fbbfc133e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbfc0b6d40 0x7fbbfc134360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc151710 con 0x7fbbfc070a40 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc151590 con 0x7fbbfc0b6d40 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbbfc151890 con 0x7fbbfc0b63b0 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbbfbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc070a40 0x7fbbfc13aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbbfbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc070a40 0x7fbbfc13aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33892/0 (socket says 172.21.15.43:33892) 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbbfbfff640 1 -- 172.21.15.43:0/3008893860 learned_addr learned my addr 172.21.15.43:0/3008893860 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbbfbfff640 1 -- 172.21.15.43:0/3008893860 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbfc0b63b0 msgr2=0x7fbbfc133e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbbfbfff640 1 --2- 172.21.15.43:0/3008893860 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbfc0b63b0 0x7fbbfc133e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbbfbfff640 1 -- 172.21.15.43:0/3008893860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbfc0b6d40 msgr2=0x7fbbfc134360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbbfbfff640 1 --2- 172.21.15.43:0/3008893860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbfc0b6d40 0x7fbbfc134360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbbfbfff640 1 -- 172.21.15.43:0/3008893860 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbfc137ae0 con 0x7fbbfc070a40 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbbfbfff640 1 --2- 172.21.15.43:0/3008893860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc070a40 0x7fbbfc13aab0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00c7f0 tx=0x7fbbec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbbf8ff9640 1 -- 172.21.15.43:0/3008893860 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec015070 con 0x7fbbfc070a40 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbbf8ff9640 1 -- 172.21.15.43:0/3008893860 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbbec007820 con 0x7fbbfc070a40 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbbf8ff9640 1 -- 172.21.15.43:0/3008893860 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec007c30 con 0x7fbbfc070a40 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 -- 172.21.15.43:0/3008893860 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbfc13b100 con 0x7fbbfc070a40 2024-04-24T23:08:51.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 -- 172.21.15.43:0/3008893860 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbfc1377e0 con 0x7fbbfc070a40 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.850+0000 7fbc02591640 1 -- 172.21.15.43:0/3008893860 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbfc04f580 con 0x7fbbfc070a40 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.854+0000 7fbbf8ff9640 1 -- 172.21.15.43:0/3008893860 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbbec018070 con 0x7fbbfc070a40 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.854+0000 7fbbf8ff9640 1 --2- 172.21.15.43:0/3008893860 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbbe80678f0 0x7fbbe8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.854+0000 7fbbf8ff9640 1 -- 172.21.15.43:0/3008893860 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7fbbec0863e0 con 0x7fbbfc070a40 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.854+0000 7fbbfb7fe640 1 --2- 172.21.15.43:0/3008893860 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbbe80678f0 0x7fbbe8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:51.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.854+0000 7fbbfb7fe640 1 --2- 172.21.15.43:0/3008893860 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbbe80678f0 0x7fbbe8069db0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbbf00ad000 tx=0x7fbbf0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:51.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:51.858+0000 7fbbf8ff9640 1 -- 172.21.15.43:0/3008893860 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fbbec056cc0 con 0x7fbbfc070a40 2024-04-24T23:08:52.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.018+0000 7fbc02591640 1 -- 172.21.15.43:0/3008893860 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbfc14e940 con 0x7fbbfc070a40 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.018+0000 7fbbf8ff9640 1 -- 172.21.15.43:0/3008893860 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18754 (secure 0 0 0) 0x7fbbec0565c0 con 0x7fbbfc070a40 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-24T23:08:52.020 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"fsid":"97891efb-e5ff-41f6-b724-29d534e60717","created":"2024-04-24T22:59:51.568348+0000","modified":"2024-04-24T23:00:57.637496+0000","last_up_change":"2024-04-24T23:00:02.322380+0000","last_in_change":"2024-04-24T22:59:53.868689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T23:00:02.322280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-24T23:00:14.136303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-24T23:00:14.764010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-24T23:00:18.504756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fcdad35-0067-4caf-ad89-01d224bc5a6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6801","nonce":4282580106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6803","nonce":4282580106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6807","nonce":4282580106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4282580106},{"type":"v1","addr":"172.21.15.43:6805","nonce":4282580106}]},"public_addr":"172.21.15.43:6801/4282580106","cluster_addr":"172.21.15.43:6803/4282580106","heartbeat_back_addr":"172.21.15.43:6807/4282580106","heartbeat_front_addr":"172.21.15.43:6805/4282580106","state":["exists","up"]},{"osd":1,"uuid":"5ba8bdb6-887f-4a96-953c-00f6c9bff92b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6809","nonce":3690422661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6811","nonce":3690422661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6815","nonce":3690422661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3690422661},{"type":"v1","addr":"172.21.15.43:6813","nonce":3690422661}]},"public_addr":"172.21.15.43:6809/3690422661","cluster_addr":"172.21.15.43:6811/3690422661","heartbeat_back_addr":"172.21.15.43:6815/3690422661","heartbeat_front_addr":"172.21.15.43:6813/3690422661","state":["exists","up"]},{"osd":2,"uuid":"90a65037-45c9-4627-88ce-793d48a647dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6817","nonce":1769132304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6820","nonce":1769132304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6826","nonce":1769132304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1769132304},{"type":"v1","addr":"172.21.15.43:6823","nonce":1769132304}]},"public_addr":"172.21.15.43:6817/1769132304","cluster_addr":"172.21.15.43:6820/1769132304","heartbeat_back_addr":"172.21.15.43:6826/1769132304","heartbeat_front_addr":"172.21.15.43:6823/1769132304","state":["exists","up"]},{"osd":3,"uuid":"616f92c4-db5d-4167-8d08-c7a9d999fe81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6821","nonce":451290605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6827","nonce":451290605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6831","nonce":451290605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":451290605},{"type":"v1","addr":"172.21.15.43:6829","nonce":451290605}]},"public_addr":"172.21.15.43:6821/451290605","cluster_addr":"172.21.15.43:6827/451290605","heartbeat_back_addr":"172.21.15.43:6831/451290605","heartbeat_front_addr":"172.21.15.43:6829/451290605","state":["exists","up"]},{"osd":4,"uuid":"1067858b-54f4-4223-aef0-d91d33711fd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6801","nonce":2854620223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6805","nonce":2854620223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6815","nonce":2854620223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2854620223},{"type":"v1","addr":"172.21.15.162:6811","nonce":2854620223}]},"public_addr":"172.21.15.162:6801/2854620223","cluster_addr":"172.21.15.162:6805/2854620223","heartbeat_back_addr":"172.21.15.162:6815/2854620223","heartbeat_front_addr":"172.21.15.162:6811/2854620223","state":["exists","up"]},{"osd":5,"uuid":"781ecc98-c6be-4e7a-bacc-afd91a7e8bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6809","nonce":4243337477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6816","nonce":4243337477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6823","nonce":4243337477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4243337477},{"type":"v1","addr":"172.21.15.162:6820","nonce":4243337477}]},"public_addr":"172.21.15.162:6809/4243337477","cluster_addr":"172.21.15.162:6816/4243337477","heartbeat_back_addr":"172.21.15.162:6823/4243337477","heartbeat_front_addr":"172.21.15.162:6820/4243337477","state":["exists","up"]},{"osd":6,"uuid":"7819a72c-42d8-4699-b5da-c2321f36bab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6825","nonce":4054273326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6827","nonce":4054273326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6831","nonce":4054273326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":4054273326},{"type":"v1","addr":"172.21.15.162:6829","nonce":4054273326}]},"public_addr":"172.21.15.162:6825/4054273326","cluster_addr":"172.21.15.162:6827/4054273326","heartbeat_back_addr":"172.21.15.162:6831/4054273326","heartbeat_front_addr":"172.21.15.162:6829/4054273326","state":["exists","up"]},{"osd":7,"uuid":"11f817d6-d19a-4326-aa63-61a72c39f5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6804","nonce":2526900120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6810","nonce":2526900120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6819","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6821","nonce":2526900120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2526900120},{"type":"v1","addr":"172.21.15.162:6817","nonce":2526900120}]},"public_addr":"172.21.15.162:6804/2526900120","cluster_addr":"172.21.15.162:6810/2526900120","heartbeat_back_addr":"172.21.15.162:6821/2526900120","heartbeat_front_addr":"172.21.15.162:6817/2526900120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.407557+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.398711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.411891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.377311+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.320235+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.176742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.435122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T22:59:59.508714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":5}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.1a","mappings":[{"from":7,"to":4}]},{"pgid":"4.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.022+0000 7fbc02591640 1 -- 172.21.15.43:0/3008893860 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbbe80678f0 msgr2=0x7fbbe8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.022+0000 7fbc02591640 1 --2- 172.21.15.43:0/3008893860 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbbe80678f0 0x7fbbe8069db0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbbf00ad000 tx=0x7fbbf0008040 comp rx=0 tx=0).stop 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.022+0000 7fbc02591640 1 -- 172.21.15.43:0/3008893860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc070a40 msgr2=0x7fbbfc13aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.022+0000 7fbc02591640 1 --2- 172.21.15.43:0/3008893860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc070a40 0x7fbbfc13aab0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00c7f0 tx=0x7fbbec00ccb0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.022+0000 7fbc02591640 1 -- 172.21.15.43:0/3008893860 shutdown_connections 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.022+0000 7fbc02591640 1 --2- 172.21.15.43:0/3008893860 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbbe80678f0 0x7fbbe8069db0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.022+0000 7fbc02591640 1 --2- 172.21.15.43:0/3008893860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbfc0b6d40 0x7fbbfc134360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.022+0000 7fbc02591640 1 --2- 172.21.15.43:0/3008893860 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbfc0b63b0 0x7fbbfc133e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.022+0000 7fbc02591640 1 --2- 172.21.15.43:0/3008893860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc070a40 0x7fbbfc13aab0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.022+0000 7fbc02591640 1 -- 172.21.15.43:0/3008893860 >> 172.21.15.43:0/3008893860 conn(0x7fbbfc06c4d0 msgr2=0x7fbbfc0b9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.022+0000 7fbc02591640 1 -- 172.21.15.43:0/3008893860 shutdown_connections 2024-04-24T23:08:52.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.022+0000 7fbc02591640 1 -- 172.21.15.43:0/3008893860 wait complete. 2024-04-24T23:08:52.040 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.170+0000 7f429f691640 1 Processor -- start 2024-04-24T23:08:52.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.170+0000 7f429f691640 1 -- start start 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.170+0000 7f429f691640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f42980b72a0 0x7f429814fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.170+0000 7f429f691640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42980b76f0 con 0x7f4298061e90 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.170+0000 7f429f691640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4298144590 con 0x7f4298145070 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.170+0000 7f429f691640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f4298144be0 con 0x7f42980b72a0 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.170+0000 7f429d42d640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4298061e90 0x7f429813e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36654/0 (socket says 172.21.15.43:36654) 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.170+0000 7f429d42d640 1 -- 172.21.15.43:0/4259558143 learned_addr learned my addr 172.21.15.43:0/4259558143 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.170+0000 7f429dc2e640 1 --2- 172.21.15.43:0/4259558143 >> v2:172.21.15.43:3300/0 conn(0x7f42980b72a0 0x7f429814fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.170+0000 7f429dc2e640 1 -- 172.21.15.43:0/4259558143 >> v1:172.21.15.162:6789/0 conn(0x7f4298145070 legacy=0x7f42980b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.170+0000 7f429dc2e640 1 -- 172.21.15.43:0/4259558143 >> v1:172.21.15.43:6789/0 conn(0x7f4298061e90 legacy=0x7f429813e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:52.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.170+0000 7f429dc2e640 1 -- 172.21.15.43:0/4259558143 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4298144870 con 0x7f42980b72a0 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429dc2e640 1 --2- 172.21.15.43:0/4259558143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42980b72a0 0x7f429814fd30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f42940097c0 tx=0x7f429401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611b469d0706adf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f428ffff640 1 -- 172.21.15.43:0/4259558143 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42940b0070 con 0x7f42980b72a0 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f428ffff640 1 -- 172.21.15.43:0/4259558143 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f42940ab600 con 0x7f42980b72a0 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f428ffff640 1 -- 172.21.15.43:0/4259558143 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42940ab9f0 con 0x7f42980b72a0 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 -- 172.21.15.43:0/4259558143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42980b72a0 msgr2=0x7f429814fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 --2- 172.21.15.43:0/4259558143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42980b72a0 0x7f429814fd30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f42940097c0 tx=0x7f429401c3d0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 -- 172.21.15.43:0/4259558143 shutdown_connections 2024-04-24T23:08:52.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 --2- 172.21.15.43:0/4259558143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42980b72a0 0x7f429814fd30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 -- 172.21.15.43:0/4259558143 >> 172.21.15.43:0/4259558143 conn(0x7f429809b250 msgr2=0x7f429809b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 -- 172.21.15.43:0/4259558143 shutdown_connections 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 -- 172.21.15.43:0/4259558143 wait complete. 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 Processor -- start 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 -- start start 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4298061e90 0x7f4298073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42980b72a0 0x7f42981407b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4298145070 0x7f429813fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f42980b4730 con 0x7f42980b72a0 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42980b45b0 con 0x7f4298145070 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4298152a90 con 0x7f4298061e90 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429cc2c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42980b72a0 0x7f42981407b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429cc2c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42980b72a0 0x7f42981407b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33914/0 (socket says 172.21.15.43:33914) 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429cc2c640 1 -- 172.21.15.43:0/59208548 learned_addr learned my addr 172.21.15.43:0/59208548 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:52.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429dc2e640 1 --2- 172.21.15.43:0/59208548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4298145070 0x7f429813fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429d42d640 1 --2- 172.21.15.43:0/59208548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4298061e90 0x7f4298073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429cc2c640 1 -- 172.21.15.43:0/59208548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4298061e90 msgr2=0x7f4298073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429cc2c640 1 --2- 172.21.15.43:0/59208548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4298061e90 0x7f4298073ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429cc2c640 1 -- 172.21.15.43:0/59208548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4298145070 msgr2=0x7f429813fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429cc2c640 1 --2- 172.21.15.43:0/59208548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4298145070 0x7f429813fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429cc2c640 1 -- 172.21.15.43:0/59208548 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42981455e0 con 0x7f42980b72a0 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429cc2c640 1 --2- 172.21.15.43:0/59208548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42980b72a0 0x7f42981407b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f428800b3f0 tx=0x7f428800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f428dffb640 1 -- 172.21.15.43:0/59208548 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288015020 con 0x7f42980b72a0 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f428dffb640 1 -- 172.21.15.43:0/59208548 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4288011850 con 0x7f42980b72a0 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 -- 172.21.15.43:0/59208548 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42980b2d90 con 0x7f42980b72a0 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f428dffb640 1 -- 172.21.15.43:0/59208548 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288011c60 con 0x7f42980b72a0 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.174+0000 7f429f691640 1 -- 172.21.15.43:0/59208548 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4298145c70 con 0x7f42980b72a0 2024-04-24T23:08:52.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.178+0000 7f42837fe640 1 -- 172.21.15.43:0/59208548 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42700052a0 con 0x7f42980b72a0 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.178+0000 7f428dffb640 1 -- 172.21.15.43:0/59208548 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4288018020 con 0x7f42980b72a0 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.178+0000 7f428dffb640 1 --2- 172.21.15.43:0/59208548 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f427c0678f0 0x7f427c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.178+0000 7f429d42d640 1 --2- 172.21.15.43:0/59208548 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f427c0678f0 0x7f427c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.178+0000 7f428dffb640 1 -- 172.21.15.43:0/59208548 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6677+0+0 (secure 0 0 0) 0x7f4288085c40 con 0x7f42980b72a0 2024-04-24T23:08:52.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.178+0000 7f429d42d640 1 --2- 172.21.15.43:0/59208548 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f427c0678f0 0x7f427c069db0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f429814fde0 tx=0x7f4290009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:52.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.182+0000 7f428dffb640 1 -- 172.21.15.43:0/59208548 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f42880202a0 con 0x7f42980b72a0 2024-04-24T23:08:52.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.370+0000 7f42837fe640 1 -- 172.21.15.43:0/59208548 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4270005860 con 0x7f42980b72a0 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.374+0000 7f428dffb640 1 -- 172.21.15.43:0/59208548 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f4288056440 con 0x7f42980b72a0 2024-04-24T23:08:52.376 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.378+0000 7f42837fe640 1 -- 172.21.15.43:0/59208548 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f427c0678f0 msgr2=0x7f427c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.378+0000 7f42837fe640 1 --2- 172.21.15.43:0/59208548 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f427c0678f0 0x7f427c069db0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f429814fde0 tx=0x7f4290009040 comp rx=0 tx=0).stop 2024-04-24T23:08:52.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.378+0000 7f42837fe640 1 -- 172.21.15.43:0/59208548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42980b72a0 msgr2=0x7f42981407b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.378+0000 7f42837fe640 1 --2- 172.21.15.43:0/59208548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42980b72a0 0x7f42981407b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f428800b3f0 tx=0x7f428800b8b0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.378+0000 7f42837fe640 1 -- 172.21.15.43:0/59208548 shutdown_connections 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.378+0000 7f42837fe640 1 --2- 172.21.15.43:0/59208548 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f427c0678f0 0x7f427c069db0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.378+0000 7f42837fe640 1 --2- 172.21.15.43:0/59208548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4298145070 0x7f429813fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.378+0000 7f42837fe640 1 --2- 172.21.15.43:0/59208548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42980b72a0 0x7f42981407b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.378+0000 7f42837fe640 1 --2- 172.21.15.43:0/59208548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4298061e90 0x7f4298073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.378+0000 7f42837fe640 1 -- 172.21.15.43:0/59208548 >> 172.21.15.43:0/59208548 conn(0x7f429809b250 msgr2=0x7f4298143b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.378+0000 7f42837fe640 1 -- 172.21.15.43:0/59208548 shutdown_connections 2024-04-24T23:08:52.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.378+0000 7f42837fe640 1 -- 172.21.15.43:0/59208548 wait complete. 2024-04-24T23:08:52.404 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-24T23:08:52.458 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.514+0000 7fbcfd0fd640 1 Processor -- start 2024-04-24T23:08:52.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.514+0000 7fbcfd0fd640 1 -- start start 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.514+0000 7fbcfd0fd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbcf80bd810 0x7fbcf80b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.514+0000 7fbcfd0fd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf814aef0 0x7fbcf8151e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.514+0000 7fbcfd0fd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf814b340 con 0x7fbcf814aab0 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.514+0000 7fbcfd0fd640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf80bdbf0 con 0x7fbcf80bd810 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.514+0000 7fbcfd0fd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf80b4670 con 0x7fbcf814aef0 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.514+0000 7fbcf6d9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbcf80bd810 0x7fbcf80b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.514+0000 7fbcf6d9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbcf80bd810 0x7fbcf80b5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33940/0 (socket says 172.21.15.43:33940) 2024-04-24T23:08:52.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.514+0000 7fbcf6d9d640 1 -- 172.21.15.43:0/1972111473 learned_addr learned my addr 172.21.15.43:0/1972111473 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.514+0000 7fbcf759e640 1 --2- 172.21.15.43:0/1972111473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf814aef0 0x7fbcf8151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.514+0000 7fbcf6d9d640 1 -- 172.21.15.43:0/1972111473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf814aef0 msgr2=0x7fbcf8151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.514+0000 7fbcf6d9d640 1 --2- 172.21.15.43:0/1972111473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf814aef0 0x7fbcf8151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.514+0000 7fbcf6d9d640 1 -- 172.21.15.43:0/1972111473 >> v1:172.21.15.162:6789/0 conn(0x7fbcf814aab0 legacy=0x7fbcf8141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:52.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.514+0000 7fbcf6d9d640 1 -- 172.21.15.43:0/1972111473 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf80b4950 con 0x7fbcf80bd810 2024-04-24T23:08:52.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.518+0000 7fbcf6d9d640 1 --2- 172.21.15.43:0/1972111473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf80bd810 0x7fbcf80b5af0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009870 tx=0x7fbce801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3f4fe3ce3228fb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.518+0000 7fbcf659c640 1 -- 172.21.15.43:0/1972111473 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce80a7070 con 0x7fbcf80bd810 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.518+0000 7fbcf659c640 1 -- 172.21.15.43:0/1972111473 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbce80b0070 con 0x7fbcf80bd810 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.518+0000 7fbcf659c640 1 -- 172.21.15.43:0/1972111473 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce80ab8b0 con 0x7fbcf80bd810 2024-04-24T23:08:52.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.518+0000 7fbcfd0fd640 1 -- 172.21.15.43:0/1972111473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf80bd810 msgr2=0x7fbcf80b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.518+0000 7fbcfd0fd640 1 --2- 172.21.15.43:0/1972111473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf80bd810 0x7fbcf80b5af0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009870 tx=0x7fbce801c560 comp rx=0 tx=0).stop 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.518+0000 7fbcfd0fd640 1 -- 172.21.15.43:0/1972111473 shutdown_connections 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.518+0000 7fbcfd0fd640 1 --2- 172.21.15.43:0/1972111473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf814aef0 0x7fbcf8151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.518+0000 7fbcfd0fd640 1 --2- 172.21.15.43:0/1972111473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf80bd810 0x7fbcf80b5af0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.518+0000 7fbcfd0fd640 1 -- 172.21.15.43:0/1972111473 >> 172.21.15.43:0/1972111473 conn(0x7fbcf8072f20 msgr2=0x7fbcf80bcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.518+0000 7fbcfd0fd640 1 -- 172.21.15.43:0/1972111473 shutdown_connections 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.518+0000 7fbcfd0fd640 1 -- 172.21.15.43:0/1972111473 wait complete. 2024-04-24T23:08:52.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.518+0000 7fbcfd0fd640 1 Processor -- start 2024-04-24T23:08:52.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.518+0000 7fbcfd0fd640 1 -- start start 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcfd0fd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf80bd810 0x7fbcf80bbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcfd0fd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf814aab0 0x7fbcf8138500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcfd0fd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf814aef0 0x7fbcf813a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcfd0fd640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf8141b90 con 0x7fbcf814aef0 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcfd0fd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf8141a10 con 0x7fbcf80bd810 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcfd0fd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf8154ba0 con 0x7fbcf814aab0 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcf759e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf814aef0 0x7fbcf813a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcf759e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf814aef0 0x7fbcf813a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33946/0 (socket says 172.21.15.43:33946) 2024-04-24T23:08:52.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcf759e640 1 -- 172.21.15.43:0/1890456550 learned_addr learned my addr 172.21.15.43:0/1890456550 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcf6d9d640 1 --2- 172.21.15.43:0/1890456550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf80bd810 0x7fbcf80bbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcee59c640 1 --2- 172.21.15.43:0/1890456550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf814aab0 0x7fbcf8138500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcf759e640 1 -- 172.21.15.43:0/1890456550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf814aab0 msgr2=0x7fbcf8138500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcf759e640 1 --2- 172.21.15.43:0/1890456550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf814aab0 0x7fbcf8138500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcf759e640 1 -- 172.21.15.43:0/1890456550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf80bd810 msgr2=0x7fbcf80bbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcf759e640 1 --2- 172.21.15.43:0/1890456550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf80bd810 0x7fbcf80bbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcf759e640 1 -- 172.21.15.43:0/1890456550 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf8146290 con 0x7fbcf814aef0 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcf759e640 1 --2- 172.21.15.43:0/1890456550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf814aef0 0x7fbcf813a440 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0007e70 tx=0x7fbcf000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbceffff640 1 -- 172.21.15.43:0/1890456550 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0014620 con 0x7fbcf814aef0 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbceffff640 1 -- 172.21.15.43:0/1890456550 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbcf0019070 con 0x7fbcf814aef0 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcfd0fd640 1 -- 172.21.15.43:0/1890456550 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf813bde0 con 0x7fbcf814aef0 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbceffff640 1 -- 172.21.15.43:0/1890456550 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0014a40 con 0x7fbcf814aef0 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcfd0fd640 1 -- 172.21.15.43:0/1890456550 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf81e1010 con 0x7fbcf814aef0 2024-04-24T23:08:52.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcfd0fd640 1 -- 172.21.15.43:0/1890456550 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf804f580 con 0x7fbcf814aef0 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbceffff640 1 -- 172.21.15.43:0/1890456550 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbcf0014be0 con 0x7fbcf814aef0 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbceffff640 1 --2- 172.21.15.43:0/1890456550 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbcd80678c0 0x7fbcd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbceffff640 1 -- 172.21.15.43:0/1890456550 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6763+0+0 (secure 0 0 0) 0x7fbcf0086a90 con 0x7fbcf814aef0 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.522+0000 7fbcf6d9d640 1 --2- 172.21.15.43:0/1890456550 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbcd80678c0 0x7fbcd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:52.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.526+0000 7fbcf6d9d640 1 --2- 172.21.15.43:0/1890456550 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbcd80678c0 0x7fbcd8069d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbce80af000 tx=0x7fbce80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:52.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.530+0000 7fbceffff640 1 -- 172.21.15.43:0/1890456550 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fbcf0011260 con 0x7fbcf814aef0 2024-04-24T23:08:52.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:52.726+0000 7fbcfd0fd640 1 -- 172.21.15.43:0/1890456550 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fbcf80b5880 con 0x7fbcf814aef0 2024-04-24T23:08:53.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.382+0000 7fbceffff640 1 -- 172.21.15.43:0/1890456550 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fbcf0057110 con 0x7fbcf814aef0 2024-04-24T23:08:53.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.386+0000 7fbcfd0fd640 1 -- 172.21.15.43:0/1890456550 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbcd80678c0 msgr2=0x7fbcd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:53.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.386+0000 7fbcfd0fd640 1 --2- 172.21.15.43:0/1890456550 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbcd80678c0 0x7fbcd8069d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbce80af000 tx=0x7fbce80a7000 comp rx=0 tx=0).stop 2024-04-24T23:08:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.386+0000 7fbcfd0fd640 1 -- 172.21.15.43:0/1890456550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf814aef0 msgr2=0x7fbcf813a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.386+0000 7fbcfd0fd640 1 --2- 172.21.15.43:0/1890456550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf814aef0 0x7fbcf813a440 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0007e70 tx=0x7fbcf000e4b0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.386+0000 7fbcfd0fd640 1 -- 172.21.15.43:0/1890456550 shutdown_connections 2024-04-24T23:08:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.386+0000 7fbcfd0fd640 1 --2- 172.21.15.43:0/1890456550 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7fbcd80678c0 0x7fbcd8069d80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.386+0000 7fbcfd0fd640 1 --2- 172.21.15.43:0/1890456550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcf814aef0 0x7fbcf813a440 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.386+0000 7fbcfd0fd640 1 --2- 172.21.15.43:0/1890456550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcf814aab0 0x7fbcf8138500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.386+0000 7fbcfd0fd640 1 --2- 172.21.15.43:0/1890456550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcf80bd810 0x7fbcf80bbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.386+0000 7fbcfd0fd640 1 -- 172.21.15.43:0/1890456550 >> 172.21.15.43:0/1890456550 conn(0x7fbcf8072f20 msgr2=0x7fbcf81457b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.386+0000 7fbcfd0fd640 1 -- 172.21.15.43:0/1890456550 shutdown_connections 2024-04-24T23:08:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.386+0000 7fbcfd0fd640 1 -- 172.21.15.43:0/1890456550 wait complete. 2024-04-24T23:08:53.404 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-24T23:08:53.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f062acf4640 1 Processor -- start 2024-04-24T23:08:53.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f062acf4640 1 -- start start 2024-04-24T23:08:53.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f062acf4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0624145c50 0x7f0624150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:53.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f062acf4640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06240705f0 con 0x7f062406f430 2024-04-24T23:08:53.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f062acf4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06240b6b00 con 0x7f0624073080 2024-04-24T23:08:53.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f062acf4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f06240b68b0 con 0x7f0624145c50 2024-04-24T23:08:53.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f0628a90640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f062406f430 0x7f06240b17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36662/0 (socket says 172.21.15.43:36662) 2024-04-24T23:08:53.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f0628a90640 1 -- 172.21.15.43:0/3283702583 learned_addr learned my addr 172.21.15.43:0/3283702583 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:53.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f0629291640 1 --2- 172.21.15.43:0/3283702583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0624145c50 0x7f0624150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:53.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f06237fe640 1 -- 172.21.15.43:0/3283702583 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 529357688 0 0) 0x7f06240705f0 con 0x7f062406f430 2024-04-24T23:08:53.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f06237fe640 1 -- 172.21.15.43:0/3283702583 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f060c003530 con 0x7f062406f430 2024-04-24T23:08:53.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f06237fe640 1 -- 172.21.15.43:0/3283702583 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2473954368 0 0) 0x7f060c003530 con 0x7f062406f430 2024-04-24T23:08:53.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f06237fe640 1 -- 172.21.15.43:0/3283702583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0624145c50 msgr2=0x7f0624150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:53.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f06237fe640 1 --2- 172.21.15.43:0/3283702583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0624145c50 0x7f0624150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f06237fe640 1 -- 172.21.15.43:0/3283702583 >> v1:172.21.15.162:6789/0 conn(0x7f0624073080 legacy=0x7f0624145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:53.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f06237fe640 1 -- 172.21.15.43:0/3283702583 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06240b6de0 con 0x7f062406f430 2024-04-24T23:08:53.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f06237fe640 1 -- 172.21.15.43:0/3283702583 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f0614001a00 con 0x7f062406f430 2024-04-24T23:08:53.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f06237fe640 1 -- 172.21.15.43:0/3283702583 >> v1:172.21.15.43:6789/0 conn(0x7f062406f430 legacy=0x7f06240b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:53.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f06237fe640 1 --2- 172.21.15.43:0/3283702583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f060c0039f0 0x7f060c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:53.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f06237fe640 1 --2- 172.21.15.43:0/3283702583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0624145c50 0x7f060c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:53.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f06237fe640 1 --2- 172.21.15.43:0/3283702583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f060c004d50 0x7f060c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:53.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f06237fe640 1 -- 172.21.15.43:0/3283702583 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f06240b68b0 con 0x7f060c004d50 2024-04-24T23:08:53.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f06237fe640 1 -- 172.21.15.43:0/3283702583 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f060c00bb90 con 0x7f060c0039f0 2024-04-24T23:08:53.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.522+0000 7f06237fe640 1 -- 172.21.15.43:0/3283702583 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f060c00bd90 con 0x7f0624145c50 2024-04-24T23:08:53.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f0629291640 1 --2- 172.21.15.43:0/3283702583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f060c004d50 0x7f060c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:53.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f0623fff640 1 --2- 172.21.15.43:0/3283702583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0624145c50 0x7f060c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:53.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f0628a90640 1 --2- 172.21.15.43:0/3283702583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f060c0039f0 0x7f060c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:53.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f0629291640 1 -- 172.21.15.43:0/3283702583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0624145c50 msgr2=0x7f060c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:53.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f0629291640 1 --2- 172.21.15.43:0/3283702583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0624145c50 0x7f060c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f0629291640 1 -- 172.21.15.43:0/3283702583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f060c0039f0 msgr2=0x7f060c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:53.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f0629291640 1 --2- 172.21.15.43:0/3283702583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f060c0039f0 0x7f060c003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f0629291640 1 -- 172.21.15.43:0/3283702583 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060c003530 con 0x7f060c004d50 2024-04-24T23:08:53.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f0623fff640 1 --2- 172.21.15.43:0/3283702583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0624145c50 0x7f060c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:53.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f0629291640 1 --2- 172.21.15.43:0/3283702583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f060c004d50 0x7f060c0051d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f061c009ac0 tx=0x7f061c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6e17d6ec08583a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:53.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f06237fe640 1 -- 172.21.15.43:0/3283702583 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c0b2070 con 0x7f060c004d50 2024-04-24T23:08:53.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f06237fe640 1 -- 172.21.15.43:0/3283702583 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f061c0a55c0 con 0x7f060c004d50 2024-04-24T23:08:53.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f06237fe640 1 -- 172.21.15.43:0/3283702583 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c009690 con 0x7f060c004d50 2024-04-24T23:08:53.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f062acf4640 1 -- 172.21.15.43:0/3283702583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f060c004d50 msgr2=0x7f060c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:53.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f062acf4640 1 --2- 172.21.15.43:0/3283702583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f060c004d50 0x7f060c0051d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f061c009ac0 tx=0x7f061c01ca00 comp rx=0 tx=0).stop 2024-04-24T23:08:53.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f0629291640 1 -- 172.21.15.43:0/3283702583 reap_dead start 2024-04-24T23:08:53.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f062acf4640 1 -- 172.21.15.43:0/3283702583 shutdown_connections 2024-04-24T23:08:53.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f062acf4640 1 -- 172.21.15.43:0/3283702583 >> 172.21.15.43:0/3283702583 conn(0x7f06240b7880 msgr2=0x7f06240b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:53.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f062acf4640 1 -- 172.21.15.43:0/3283702583 shutdown_connections 2024-04-24T23:08:53.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.526+0000 7f062acf4640 1 -- 172.21.15.43:0/3283702583 wait complete. 2024-04-24T23:08:53.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f062acf4640 1 Processor -- start 2024-04-24T23:08:53.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f062acf4640 1 -- start start 2024-04-24T23:08:53.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f062acf4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f062413b6c0 0x7f062413baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:53.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f062acf4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06241ddc80 0x7f06241de0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:53.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f062acf4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06241e0d50 0x7f06241e11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:53.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f062acf4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0624070340 con 0x7f06241ddc80 2024-04-24T23:08:53.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f062acf4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f06240701c0 con 0x7f06241e0d50 2024-04-24T23:08:53.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f062acf4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f06241514f0 con 0x7f062413b6c0 2024-04-24T23:08:53.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f0623fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06241ddc80 0x7f06241de0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:53.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f0623fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06241ddc80 0x7f06241de0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33966/0 (socket says 172.21.15.43:33966) 2024-04-24T23:08:53.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f0623fff640 1 -- 172.21.15.43:0/2428144049 learned_addr learned my addr 172.21.15.43:0/2428144049 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:53.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f0629291640 1 --2- 172.21.15.43:0/2428144049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06241e0d50 0x7f06241e11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:53.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f0628a90640 1 --2- 172.21.15.43:0/2428144049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f062413b6c0 0x7f062413baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:53.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f0623fff640 1 -- 172.21.15.43:0/2428144049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f062413b6c0 msgr2=0x7f062413baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:53.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f0623fff640 1 --2- 172.21.15.43:0/2428144049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f062413b6c0 0x7f062413baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f0623fff640 1 -- 172.21.15.43:0/2428144049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06241e0d50 msgr2=0x7f06241e11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:53.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f0623fff640 1 --2- 172.21.15.43:0/2428144049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06241e0d50 0x7f06241e11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:53.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f0623fff640 1 -- 172.21.15.43:0/2428144049 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06241dd7e0 con 0x7f06241ddc80 2024-04-24T23:08:53.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f0629291640 1 --2- 172.21.15.43:0/2428144049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06241e0d50 0x7f06241e11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:53.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f0623fff640 1 --2- 172.21.15.43:0/2428144049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06241ddc80 0x7f06241de0e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f061800d7a0 tx=0x7f061800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:53.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f06217fa640 1 -- 172.21.15.43:0/2428144049 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0618005070 con 0x7f06241ddc80 2024-04-24T23:08:53.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f06217fa640 1 -- 172.21.15.43:0/2428144049 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0618005210 con 0x7f06241ddc80 2024-04-24T23:08:53.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f062acf4640 1 -- 172.21.15.43:0/2428144049 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06241de620 con 0x7f06241ddc80 2024-04-24T23:08:53.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f06217fa640 1 -- 172.21.15.43:0/2428144049 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0618007030 con 0x7f06241ddc80 2024-04-24T23:08:53.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f062acf4640 1 -- 172.21.15.43:0/2428144049 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06240b2500 con 0x7f06241ddc80 2024-04-24T23:08:53.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f062acf4640 1 -- 172.21.15.43:0/2428144049 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f062404f580 con 0x7f06241ddc80 2024-04-24T23:08:53.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f06217fa640 1 -- 172.21.15.43:0/2428144049 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f061801a020 con 0x7f06241ddc80 2024-04-24T23:08:53.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f06217fa640 1 --2- 172.21.15.43:0/2428144049 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f06100678f0 0x7f0610069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:53.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f06217fa640 1 -- 172.21.15.43:0/2428144049 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6763+0+0 (secure 0 0 0) 0x7f06180857a0 con 0x7f06241ddc80 2024-04-24T23:08:53.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.530+0000 7f0628a90640 1 --2- 172.21.15.43:0/2428144049 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f06100678f0 0x7f0610069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:53.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.534+0000 7f0628a90640 1 --2- 172.21.15.43:0/2428144049 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f06100678f0 0x7f0610069db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0614001bf0 tx=0x7f0614009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:53.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.538+0000 7f06217fa640 1 -- 172.21.15.43:0/2428144049 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f0618021020 con 0x7f06241ddc80 2024-04-24T23:08:53.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:53.694+0000 7f062acf4640 1 -- 172.21.15.43:0/2428144049 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f062413aff0 con 0x7f06241ddc80 2024-04-24T23:08:54.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.702+0000 7f06217fa640 1 -- 172.21.15.43:0/2428144049 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7f06241dd7e0 con 0x7f06241ddc80 2024-04-24T23:08:54.705 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2024-04-24T23:08:54.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.706+0000 7f062acf4640 1 -- 172.21.15.43:0/2428144049 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f06100678f0 msgr2=0x7f0610069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.706+0000 7f062acf4640 1 --2- 172.21.15.43:0/2428144049 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f06100678f0 0x7f0610069db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0614001bf0 tx=0x7f0614009040 comp rx=0 tx=0).stop 2024-04-24T23:08:54.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.706+0000 7f062acf4640 1 -- 172.21.15.43:0/2428144049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06241ddc80 msgr2=0x7f06241de0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.706+0000 7f062acf4640 1 --2- 172.21.15.43:0/2428144049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06241ddc80 0x7f06241de0e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f061800d7a0 tx=0x7f061800dc60 comp rx=0 tx=0).stop 2024-04-24T23:08:54.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.706+0000 7f062acf4640 1 -- 172.21.15.43:0/2428144049 shutdown_connections 2024-04-24T23:08:54.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.706+0000 7f062acf4640 1 --2- 172.21.15.43:0/2428144049 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f06100678f0 0x7f0610069db0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.706+0000 7f062acf4640 1 --2- 172.21.15.43:0/2428144049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06241e0d50 0x7f06241e11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.706+0000 7f062acf4640 1 --2- 172.21.15.43:0/2428144049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06241ddc80 0x7f06241de0e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.706+0000 7f062acf4640 1 --2- 172.21.15.43:0/2428144049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f062413b6c0 0x7f062413baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.706+0000 7f062acf4640 1 -- 172.21.15.43:0/2428144049 >> 172.21.15.43:0/2428144049 conn(0x7f06240b7880 msgr2=0x7f06240b8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:54.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.710+0000 7f062acf4640 1 -- 172.21.15.43:0/2428144049 shutdown_connections 2024-04-24T23:08:54.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.710+0000 7f062acf4640 1 -- 172.21.15.43:0/2428144049 wait complete. 2024-04-24T23:08:54.733 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-24T23:08:54.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f2943418640 1 Processor -- start 2024-04-24T23:08:54.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f2943418640 1 -- start start 2024-04-24T23:08:54.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f2943418640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293c073080 0x7f293c145540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f2943418640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f293c145ef0 con 0x7f293c145a80 2024-04-24T23:08:54.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f2943418640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f293c0705f0 con 0x7f293c06f430 2024-04-24T23:08:54.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f2943418640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f293c0b68b0 con 0x7f293c073080 2024-04-24T23:08:54.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f29419b5640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f293c145a80 0x7f293c14fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36678/0 (socket says 172.21.15.43:36678) 2024-04-24T23:08:54.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f29419b5640 1 -- 172.21.15.43:0/175692579 learned_addr learned my addr 172.21.15.43:0/175692579 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-04-24T23:08:54.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f29409b3640 1 --2- 172.21.15.43:0/175692579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293c073080 0x7f293c145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f293bfff640 1 -- 172.21.15.43:0/175692579 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3975448635 0 0) 0x7f293c145ef0 con 0x7f293c145a80 2024-04-24T23:08:54.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f293bfff640 1 -- 172.21.15.43:0/175692579 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2924003530 con 0x7f293c145a80 2024-04-24T23:08:54.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f293bfff640 1 -- 172.21.15.43:0/175692579 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 168200535 0 0) 0x7f2924003530 con 0x7f293c145a80 2024-04-24T23:08:54.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f293bfff640 1 -- 172.21.15.43:0/175692579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293c073080 msgr2=0x7f293c145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:54.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f293bfff640 1 --2- 172.21.15.43:0/175692579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293c073080 0x7f293c145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f293bfff640 1 -- 172.21.15.43:0/175692579 >> v1:172.21.15.162:6789/0 conn(0x7f293c06f430 legacy=0x7f293c0b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f293bfff640 1 -- 172.21.15.43:0/175692579 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293c0b6b00 con 0x7f293c145a80 2024-04-24T23:08:54.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f293bfff640 1 -- 172.21.15.43:0/175692579 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1344724387 0 0) 0x7f292c001a00 con 0x7f293c145a80 2024-04-24T23:08:54.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f29409b3640 1 --2- 172.21.15.43:0/175692579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293c073080 0x7f293c145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-24T23:08:54.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f293bfff640 1 -- 172.21.15.43:0/175692579 >> v1:172.21.15.43:6789/0 conn(0x7f293c145a80 legacy=0x7f293c14fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f293bfff640 1 --2- 172.21.15.43:0/175692579 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29240039f0 0x7f2924003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f293bfff640 1 --2- 172.21.15.43:0/175692579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2924004810 0x7f2924004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f293bfff640 1 --2- 172.21.15.43:0/175692579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293c073080 0x7f292400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f293bfff640 1 -- 172.21.15.43:0/175692579 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f293c0b68b0 con 0x7f29240039f0 2024-04-24T23:08:54.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f293bfff640 1 -- 172.21.15.43:0/175692579 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2924005510 con 0x7f2924004810 2024-04-24T23:08:54.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f293bfff640 1 -- 172.21.15.43:0/175692579 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f292400bf10 con 0x7f293c073080 2024-04-24T23:08:54.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f29411b4640 1 --2- 172.21.15.43:0/175692579 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29240039f0 0x7f2924003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f29419b5640 1 --2- 172.21.15.43:0/175692579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293c073080 0x7f292400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f29411b4640 1 -- 172.21.15.43:0/175692579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293c073080 msgr2=0x7f292400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:54.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f29411b4640 1 --2- 172.21.15.43:0/175692579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293c073080 0x7f292400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f29411b4640 1 -- 172.21.15.43:0/175692579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2924004810 msgr2=0x7f2924004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:54.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f29411b4640 1 --2- 172.21.15.43:0/175692579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2924004810 0x7f2924004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.850+0000 7f29411b4640 1 -- 172.21.15.43:0/175692579 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2924003530 con 0x7f29240039f0 2024-04-24T23:08:54.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.854+0000 7f29411b4640 1 --2- 172.21.15.43:0/175692579 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29240039f0 0x7f2924003e10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2934001780 tx=0x7f293401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbaa7d2f7d5a4beb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:54.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.854+0000 7f293bfff640 1 -- 172.21.15.43:0/175692579 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29340013a0 con 0x7f29240039f0 2024-04-24T23:08:54.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.854+0000 7f293bfff640 1 -- 172.21.15.43:0/175692579 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f29340052f0 con 0x7f29240039f0 2024-04-24T23:08:54.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.854+0000 7f293bfff640 1 -- 172.21.15.43:0/175692579 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934003860 con 0x7f29240039f0 2024-04-24T23:08:54.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.854+0000 7f2943418640 1 -- 172.21.15.43:0/175692579 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29240039f0 msgr2=0x7f2924003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.854+0000 7f2943418640 1 --2- 172.21.15.43:0/175692579 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29240039f0 0x7f2924003e10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2934001780 tx=0x7f293401c3f0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.854+0000 7f29419b5640 1 -- 172.21.15.43:0/175692579 reap_dead start 2024-04-24T23:08:54.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.854+0000 7f2943418640 1 -- 172.21.15.43:0/175692579 shutdown_connections 2024-04-24T23:08:54.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.854+0000 7f2943418640 1 -- 172.21.15.43:0/175692579 >> 172.21.15.43:0/175692579 conn(0x7f293c0b7880 msgr2=0x7f293c0b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:54.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.854+0000 7f2943418640 1 -- 172.21.15.43:0/175692579 shutdown_connections 2024-04-24T23:08:54.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.854+0000 7f2943418640 1 -- 172.21.15.43:0/175692579 wait complete. 2024-04-24T23:08:54.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.854+0000 7f2943418640 1 Processor -- start 2024-04-24T23:08:54.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.854+0000 7f2943418640 1 -- start start 2024-04-24T23:08:54.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f2943418640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29240039f0 0x7f293c146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f2943418640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f293c1501a0 0x7f293c1e1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f2943418640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293c13dff0 0x7f293c13e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f2943418640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f293c0b7390 con 0x7f293c1501a0 2024-04-24T23:08:54.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f2943418640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f293c0b7210 con 0x7f29240039f0 2024-04-24T23:08:54.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f2943418640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f293c0701c0 con 0x7f293c13dff0 2024-04-24T23:08:54.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f29409b3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f293c1501a0 0x7f293c1e1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f29409b3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f293c1501a0 0x7f293c1e1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33982/0 (socket says 172.21.15.43:33982) 2024-04-24T23:08:54.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f29409b3640 1 -- 172.21.15.43:0/1064626534 learned_addr learned my addr 172.21.15.43:0/1064626534 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:54.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f29411b4640 1 --2- 172.21.15.43:0/1064626534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29240039f0 0x7f293c146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f29419b5640 1 --2- 172.21.15.43:0/1064626534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293c13dff0 0x7f293c13e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f29409b3640 1 -- 172.21.15.43:0/1064626534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293c13dff0 msgr2=0x7f293c13e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f29409b3640 1 --2- 172.21.15.43:0/1064626534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293c13dff0 0x7f293c13e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f29409b3640 1 -- 172.21.15.43:0/1064626534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29240039f0 msgr2=0x7f293c146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:54.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f29409b3640 1 --2- 172.21.15.43:0/1064626534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29240039f0 0x7f293c146bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:54.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f29409b3640 1 -- 172.21.15.43:0/1064626534 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293c0b4760 con 0x7f293c1501a0 2024-04-24T23:08:54.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f29419b5640 1 --2- 172.21.15.43:0/1064626534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293c13dff0 0x7f293c13e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-24T23:08:54.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f29409b3640 1 --2- 172.21.15.43:0/1064626534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f293c1501a0 0x7f293c1e1430 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f293000e600 tx=0x7f293000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:54.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f2939ffb640 1 -- 172.21.15.43:0/1064626534 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293000f040 con 0x7f293c1501a0 2024-04-24T23:08:54.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f2939ffb640 1 -- 172.21.15.43:0/1064626534 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2930004230 con 0x7f293c1501a0 2024-04-24T23:08:54.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f2943418640 1 -- 172.21.15.43:0/1064626534 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f293c14fd80 con 0x7f293c1501a0 2024-04-24T23:08:54.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f2939ffb640 1 -- 172.21.15.43:0/1064626534 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930003620 con 0x7f293c1501a0 2024-04-24T23:08:54.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f2943418640 1 -- 172.21.15.43:0/1064626534 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f293c14ee70 con 0x7f293c1501a0 2024-04-24T23:08:54.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f2943418640 1 -- 172.21.15.43:0/1064626534 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f293c04f580 con 0x7f293c1501a0 2024-04-24T23:08:54.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f2939ffb640 1 -- 172.21.15.43:0/1064626534 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f29300037c0 con 0x7f293c1501a0 2024-04-24T23:08:54.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f2939ffb640 1 --2- 172.21.15.43:0/1064626534 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f29280678f0 0x7f2928069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:54.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f29411b4640 1 --2- 172.21.15.43:0/1064626534 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f29280678f0 0x7f2928069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:54.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f2939ffb640 1 -- 172.21.15.43:0/1064626534 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6325+0+0 (secure 0 0 0) 0x7f2930085cf0 con 0x7f293c1501a0 2024-04-24T23:08:54.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.858+0000 7f29411b4640 1 --2- 172.21.15.43:0/1064626534 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f29280678f0 0x7f2928069db0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2934001750 tx=0x7f29340011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:54.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:54.862+0000 7f2939ffb640 1 -- 172.21.15.43:0/1064626534 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f293008a070 con 0x7f293c1501a0 2024-04-24T23:08:55.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.026+0000 7f2943418640 1 -- 172.21.15.43:0/1064626534 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f293c0b4930 con 0x7f293c1501a0 2024-04-24T23:08:55.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.714+0000 7f2939ffb640 1 -- 172.21.15.43:0/1064626534 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f2930020020 con 0x7f293c1501a0 2024-04-24T23:08:55.715 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2024-04-24T23:08:55.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.714+0000 7f2943418640 1 -- 172.21.15.43:0/1064626534 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f29280678f0 msgr2=0x7f2928069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.714+0000 7f2943418640 1 --2- 172.21.15.43:0/1064626534 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f29280678f0 0x7f2928069db0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2934001750 tx=0x7f29340011a0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.714+0000 7f2943418640 1 -- 172.21.15.43:0/1064626534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f293c1501a0 msgr2=0x7f293c1e1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.714+0000 7f2943418640 1 --2- 172.21.15.43:0/1064626534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f293c1501a0 0x7f293c1e1430 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f293000e600 tx=0x7f293000eac0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.714+0000 7f2943418640 1 -- 172.21.15.43:0/1064626534 shutdown_connections 2024-04-24T23:08:55.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.714+0000 7f2943418640 1 --2- 172.21.15.43:0/1064626534 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7f29280678f0 0x7f2928069db0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.714+0000 7f2943418640 1 --2- 172.21.15.43:0/1064626534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293c13dff0 0x7f293c13e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.714+0000 7f2943418640 1 --2- 172.21.15.43:0/1064626534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f293c1501a0 0x7f293c1e1430 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.714+0000 7f2943418640 1 --2- 172.21.15.43:0/1064626534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29240039f0 0x7f293c146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.714+0000 7f2943418640 1 -- 172.21.15.43:0/1064626534 >> 172.21.15.43:0/1064626534 conn(0x7f293c0b7880 msgr2=0x7f293c0b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.714+0000 7f2943418640 1 -- 172.21.15.43:0/1064626534 shutdown_connections 2024-04-24T23:08:55.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.718+0000 7f2943418640 1 -- 172.21.15.43:0/1064626534 wait complete. 2024-04-24T23:08:55.740 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-24T23:08:55.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.850+0000 7faa77061640 1 Processor -- start 2024-04-24T23:08:55.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.850+0000 7faa77061640 1 -- start start 2024-04-24T23:08:55.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.850+0000 7faa77061640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa700b7030 0x7faa700b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.850+0000 7faa77061640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faa70073690 0x7faa70142410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.850+0000 7faa77061640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa700b63c0 con 0x7faa700b7e40 2024-04-24T23:08:55.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.850+0000 7faa77061640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7faa700b8600 con 0x7faa70073690 2024-04-24T23:08:55.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.850+0000 7faa77061640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faa700b59f0 con 0x7faa700b7030 2024-04-24T23:08:55.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.850+0000 7faa6ffff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faa70073690 0x7faa70142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.850+0000 7faa6ffff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faa70073690 0x7faa70142410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33990/0 (socket says 172.21.15.43:33990) 2024-04-24T23:08:55.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.850+0000 7faa6ffff640 1 -- 172.21.15.43:0/3324306885 learned_addr learned my addr 172.21.15.43:0/3324306885 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:55.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa6ffff640 1 -- 172.21.15.43:0/3324306885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa700b7030 msgr2=0x7faa700b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T23:08:55.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa6ffff640 1 --2- 172.21.15.43:0/3324306885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa700b7030 0x7faa700b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa6ffff640 1 -- 172.21.15.43:0/3324306885 >> v1:172.21.15.43:6789/0 conn(0x7faa700b7e40 legacy=0x7faa70148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa6ffff640 1 -- 172.21.15.43:0/3324306885 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa700b8320 con 0x7faa70073690 2024-04-24T23:08:55.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa6ffff640 1 --2- 172.21.15.43:0/3324306885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa70073690 0x7faa70142410 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7faa640098a0 tx=0x7faa6401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74ef1d82296ddc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa6f7fe640 1 -- 172.21.15.43:0/3324306885 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa640b1070 con 0x7faa70073690 2024-04-24T23:08:55.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa6f7fe640 1 -- 172.21.15.43:0/3324306885 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faa640a8050 con 0x7faa70073690 2024-04-24T23:08:55.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa6f7fe640 1 -- 172.21.15.43:0/3324306885 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa640ac880 con 0x7faa70073690 2024-04-24T23:08:55.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa77061640 1 -- 172.21.15.43:0/3324306885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa70073690 msgr2=0x7faa70142410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa77061640 1 --2- 172.21.15.43:0/3324306885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa70073690 0x7faa70142410 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7faa640098a0 tx=0x7faa6401c4b0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa77061640 1 -- 172.21.15.43:0/3324306885 shutdown_connections 2024-04-24T23:08:55.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa77061640 1 --2- 172.21.15.43:0/3324306885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa70073690 0x7faa70142410 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa77061640 1 --2- 172.21.15.43:0/3324306885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa700b7030 0x7faa700b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa77061640 1 -- 172.21.15.43:0/3324306885 >> 172.21.15.43:0/3324306885 conn(0x7faa70062030 msgr2=0x7faa70062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:55.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa77061640 1 -- 172.21.15.43:0/3324306885 shutdown_connections 2024-04-24T23:08:55.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.854+0000 7faa77061640 1 -- 172.21.15.43:0/3324306885 wait complete. 2024-04-24T23:08:55.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa77061640 1 Processor -- start 2024-04-24T23:08:55.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa77061640 1 -- start start 2024-04-24T23:08:55.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa77061640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa70073690 0x7faa701389a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa77061640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa700b7030 0x7faa700b9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa77061640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa700b7e40 0x7faa7013ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa77061640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faa70152e00 con 0x7faa700b7e40 2024-04-24T23:08:55.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa77061640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa70152c80 con 0x7faa700b7030 2024-04-24T23:08:55.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa77061640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faa70152f80 con 0x7faa70073690 2024-04-24T23:08:55.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa755fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa700b7e40 0x7faa7013ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa755fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa700b7e40 0x7faa7013ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34000/0 (socket says 172.21.15.43:34000) 2024-04-24T23:08:55.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa755fe640 1 -- 172.21.15.43:0/3492570810 learned_addr learned my addr 172.21.15.43:0/3492570810 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-24T23:08:55.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa755fe640 1 -- 172.21.15.43:0/3492570810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa70073690 msgr2=0x7faa701389a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa755fe640 1 --2- 172.21.15.43:0/3492570810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa70073690 0x7faa701389a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa755fe640 1 -- 172.21.15.43:0/3492570810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa700b7030 msgr2=0x7faa700b9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:55.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa755fe640 1 --2- 172.21.15.43:0/3492570810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa700b7030 0x7faa700b9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:55.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa755fe640 1 -- 172.21.15.43:0/3492570810 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7006cc40 con 0x7faa700b7e40 2024-04-24T23:08:55.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa755fe640 1 --2- 172.21.15.43:0/3492570810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa700b7e40 0x7faa7013ded0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faa6800c730 tx=0x7faa6800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa6d7fa640 1 -- 172.21.15.43:0/3492570810 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa68003b80 con 0x7faa700b7e40 2024-04-24T23:08:55.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa6d7fa640 1 -- 172.21.15.43:0/3492570810 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faa68003d20 con 0x7faa700b7e40 2024-04-24T23:08:55.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa6d7fa640 1 -- 172.21.15.43:0/3492570810 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa68005330 con 0x7faa700b7e40 2024-04-24T23:08:55.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa77061640 1 -- 172.21.15.43:0/3492570810 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa7006c960 con 0x7faa700b7e40 2024-04-24T23:08:55.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa77061640 1 -- 172.21.15.43:0/3492570810 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa700ba270 con 0x7faa700b7e40 2024-04-24T23:08:55.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa77061640 1 -- 172.21.15.43:0/3492570810 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa700ba470 con 0x7faa700b7e40 2024-04-24T23:08:55.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.858+0000 7faa6d7fa640 1 -- 172.21.15.43:0/3492570810 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faa680056e0 con 0x7faa700b7e40 2024-04-24T23:08:55.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.862+0000 7faa6d7fa640 1 --2- 172.21.15.43:0/3492570810 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7faa5c0678c0 0x7faa5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T23:08:55.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.862+0000 7faa6d7fa640 1 -- 172.21.15.43:0/3492570810 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5882+0+0 (secure 0 0 0) 0x7faa68085d80 con 0x7faa700b7e40 2024-04-24T23:08:55.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.862+0000 7faa74dfd640 1 --2- 172.21.15.43:0/3492570810 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7faa5c0678c0 0x7faa5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T23:08:55.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.862+0000 7faa74dfd640 1 --2- 172.21.15.43:0/3492570810 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7faa5c0678c0 0x7faa5c069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faa70139110 tx=0x7faa60006ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T23:08:55.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:55.866+0000 7faa6d7fa640 1 -- 172.21.15.43:0/3492570810 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7faa7006cc40 con 0x7faa700b7e40 2024-04-24T23:08:56.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:56.026+0000 7faa77061640 1 -- 172.21.15.43:0/3492570810 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7faa70148af0 con 0x7faa700b7e40 2024-04-24T23:08:56.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:56.714+0000 7faa6d7fa640 1 -- 172.21.15.43:0/3492570810 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7faa68056810 con 0x7faa700b7e40 2024-04-24T23:08:56.717 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data_ec' removed 2024-04-24T23:08:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:56.718+0000 7faa77061640 1 -- 172.21.15.43:0/3492570810 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7faa5c0678c0 msgr2=0x7faa5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:56.718+0000 7faa77061640 1 --2- 172.21.15.43:0/3492570810 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7faa5c0678c0 0x7faa5c069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faa70139110 tx=0x7faa60006ca0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:56.718+0000 7faa77061640 1 -- 172.21.15.43:0/3492570810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa700b7e40 msgr2=0x7faa7013ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T23:08:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:56.718+0000 7faa77061640 1 --2- 172.21.15.43:0/3492570810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa700b7e40 0x7faa7013ded0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faa6800c730 tx=0x7faa6800cbf0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:56.718+0000 7faa77061640 1 -- 172.21.15.43:0/3492570810 shutdown_connections 2024-04-24T23:08:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:56.718+0000 7faa77061640 1 --2- 172.21.15.43:0/3492570810 >> [v2:172.21.15.43:6832/444634859,v1:172.21.15.43:6833/444634859] conn(0x7faa5c0678c0 0x7faa5c069d80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:56.718+0000 7faa77061640 1 --2- 172.21.15.43:0/3492570810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa700b7e40 0x7faa7013ded0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:56.718+0000 7faa77061640 1 --2- 172.21.15.43:0/3492570810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa700b7030 0x7faa700b9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:56.718+0000 7faa77061640 1 --2- 172.21.15.43:0/3492570810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa70073690 0x7faa701389a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T23:08:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:56.718+0000 7faa77061640 1 -- 172.21.15.43:0/3492570810 >> 172.21.15.43:0/3492570810 conn(0x7faa70062030 msgr2=0x7faa70071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T23:08:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:56.722+0000 7faa77061640 1 -- 172.21.15.43:0/3492570810 shutdown_connections 2024-04-24T23:08:56.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-24T23:08:56.722+0000 7faa77061640 1 -- 172.21.15.43:0/3492570810 wait complete. 2024-04-24T23:08:56.742 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-24T23:08:56.743 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-24T23:08:56.743 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:56.757 INFO:tasks.ceph.mds.a:Stopped 2024-04-24T23:08:56.757 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-24T23:08:56.757 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:56.782 INFO:tasks.ceph.mds.b:Stopped 2024-04-24T23:08:56.782 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-24T23:08:56.782 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-24T23:08:56.782 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:56.870 INFO:tasks.ceph.osd.0:Stopped 2024-04-24T23:08:56.870 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-24T23:08:56.870 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:56.957 INFO:tasks.ceph.osd.1:Stopped 2024-04-24T23:08:56.957 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-24T23:08:56.957 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:57.055 INFO:tasks.ceph.osd.2:Stopped 2024-04-24T23:08:57.055 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-24T23:08:57.055 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:57.109 INFO:tasks.ceph.osd.3:Stopped 2024-04-24T23:08:57.109 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-24T23:08:57.109 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:57.204 INFO:tasks.ceph.osd.4:Stopped 2024-04-24T23:08:57.205 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-24T23:08:57.205 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:57.292 INFO:tasks.ceph.osd.5:Stopped 2024-04-24T23:08:57.292 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-24T23:08:57.292 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:57.390 INFO:tasks.ceph.osd.6:Stopped 2024-04-24T23:08:57.390 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-24T23:08:57.390 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:57.477 INFO:tasks.ceph.osd.7:Stopped 2024-04-24T23:08:57.477 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-24T23:08:57.477 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-24T23:08:57.477 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:57.503 INFO:tasks.ceph.mgr.y:Stopped 2024-04-24T23:08:57.503 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-24T23:08:57.503 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:57.532 INFO:tasks.ceph.mgr.x:Stopped 2024-04-24T23:08:57.532 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-24T23:08:57.532 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-24T23:08:57.532 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:57.556 INFO:tasks.ceph.mon.a:Stopped 2024-04-24T23:08:57.556 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-24T23:08:57.557 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:57.591 INFO:tasks.ceph.mon.b:Stopped 2024-04-24T23:08:57.591 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-24T23:08:57.591 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T23:08:57.648 INFO:tasks.ceph.mon.c:Stopped 2024-04-24T23:08:57.648 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-24T23:08:57.648 DEBUG:teuthology.orchestra.run.smithi043:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-24T23:08:57.697 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-24T23:08:57.697 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-24T23:08:58.863 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-24T23:08:58.863 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-24T23:08:59.123 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-24T23:08:59.123 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-24T23:08:59.294 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi043.front.sepia.ceph.com 2024-04-24T23:08:59.294 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-24T23:08:59.488 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-24T23:08:59.489 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-24T23:08:59.845 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-24T23:08:59.845 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-24T23:09:00.099 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-24T23:09:00.100 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-24T23:09:00.258 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-24T23:09:00.258 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-24T23:09:00.449 INFO:tasks.ceph:Archiving mon data... 2024-04-24T23:09:00.451 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672162/data/mon.a.tgz 2024-04-24T23:09:00.451 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-04-24T23:09:00.468 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.jRpf3sjhDg 2024-04-24T23:09:00.468 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.jRpf3sjhDg 2024-04-24T23:09:00.637 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.jRpf3sjhDg 2024-04-24T23:09:00.721 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.jRpf3sjhDg is 413KB 2024-04-24T23:09:00.780 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.jRpf3sjhDg 2024-04-24T23:09:00.786 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672162/data/mon.b.tgz 2024-04-24T23:09:00.786 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-04-24T23:09:00.792 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.5AWVZPG6u8 2024-04-24T23:09:00.792 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.5AWVZPG6u8 2024-04-24T23:09:00.924 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.5AWVZPG6u8 2024-04-24T23:09:00.988 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.5AWVZPG6u8 is 416KB 2024-04-24T23:09:01.050 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.5AWVZPG6u8 2024-04-24T23:09:01.055 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672162/data/mon.c.tgz 2024-04-24T23:09:01.056 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-04-24T23:09:01.104 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.fX4GGBgb87 2024-04-24T23:09:01.104 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.fX4GGBgb87 2024-04-24T23:09:01.238 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.fX4GGBgb87 2024-04-24T23:09:01.300 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.fX4GGBgb87 is 416KB 2024-04-24T23:09:01.361 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.fX4GGBgb87 2024-04-24T23:09:01.367 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-24T23:09:01.367 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T23:09:01.370 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T23:09:01.441 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T23:09:01.472 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T23:09:01.472 INFO:tasks.ceph:Archiving crash dumps... 2024-04-24T23:09:01.474 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672162/remote/smithi043/crash 2024-04-24T23:09:01.475 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T23:09:01.495 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672162/remote/smithi162/crash 2024-04-24T23:09:01.496 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T23:09:01.527 INFO:tasks.ceph:Shutting down logrotate 2024-04-24T23:09:01.527 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:09:01.539 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-24T23:09:01.615 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-24T23:09:01.626 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-24T23:09:01.671 INFO:tasks.ceph:Compressing logs... 2024-04-24T23:09:01.672 DEBUG:teuthology.orchestra.run.smithi043:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T23:09:01.674 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T23:09:01.703 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32099.log 2024-04-24T23:09:01.704 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32579.log 2024-04-24T23:09:01.704 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32314.log 2024-04-24T23:09:01.705 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33255.log 2024-04-24T23:09:01.705 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33437.log 2024-04-24T23:09:01.705 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148752.log 2024-04-24T23:09:01.708 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149601.log 2024-04-24T23:09:01.708 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33437.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32579.log.gz 2024-04-24T23:09:01.708 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148752.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-24T23:09:01.708 INFO:teuthology.orchestra.run.smithi043.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148752.log.gz 2024-04-24T23:09:01.709 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148700.log 2024-04-24T23:09:01.709 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31681.log 2024-04-24T23:09:01.709 INFO:teuthology.orchestra.run.smithi043.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.149601.log.gz 2024-04-24T23:09:01.709 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148999.log 2024-04-24T23:09:01.709 INFO:teuthology.orchestra.run.smithi043.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.148700.log.gz 2024-04-24T23:09:01.709 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32392.log 2024-04-24T23:09:01.709 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31921.log 2024-04-24T23:09:01.709 INFO:teuthology.orchestra.run.smithi043.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.148999.log.gz 2024-04-24T23:09:01.709 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148778.log 2024-04-24T23:09:01.714 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149055.log 2024-04-24T23:09:01.714 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31921.log: /var/log/ceph/ceph-client.admin.148778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32788.log 2024-04-24T23:09:01.714 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149055.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148778.log.gz 2024-04-24T23:09:01.714 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32992.log 2024-04-24T23:09:01.714 INFO:teuthology.orchestra.run.smithi043.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149055.log.gz 2024-04-24T23:09:01.714 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32997.log 2024-04-24T23:09:01.714 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32774.log 2024-04-24T23:09:01.714 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149394.log 2024-04-24T23:09:01.714 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32774.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-24T23:09:01.714 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148726.log 2024-04-24T23:09:01.715 INFO:teuthology.orchestra.run.smithi043.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.149394.log.gz 2024-04-24T23:09:01.715 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31895.log 2024-04-24T23:09:01.715 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31564.log 2024-04-24T23:09:01.715 INFO:teuthology.orchestra.run.smithi043.stderr: 88.6%/var/log/ceph/ceph-client.admin.31895.log: -- replaced with /var/log/ceph/ceph-client.admin.148726.log.gz 2024-04-24T23:09:01.715 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32366.log 2024-04-24T23:09:01.715 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32990.log 2024-04-24T23:09:01.715 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148538.log 2024-04-24T23:09:01.715 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33333.log 2024-04-24T23:09:01.715 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32501.log 2024-04-24T23:09:01.715 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33333.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.148538.log.gz 2024-04-24T23:09:01.715 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33567.log 2024-04-24T23:09:01.756 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27736.log 2024-04-24T23:09:01.756 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27712.log 2024-04-24T23:09:01.756 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.27736.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-24T23:09:01.756 INFO:teuthology.orchestra.run.smithi162.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27736.log.gz 2024-04-24T23:09:01.756 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-24T23:09:01.757 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.27712.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-24T23:09:01.757 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.6.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27712.log.gz 2024-04-24T23:09:01.757 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27640.log 2024-04-24T23:09:01.757 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27688.log 2024-04-24T23:09:01.757 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.27640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27784.log 2024-04-24T23:09:01.757 INFO:teuthology.orchestra.run.smithi162.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.27640.log.gz 2024-04-24T23:09:01.757 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.27688.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-24T23:09:01.757 INFO:teuthology.orchestra.run.smithi162.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.27688.log.gz 2024-04-24T23:09:01.757 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.27784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27664.log 2024-04-24T23:09:01.757 INFO:teuthology.orchestra.run.smithi162.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.27784.log.gz 2024-04-24T23:09:01.757 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27760.log 2024-04-24T23:09:01.757 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.27664.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-24T23:09:01.757 INFO:teuthology.orchestra.run.smithi162.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27664.log.gz 2024-04-24T23:09:01.757 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.27760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27808.log 2024-04-24T23:09:01.757 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27760.log.gz 2024-04-24T23:09:01.758 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-24T23:09:01.758 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.27808.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-24T23:09:01.758 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27808.log.gz/var/log/ceph/ceph-mon.c.log: 2024-04-24T23:09:01.758 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-24T23:09:01.758 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-24T23:09:01.758 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.b.log: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-24T23:09:01.758 INFO:teuthology.orchestra.run.smithi162.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-24T23:09:01.758 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-24T23:09:01.758 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 93.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-24T23:09:01.760 INFO:teuthology.orchestra.run.smithi162.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-24T23:09:01.766 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149212.log 2024-04-24T23:09:01.766 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32989.log 2024-04-24T23:09:01.766 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32993.log 2024-04-24T23:09:01.767 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148564.log 2024-04-24T23:09:01.767 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.149212.log.gz 2024-04-24T23:09:01.767 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32789.log 2024-04-24T23:09:01.767 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149160.log 2024-04-24T23:09:01.767 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32789.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.148564.log.gz 2024-04-24T23:09:01.767 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32605.log 2024-04-24T23:09:01.767 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149160.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-24T23:09:01.767 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32605.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149160.log.gz 2024-04-24T23:09:01.767 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32553.log 2024-04-24T23:09:01.767 INFO:teuthology.orchestra.run.smithi043.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.31921.log.gz 2024-04-24T23:09:01.767 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32418.log 2024-04-24T23:09:01.767 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149802.log 2024-04-24T23:09:01.768 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148590.log 2024-04-24T23:09:01.768 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149802.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33255.log.gz 2024-04-24T23:09:01.768 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149653.log 2024-04-24T23:09:01.768 INFO:teuthology.orchestra.run.smithi043.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.32099.log.gz 2024-04-24T23:09:01.768 INFO:teuthology.orchestra.run.smithi043.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31895.log.gz 2024-04-24T23:09:01.768 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148590.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149802.log.gz 2024-04-24T23:09:01.768 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149550.log 2024-04-24T23:09:01.768 INFO:teuthology.orchestra.run.smithi043.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32788.log.gz 2024-04-24T23:09:01.768 INFO:teuthology.orchestra.run.smithi043.stderr: 87.9% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32990.log.gz 2024-04-24T23:09:01.768 INFO:teuthology.orchestra.run.smithi043.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32774.log.gz 2024-04-24T23:09:01.768 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149653.log: -- replaced with /var/log/ceph/ceph-client.admin.148590.log.gz 2024-04-24T23:09:01.768 INFO:teuthology.orchestra.run.smithi043.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32993.log.gz 2024-04-24T23:09:01.768 INFO:teuthology.orchestra.run.smithi043.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32992.log.gz 2024-04-24T23:09:01.769 INFO:teuthology.orchestra.run.smithi043.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32989.log.gz 2024-04-24T23:09:01.769 INFO:teuthology.orchestra.run.smithi043.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149653.log.gz 2024-04-24T23:09:01.769 INFO:teuthology.orchestra.run.smithi043.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33567.log.gz 2024-04-24T23:09:01.769 INFO:teuthology.orchestra.run.smithi043.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33437.log.gz 2024-04-24T23:09:01.769 INFO:teuthology.orchestra.run.smithi043.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32997.log.gz 2024-04-24T23:09:01.769 INFO:teuthology.orchestra.run.smithi043.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33333.log.gz 2024-04-24T23:09:01.769 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149550.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.32789.log.gz 2024-04-24T23:09:01.769 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-24T23:09:01.769 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.149550.log.gz 2024-04-24T23:09:01.769 INFO:teuthology.orchestra.run.smithi043.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32605.log.gz 2024-04-24T23:09:01.769 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33177.log 2024-04-24T23:09:01.769 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32969.log 2024-04-24T23:09:01.769 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149290.log 2024-04-24T23:09:01.769 INFO:teuthology.orchestra.run.smithi043.stderr:gzip/var/log/ceph/ceph-client.admin.32969.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32782.log 2024-04-24T23:09:01.770 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33515.log 2024-04-24T23:09:01.770 INFO:teuthology.orchestra.run.smithi043.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149290.log.gz 2024-04-24T23:09:01.770 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31288.log 2024-04-24T23:09:01.770 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32782.log: gzip -5/var/log/ceph/ceph-client.admin.33515.log: --verbose -- /var/log/ceph/ceph-client.admin.31432.log 2024-04-24T23:09:01.770 INFO:teuthology.orchestra.run.smithi043.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32553.log.gz 2024-04-24T23:09:01.770 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149472.log 2024-04-24T23:09:01.770 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31971.log 2024-04-24T23:09:01.770 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149107.log 2024-04-24T23:09:01.770 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31971.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149472.log.gz 2024-04-24T23:09:01.770 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31510.log 2024-04-24T23:09:01.770 INFO:teuthology.orchestra.run.smithi043.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31564.log.gz 2024-04-24T23:09:01.770 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32444.log 2024-04-24T23:09:01.770 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149107.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33177.log.gz 2024-04-24T23:09:01.770 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148909.log 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.149107.log.gz 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32969.log.gz 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31458.log 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32782.log.gz 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33682.log 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33515.log.gz 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.148909.log.gz 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31765.log 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.31971.log.gz 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32631.log 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log/var/log/ceph/ceph-client.admin.31765.log: 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33281.log 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33682.log.gz 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31765.log.gz 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.3.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32631.log.gz 2024-04-24T23:09:01.771 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22658.log 2024-04-24T23:09:01.772 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33541.log 2024-04-24T23:09:01.772 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.tmp-client.admin.22658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33203.log 2024-04-24T23:09:01.772 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22658.log.gz 2024-04-24T23:09:01.772 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148857.log 2024-04-24T23:09:01.772 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33541.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33281.log.gz 2024-04-24T23:09:01.772 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32261.log 2024-04-24T23:09:01.772 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27563.log 2024-04-24T23:09:01.772 INFO:teuthology.orchestra.run.smithi043.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.148857.log.gz 2024-04-24T23:09:01.772 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32261.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-24T23:09:01.772 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149029.log 2024-04-24T23:09:01.772 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148642.log 2024-04-24T23:09:01.772 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149186.log 2024-04-24T23:09:01.772 INFO:teuthology.orchestra.run.smithi043.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33541.log.gz 2024-04-24T23:09:01.772 INFO:teuthology.orchestra.run.smithi043.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149029.log.gz 2024-04-24T23:09:01.773 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149705.log 2024-04-24T23:09:01.773 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149186.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.148642.log.gz 2024-04-24T23:09:01.773 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148935.log 2024-04-24T23:09:01.773 INFO:teuthology.orchestra.run.smithi043.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149186.log.gz 2024-04-24T23:09:01.773 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149368.log 2024-04-24T23:09:01.773 INFO:teuthology.orchestra.run.smithi043.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.149705.log.gz 2024-04-24T23:09:01.773 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33359.log 2024-04-24T23:09:01.773 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149368.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.148935.log.gz 2024-04-24T23:09:01.773 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148674.log 2024-04-24T23:09:01.773 INFO:teuthology.orchestra.run.smithi043.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149368.log.gz 2024-04-24T23:09:01.773 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32527.log 2024-04-24T23:09:01.773 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32683.log 2024-04-24T23:09:01.773 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33203.log.gz 2024-04-24T23:09:01.773 INFO:teuthology.orchestra.run.smithi043.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33359.log.gz 2024-04-24T23:09:01.773 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32527.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.148674.log.gz 2024-04-24T23:09:01.774 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149316.log 2024-04-24T23:09:01.774 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149679.log 2024-04-24T23:09:01.774 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31386.log 2024-04-24T23:09:01.774 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149316.log: /var/log/ceph/ceph-client.admin.149679.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32683.log.gz 2024-04-24T23:09:01.774 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149731.log 2024-04-24T23:09:01.774 INFO:teuthology.orchestra.run.smithi043.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149316.log.gz 2024-04-24T23:09:01.774 INFO:teuthology.orchestra.run.smithi043.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149679.log.gz 2024-04-24T23:09:01.774 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32340.log 2024-04-24T23:09:01.774 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149577.log 2024-04-24T23:09:01.774 INFO:teuthology.orchestra.run.smithi043.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149731.log.gz 2024-04-24T23:09:01.774 INFO:teuthology.orchestra.run.smithi043.stderr:gzip/var/log/ceph/ceph-client.admin.32340.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.149081.log 2024-04-24T23:09:01.774 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33385.log 2024-04-24T23:09:01.774 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31739.log 2024-04-24T23:09:01.775 INFO:teuthology.orchestra.run.smithi043.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149577.log.gz 2024-04-24T23:09:01.775 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.149081.log.gz 2024-04-24T23:09:01.775 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.33385.log: -- /var/log/ceph/ceph-client.admin.149828.log 2024-04-24T23:09:01.775 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31739.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-24T23:09:01.775 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148616.log 2024-04-24T23:09:01.775 INFO:teuthology.orchestra.run.smithi043.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149828.log.gz 2024-04-24T23:09:01.775 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32780.log 2024-04-24T23:09:01.775 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.148616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32287.log 2024-04-24T23:09:01.775 INFO:teuthology.orchestra.run.smithi043.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148616.log.gz 2024-04-24T23:09:01.775 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32209.log 2024-04-24T23:09:01.775 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32780.log: /var/log/ceph/ceph-client.admin.32287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33619.log 2024-04-24T23:09:01.775 INFO:teuthology.orchestra.run.smithi043.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33385.log.gz 2024-04-24T23:09:01.775 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32772.log 2024-04-24T23:09:01.775 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32209.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32780.log.gz 2024-04-24T23:09:01.775 INFO:teuthology.orchestra.run.smithi043.stderr: 85.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-24T23:09:01.776 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33807.log 2024-04-24T23:09:01.776 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32235.log 2024-04-24T23:09:01.776 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.33807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148883.log 2024-04-24T23:09:01.776 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149133.log 2024-04-24T23:09:01.776 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32980.log 2024-04-24T23:09:01.776 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149133.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148883.log.gz 2024-04-24T23:09:01.776 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149776.log 2024-04-24T23:09:01.776 INFO:teuthology.orchestra.run.smithi043.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.149133.log.gz 2024-04-24T23:09:01.776 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31590.log 2024-04-24T23:09:01.776 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32980.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.33619.log.gz 2024-04-24T23:09:01.776 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148961.log 2024-04-24T23:09:01.776 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.149776.log.gz 2024-04-24T23:09:01.776 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33489.log 2024-04-24T23:09:01.776 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32781.log 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32772.log.gz 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149446.log 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33489.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148961.log.gz 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32781.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149498.log 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.audit.log: gzip 88.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.149446.log.gz -- 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr: /var/log/ceph/ceph-client.admin.149342.log 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149498.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149342.log: gzip -5 88.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.149498.log.gz 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr: /var/log/ceph/ceph-client.admin.32735.log 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.149342.log.gz 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31356.log 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27641.log 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149420.log 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31484.log 2024-04-24T23:09:01.777 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31646.log 2024-04-24T23:09:01.778 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31484.log: gzip -5 88.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.149420.log.gz 2024-04-24T23:09:01.778 INFO:teuthology.orchestra.run.smithi043.stderr: /var/log/ceph/ceph-client.admin.32709.log 2024-04-24T23:09:01.778 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33411.log 2024-04-24T23:09:01.778 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31618.log 2024-04-24T23:09:01.778 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149264.log 2024-04-24T23:09:01.778 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33411.log: /var/log/ceph/ceph-client.admin.31618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149238.log 2024-04-24T23:09:01.778 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32183.log 2024-04-24T23:09:01.778 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149238.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149264.log.gz 2024-04-24T23:09:01.778 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148831.log 2024-04-24T23:09:01.778 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.149238.log.gz 2024-04-24T23:09:01.778 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148804.log 2024-04-24T23:09:01.778 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31817.log 2024-04-24T23:09:01.778 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148804.log: 89.4% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148831.log.gz 2024-04-24T23:09:01.778 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.27563.log.gz 2024-04-24T23:09:01.779 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27422.log 2024-04-24T23:09:01.779 INFO:teuthology.orchestra.run.smithi043.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148804.log.gz 2024-04-24T23:09:01.779 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32157.log 2024-04-24T23:09:01.779 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31843.log 2024-04-24T23:09:01.779 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.27422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33593.log 2024-04-24T23:09:01.779 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32157.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31386.log.gz 2024-04-24T23:09:01.779 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31843.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31458.log.gz 2024-04-24T23:09:01.779 INFO:teuthology.orchestra.run.smithi043.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31432.log.gz 2024-04-24T23:09:01.779 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149627.log 2024-04-24T23:09:01.779 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31711.log 2024-04-24T23:09:01.779 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33307.log 2024-04-24T23:09:01.780 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31711.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.149627.log.gz 2024-04-24T23:09:01.780 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33229.log 2024-04-24T23:09:01.780 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32980.log.gz 2024-04-24T23:09:01.780 INFO:teuthology.orchestra.run.smithi043.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31590.log.gz 2024-04-24T23:09:01.780 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149524.log 2024-04-24T23:09:01.780 INFO:teuthology.orchestra.run.smithi043.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33489.log.gz 2024-04-24T23:09:01.780 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148512.log 2024-04-24T23:09:01.780 INFO:teuthology.orchestra.run.smithi043.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32781.log.gz 2024-04-24T23:09:01.780 INFO:teuthology.orchestra.run.smithi043.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31356.log.gz 2024-04-24T23:09:01.780 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33463.log 2024-04-24T23:09:01.780 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31538.log 2024-04-24T23:09:01.780 INFO:teuthology.orchestra.run.smithi043.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.149524.log.gz 2024-04-24T23:09:01.780 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.33463.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148512.log.gz 2024-04-24T23:09:01.780 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32657.log 2024-04-24T23:09:01.780 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32709.log.gz 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32475.log 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31538.log: /var/log/ceph/ceph-client.admin.32657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31791.log 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31869.log 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32991.log 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32735.log.gz 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32786.log 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32991.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27641.log.gz 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32786.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31843.log.gz 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31817.log.gz 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33411.log.gz 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.27422.log.gz 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33593.log.gz 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31618.log.gz 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32657.log.gz 2024-04-24T23:09:01.781 INFO:teuthology.orchestra.run.smithi043.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31288.log.gz 2024-04-24T23:09:01.782 INFO:teuthology.orchestra.run.smithi043.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31646.log.gz 2024-04-24T23:09:01.782 INFO:teuthology.orchestra.run.smithi043.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31681.log.gz 2024-04-24T23:09:01.782 INFO:teuthology.orchestra.run.smithi043.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31739.log.gz 2024-04-24T23:09:01.782 INFO:teuthology.orchestra.run.smithi043.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31711.log.gz 2024-04-24T23:09:01.782 INFO:teuthology.orchestra.run.smithi043.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32183.log.gz 88.7% 2024-04-24T23:09:01.782 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32157.log.gz 2024-04-24T23:09:01.782 INFO:teuthology.orchestra.run.smithi043.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32209.log.gz 2024-04-24T23:09:01.782 INFO:teuthology.orchestra.run.smithi043.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32235.log.gz 2024-04-24T23:09:01.782 INFO:teuthology.orchestra.run.smithi043.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32261.log.gz 2024-04-24T23:09:01.782 INFO:teuthology.orchestra.run.smithi043.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32287.log.gz 2024-04-24T23:09:01.782 INFO:teuthology.orchestra.run.smithi043.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32314.log.gz 2024-04-24T23:09:01.782 INFO:teuthology.orchestra.run.smithi043.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32340.log.gz 2024-04-24T23:09:01.783 INFO:teuthology.orchestra.run.smithi043.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32366.log.gz 2024-04-24T23:09:01.783 INFO:teuthology.orchestra.run.smithi043.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32392.log.gz 2024-04-24T23:09:01.783 INFO:teuthology.orchestra.run.smithi043.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32418.log.gz 2024-04-24T23:09:01.783 INFO:teuthology.orchestra.run.smithi043.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32444.log.gz 2024-04-24T23:09:01.783 INFO:teuthology.orchestra.run.smithi043.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32475.log.gz 2024-04-24T23:09:01.783 INFO:teuthology.orchestra.run.smithi043.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32501.log.gz 2024-04-24T23:09:01.783 INFO:teuthology.orchestra.run.smithi043.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32527.log.gz 2024-04-24T23:09:01.783 INFO:teuthology.orchestra.run.smithi043.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33307.log.gz 2024-04-24T23:09:01.783 INFO:teuthology.orchestra.run.smithi043.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33463.log.gz 2024-04-24T23:09:01.783 INFO:teuthology.orchestra.run.smithi043.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33229.log.gz 2024-04-24T23:09:01.783 INFO:teuthology.orchestra.run.smithi043.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31791.log.gz 2024-04-24T23:09:01.783 INFO:teuthology.orchestra.run.smithi043.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32786.log.gz 2024-04-24T23:09:01.783 INFO:teuthology.orchestra.run.smithi043.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31869.log.gz 2024-04-24T23:09:01.783 INFO:teuthology.orchestra.run.smithi043.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32991.log.gz 2024-04-24T23:09:01.815 INFO:teuthology.orchestra.run.smithi043.stderr: 89.0% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31510.log.gz -- replaced with /var/log/ceph/ceph-client.admin.31484.log.gz 2024-04-24T23:09:01.816 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-04-24T23:09:01.816 INFO:teuthology.orchestra.run.smithi043.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31538.log.gz 2024-04-24T23:09:01.857 INFO:teuthology.orchestra.run.smithi162.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-24T23:09:01.950 INFO:teuthology.orchestra.run.smithi162.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-24T23:09:02.337 INFO:teuthology.orchestra.run.smithi043.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-24T23:09:03.165 INFO:teuthology.orchestra.run.smithi043.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-24T23:09:10.531 INFO:teuthology.orchestra.run.smithi162.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-24T23:09:10.869 INFO:teuthology.orchestra.run.smithi162.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-24T23:09:11.401 INFO:teuthology.orchestra.run.smithi162.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-24T23:09:11.599 INFO:teuthology.orchestra.run.smithi162.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-24T23:09:11.601 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-04-24T23:09:11.601 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m9.882s 2024-04-24T23:09:11.601 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m36.526s 2024-04-24T23:09:11.601 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m1.249s 2024-04-24T23:09:19.079 INFO:teuthology.orchestra.run.smithi043.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-24T23:09:21.001 INFO:teuthology.orchestra.run.smithi043.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-24T23:09:23.500 INFO:teuthology.orchestra.run.smithi043.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-24T23:09:26.454 INFO:teuthology.orchestra.run.smithi043.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-24T23:09:30.085 INFO:teuthology.orchestra.run.smithi043.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-24T23:11:19.269 INFO:teuthology.orchestra.run.smithi043.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.33807.log.gz 2024-04-24T23:11:19.270 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-04-24T23:11:19.270 INFO:teuthology.orchestra.run.smithi043.stderr:real 2m17.594s 2024-04-24T23:11:19.270 INFO:teuthology.orchestra.run.smithi043.stderr:user 3m20.341s 2024-04-24T23:11:19.270 INFO:teuthology.orchestra.run.smithi043.stderr:sys 0m6.268s 2024-04-24T23:11:19.271 INFO:tasks.ceph:Archiving logs... 2024-04-24T23:11:19.271 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672162/remote/smithi043/log 2024-04-24T23:11:19.272 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T23:11:53.742 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672162/remote/smithi162/log 2024-04-24T23:11:53.746 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T23:11:59.284 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-24T23:11:59.294 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-24T23:11:59.294 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T23:11:59.297 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T23:11:59.388 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-24T23:11:59.398 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-24T23:11:59.398 DEBUG:teuthology.orchestra.run.smithi043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T23:11:59.401 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T23:11:59.414 INFO:teuthology.orchestra.run.smithi162.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T23:11:59.414 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================== 2024-04-24T23:11:59.414 INFO:teuthology.orchestra.run.smithi162.stdout:*hv01.front.sepi 44.4.53.2 2 u 5 64 377 0.070 -1.856 2.943 2024-04-24T23:11:59.414 INFO:teuthology.orchestra.run.smithi162.stdout:+hv02.front.sepi 63.231.80.2 3 u 9 64 377 0.126 -0.605 2.967 2024-04-24T23:11:59.414 INFO:teuthology.orchestra.run.smithi162.stdout:+hv03.front.sepi 74.6.168.72 3 u 6 64 377 0.091 -3.069 1.763 2024-04-24T23:11:59.414 INFO:teuthology.orchestra.run.smithi162.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-24T23:11:59.440 INFO:teuthology.orchestra.run.smithi043.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T23:11:59.440 INFO:teuthology.orchestra.run.smithi043.stdout:============================================================================== 2024-04-24T23:11:59.440 INFO:teuthology.orchestra.run.smithi043.stdout:*hv01.front.sepi 44.4.53.2 2 u 9 64 377 0.060 -1.893 0.842 2024-04-24T23:11:59.440 INFO:teuthology.orchestra.run.smithi043.stdout:+hv02.front.sepi 63.231.80.2 3 u 14 64 377 0.067 -1.145 0.542 2024-04-24T23:11:59.440 INFO:teuthology.orchestra.run.smithi043.stdout:+hv03.front.sepi 74.6.168.72 3 u 8 64 377 0.073 -0.714 0.719 2024-04-24T23:11:59.440 INFO:teuthology.orchestra.run.smithi043.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-24T23:11:59.441 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-24T23:11:59.451 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-24T23:11:59.452 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-24T23:11:59.460 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-24T23:11:59.469 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-24T23:11:59.479 INFO:teuthology.task.internal:Duration was 1361.269122 seconds 2024-04-24T23:11:59.479 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-24T23:11:59.488 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-24T23:11:59.488 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T23:11:59.490 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T23:11:59.692 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-24T23:11:59.693 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi043.front.sepia.ceph.com 2024-04-24T23:11:59.693 DEBUG:teuthology.orchestra.run.smithi043:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T23:11:59.704 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-04-24T23:11:59.704 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T23:11:59.716 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-24T23:11:59.716 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T23:11:59.747 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T23:11:59.782 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-24T23:11:59.782 DEBUG:teuthology.orchestra.run.smithi043:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T23:11:59.823 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T23:11:59.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-24T23:11:59.944 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-24T23:11:59.944 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T23:11:59.973 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T23:11:59.987 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-24T23:11:59.997 DEBUG:teuthology.orchestra.run.smithi043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:12:00.018 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:12:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-04-24T23:12:00.045 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = core 2024-04-24T23:12:00.064 DEBUG:teuthology.orchestra.run.smithi043:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:12:00.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:12:00.105 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T23:12:00.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T23:12:00.110 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-24T23:12:00.121 INFO:teuthology.task.internal:Transferring archived files... 2024-04-24T23:12:00.122 DEBUG:teuthology.misc:Transferring archived files from smithi043:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672162/remote/smithi043 2024-04-24T23:12:00.122 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T23:12:00.171 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672162/remote/smithi162 2024-04-24T23:12:00.171 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T23:12:00.190 INFO:teuthology.task.internal:Removing archive directory... 2024-04-24T23:12:00.191 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T23:12:00.211 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T23:12:00.238 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-24T23:12:00.249 INFO:teuthology.task.internal:Not uploading archives. 2024-04-24T23:12:00.250 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-24T23:12:00.260 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-24T23:12:00.260 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T23:12:00.262 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T23:12:00.266 INFO:teuthology.orchestra.run.smithi043.stdout: 658625 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 23:12 /home/ubuntu/cephtest 2024-04-24T23:12:00.290 INFO:teuthology.orchestra.run.smithi162.stdout: 658462 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 23:12 /home/ubuntu/cephtest 2024-04-24T23:12:00.291 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-24T23:12:00.305 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-24T23:12:00.381 INFO:teuthology.run:Summary data: description: fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_blogbench traceless/50pc} duration: 1361.2691223621368 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-24T23:12:00.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T23:12:00.466 INFO:teuthology.run:pass